-- Logs begin at Sun 2022-08-28 00:10:33 UTC, end at Sun 2022-08-28 02:02:10 UTC. -- Aug 28 00:43:38.684347 dv-neutron-master-2-hyperv systemd[1]: Starting Devstack devstack@keystone.service... Aug 28 00:43:38.692000 dv-neutron-master-2-hyperv devstack@keystone.service[81793]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 28 00:43:38.703209 dv-neutron-master-2-hyperv devstack@keystone.service[81793]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Aug 28 00:43:38 2022] *** Aug 28 00:43:38.703209 dv-neutron-master-2-hyperv devstack@keystone.service[81793]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 28 00:43:38.703209 dv-neutron-master-2-hyperv devstack@keystone.service[81793]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 28 00:43:38.703209 dv-neutron-master-2-hyperv devstack@keystone.service[81793]: nodename: dv-neutron-master-2-hyperv Aug 28 00:43:38.703209 dv-neutron-master-2-hyperv devstack@keystone.service[81793]: machine: x86_64 Aug 28 00:43:38.703209 dv-neutron-master-2-hyperv devstack@keystone.service[81793]: clock source: unix Aug 28 00:43:38.703209 dv-neutron-master-2-hyperv devstack@keystone.service[81793]: pcre jit disabled Aug 28 00:43:38.703209 dv-neutron-master-2-hyperv devstack@keystone.service[81793]: detected number of CPU cores: 4 Aug 28 00:43:38.703209 dv-neutron-master-2-hyperv devstack@keystone.service[81793]: current working directory: / Aug 28 00:43:38.703209 dv-neutron-master-2-hyperv devstack@keystone.service[81793]: detected binary path: /usr/bin/uwsgi-core Aug 28 00:43:38.703209 dv-neutron-master-2-hyperv devstack@keystone.service[81793]: your processes number limit is 47680 Aug 28 00:43:38.703209 dv-neutron-master-2-hyperv devstack@keystone.service[81793]: your memory page size is 4096 bytes Aug 28 00:43:38.703209 dv-neutron-master-2-hyperv devstack@keystone.service[81793]: detected max file descriptor number: 2048 Aug 28 00:43:38.703209 dv-neutron-master-2-hyperv devstack@keystone.service[81793]: lock engine: pthread robust mutexes Aug 28 00:43:38.703209 dv-neutron-master-2-hyperv devstack@keystone.service[81793]: thunder lock: enabled Aug 28 00:43:38.703209 dv-neutron-master-2-hyperv devstack@keystone.service[81793]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 28 00:43:38.703209 dv-neutron-master-2-hyperv devstack@keystone.service[81793]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 28 00:43:38.745449 dv-neutron-master-2-hyperv devstack@keystone.service[81793]: Python main interpreter initialized at 0x560e31c949c0 Aug 28 00:43:38.745449 dv-neutron-master-2-hyperv devstack@keystone.service[81793]: python threads support enabled Aug 28 00:43:38.745449 dv-neutron-master-2-hyperv devstack@keystone.service[81793]: your server socket listen backlog is limited to 100 connections Aug 28 00:43:38.745449 dv-neutron-master-2-hyperv devstack@keystone.service[81793]: your mercy for graceful operations on workers is 90 seconds Aug 28 00:43:38.745996 dv-neutron-master-2-hyperv devstack@keystone.service[81793]: mapped 403077 bytes (393 KB) for 2 cores Aug 28 00:43:38.745996 dv-neutron-master-2-hyperv devstack@keystone.service[81793]: *** Operational MODE: preforking *** Aug 28 00:43:38.746180 dv-neutron-master-2-hyperv devstack@keystone.service[81793]: *** uWSGI is running in multiple interpreter mode *** Aug 28 00:43:38.746180 dv-neutron-master-2-hyperv devstack@keystone.service[81793]: spawned uWSGI master process (pid: 81793) Aug 28 00:43:38.746410 dv-neutron-master-2-hyperv systemd[1]: Started Devstack devstack@keystone.service. Aug 28 00:43:38.747812 dv-neutron-master-2-hyperv devstack@keystone.service[81793]: spawned uWSGI worker 1 (pid: 81807, cores: 1) Aug 28 00:43:38.747812 dv-neutron-master-2-hyperv devstack@keystone.service[81793]: spawned uWSGI worker 2 (pid: 81808, cores: 1) Aug 28 00:43:38.747812 dv-neutron-master-2-hyperv devstack@keystone.service[81793]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 28 00:43:43.006120 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 28 00:43:43.006120 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: from cryptography.utils import int_from_bytes Aug 28 00:43:43.006921 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 28 00:43:43.006921 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: from cryptography.utils import int_from_bytes Aug 28 00:43:43.028663 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 28 00:43:43.028663 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: from cryptography.utils import int_from_bytes Aug 28 00:43:43.029248 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 28 00:43:43.029248 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: from cryptography.utils import int_from_bytes Aug 28 00:43:43.055814 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 28 00:43:43.056025 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 28 00:43:43.056190 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] command line args: [] {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 28 00:43:43.056458 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 28 00:43:43.056586 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] ================================================================================ {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 28 00:43:43.056871 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] admin_token = **** {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.057115 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] config_dir = [] {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.057303 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.057431 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] config_source = [] {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.057641 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] debug = True {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.057835 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.058168 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.058380 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.058628 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.058855 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.059086 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] list_limit = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.059265 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] log_config_append = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.059465 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.059625 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] log_dir = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.059837 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] log_file = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.060064 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.060323 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.060557 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.060828 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.060998 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.061151 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.061395 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.061638 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.061870 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.062101 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.062331 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.062565 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.062807 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.063052 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.063324 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.063845 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.49/identity {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.064025 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] publish_errors = False {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.064255 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.064484 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.064659 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.064903 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.065135 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.065368 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] standard_threads = False {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.065597 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.065837 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.066011 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.066185 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] use_journal = False {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.066359 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] use_json = False {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.066531 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] use_stderr = False {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.066704 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] use_syslog = False {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.066931 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.067187 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.067428 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.067707 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.067950 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.068199 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.068437 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.068683 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.068918 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.069164 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.069410 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.069662 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.069896 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.070142 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.070376 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.070622 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.070867 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.071107 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.071361 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.071613 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.071885 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.072120 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.072374 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.072638 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.072889 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.073137 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.073367 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.073597 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.073827 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.074063 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.074314 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.074561 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.074792 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.075077 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.075325 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.075571 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.075843 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.076076 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.076297 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 28 00:43:43.076388 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.076528 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 28 00:43:43.076663 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.076741 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] command line args: [] {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 28 00:43:43.076812 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.076980 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 28 00:43:43.077103 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.077243 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] ================================================================================ {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 28 00:43:43.077326 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.077398 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] admin_token = **** {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.077466 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.077637 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] config_dir = [] {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.077772 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.077862 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.077936 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.078007 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] config_source = [] {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.078082 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.078158 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] debug = True {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.078324 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.078447 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.078552 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.078626 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.078734 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.078834 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.078999 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.079137 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.079219 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.079291 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.079458 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] list_limit = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.079593 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.079746 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] log_config_append = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.080157 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.080232 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.080302 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.080377 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] log_dir = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.080456 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.080527 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] log_file = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.080701 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.080835 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.080915 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.080986 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.081124 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.081208 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.081379 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.081515 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.081598 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.081670 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.081748 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.081822 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.081962 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.082086 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.082167 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.082321 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.082404 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.082510 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.082595 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.082776 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.082900 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.082977 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.083066 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.083233 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.083357 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.083434 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.083504 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.083723 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.083854 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.083937 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.084218 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.084340 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.49/identity {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.084419 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.084507 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] publish_errors = False {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.084685 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.084816 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.084902 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.084982 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.085063 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.085142 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.085305 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.085439 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.085524 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.085597 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.085757 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] standard_threads = False {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.085881 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.085958 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.086029 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.086219 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.086343 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.086439 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.086513 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.086583 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] use_journal = False {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.086724 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] use_json = False {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.086845 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.087006 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] use_stderr = False {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.087086 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.087156 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] use_syslog = False {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.087224 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.087307 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 28 00:43:43.087380 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.087488 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.087579 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.087782 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.087922 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.088002 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.088074 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.088271 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.088406 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.088491 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.088565 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.088751 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.088904 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.089022 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.089140 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.089246 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.089348 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.089443 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.089536 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.089663 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.089771 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.089899 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.089988 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.090138 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.090233 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.090358 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.090434 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.090622 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.090739 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.090867 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.090944 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.091076 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.091196 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.091353 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.091476 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.091564 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.091640 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.091818 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.091937 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.092092 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.092215 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.092302 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.092389 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.092565 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.092660 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.092794 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] auth.external = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.092876 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.093026 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.093109 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.093306 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.093403 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.093538 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.093620 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.093737 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] auth.password = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.093810 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.093985 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] auth.token = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.094081 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.094216 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.094297 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.094419 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.094493 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.094678 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.094769 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.094908 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.095031 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.095134 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.095215 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.095390 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.095479 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.095620 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.095766 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.095872 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] credential.caching = True {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.095954 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.096128 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.096218 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.096362 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.096445 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.096599 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.096681 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.096839 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.096929 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.097067 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.097148 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.097298 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.097380 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.097532 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.097623 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.097763 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.097845 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.097987 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.098064 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.098237 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.098320 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.098468 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.098544 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.098709 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.098787 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.098942 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.099028 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.099183 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.099260 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.099421 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.099500 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.099696 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.099865 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] federation.caching = True {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.099950 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.100028 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.100162 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.100240 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.100403 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.100480 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.100643 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.100722 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.100881 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.100959 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.101119 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.101197 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.101355 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.101433 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.101597 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.101672 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.101833 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.101916 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.102072 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.102151 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.102307 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.102391 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.102540 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] identity.caching = True {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.102616 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.102791 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.102880 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.103022 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.103100 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.103261 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.103344 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.103497 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.103575 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.103765 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.103847 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.103998 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.104077 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.104236 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.104316 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.104487 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.104567 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.104725 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.104810 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.104962 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.105039 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.105196 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.105275 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.105428 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.105506 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.105671 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.105754 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.105912 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.106000 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.106180 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.106265 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.106420 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.106501 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.106670 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.106750 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.106907 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.106989 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.107142 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.107222 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.107380 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.107461 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.107609 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.107730 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.107873 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.107950 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.108104 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.108183 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.108342 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.108422 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.108584 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.108663 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.108827 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.108907 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.109064 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.109142 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.109294 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.109371 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.109534 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.109613 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.109772 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.109851 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.110006 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.110084 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.110244 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.110323 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.110478 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.110562 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.110709 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.110786 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.110944 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.111024 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.111177 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.111257 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.111411 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.111480 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.111648 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.111737 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.111918 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.111985 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.112155 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.112234 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.112391 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.112458 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.112639 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.112715 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.112887 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.113038 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.113103 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.113163 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] auth.external = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.113337 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.113406 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.113584 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.113660 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.113830 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.113898 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.114065 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.114134 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] auth.password = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.114299 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] auth.token = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.114375 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.114535 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.114605 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.114767 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] ldap.user = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.114837 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.115009 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.115084 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.115240 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.115321 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.115487 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.115554 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.115758 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.115841 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.115996 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.116064 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.116236 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] credential.caching = True {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.116303 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.116468 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.116543 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.116700 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.116815 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.116922 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.117003 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.117159 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.117247 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.117396 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.117476 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.117626 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.117705 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.117872 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.117959 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.118118 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.118196 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.118355 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.118431 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.118597 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.118682 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.118842 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.118924 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.119072 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.119149 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.119319 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.119406 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.119559 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.119640 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.119828 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.119907 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.120067 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.120155 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] federation.caching = True {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.120301 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.120380 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.120546 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.120624 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.120795 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.120881 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.121025 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.121103 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.121277 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.121356 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.121505 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.121590 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.121773 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.121859 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.122064 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.122152 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.122304 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.122393 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.122540 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.122619 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.122789 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.122930 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.123030 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] identity.caching = True {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.123180 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.123281 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.123419 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.123532 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.123733 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.123830 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.123929 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] resource.caching = True {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.124009 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.124183 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.124262 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.124434 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.124525 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.124674 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.124751 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.124925 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.125003 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.125178 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.125264 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.125411 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.125489 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.125647 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.125725 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.125881 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.125971 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.126120 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.126197 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.126358 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] role.caching = True {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.126442 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.126605 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.126695 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] role.driver = sql {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.126837 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.126915 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.127086 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.127164 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.127336 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.127423 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.127589 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.127751 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.127852 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.127986 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.128089 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.128182 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.128341 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.128477 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.128589 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.128714 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.128837 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.128957 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.129071 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.129203 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.129325 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.129447 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.129550 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.129700 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.129787 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.129935 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.130034 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.130191 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.130441 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.130527 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.130681 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.130760 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.130931 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.131010 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.131186 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.131287 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.131417 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.131496 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.131657 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.131827 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.131918 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.132051 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.132130 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.132203 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.132363 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.132448 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.132613 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.132692 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.132844 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.132920 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.133077 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.133155 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.133310 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.133390 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.133559 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.133637 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.133793 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.133870 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.134028 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.134111 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.134270 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.134348 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.134506 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.134584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.134736 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.134816 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.134971 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.135049 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] token.caching = True {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.135203 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.135282 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.135435 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] ldap.user = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.135514 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.135692 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.135773 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.135946 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.136025 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.136181 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.136257 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.136412 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.136491 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.136652 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.136732 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.136894 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.136974 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.137129 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.137206 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.137365 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.137466 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.137623 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.137703 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.137854 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.137931 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.138089 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.138166 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.138321 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.138400 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.138569 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.138648 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.138811 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.138898 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.139056 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.139141 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.139306 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.139384 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] database.connection = **** {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.139551 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.139628 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.139805 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.139896 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.140059 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.140137 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.140298 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.140375 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.140532 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.140618 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.140767 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.140845 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.141003 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.141080 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.141237 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.141323 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.141481 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.141560 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.141715 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.141794 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.141958 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.142044 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.142192 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.142269 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.142437 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.142514 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.142673 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.142760 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.142908 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.142985 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.143138 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.143215 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.143379 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.143465 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.143613 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.143740 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.143816 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 28 00:43:43.143888 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.144096 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.144341 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] resource.caching = True {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.144595 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.144845 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.145085 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.145336 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.145589 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.145830 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.146078 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.146316 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.146557 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.146795 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] role.caching = True {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.147043 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] role.driver = sql {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.147276 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.147524 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.147796 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.148049 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.148295 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.148542 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.148788 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.149034 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.149283 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.149516 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.149770 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.150019 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.150269 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.150517 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.150945 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.151183 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.151435 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.151702 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.151956 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.152208 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.152446 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.152699 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.152952 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.153269 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.153506 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.153742 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.153977 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.154229 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.154487 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.154737 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.154977 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.155216 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.155448 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.155700 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] token.caching = True {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.155943 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.156191 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.156429 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.156684 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.156933 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.157173 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.157417 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.157662 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.157910 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.158146 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.158387 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.158622 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.158876 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.159153 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.159386 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.159631 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.159934 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.160202 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] database.connection = **** {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.160448 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.160696 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.160935 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.161177 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.161413 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.161652 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.161888 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.162125 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.162824 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.162824 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.162824 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.163122 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.163371 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.163598 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.163833 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.164127 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.164317 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.164548 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 28 00:43:43.164711 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 28 00:43:43.172987 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81807) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:43:43.173217 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81807) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:43:43.173442 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81807) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:43:43.181895 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81807) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:43:43.189811 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81808) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:43:43.190062 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81808) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:43:43.190286 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81808) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:43:43.198735 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81808) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:43:43.210260 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81807) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:43:43.210506 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81807) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:43:43.224767 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81808) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:43:43.225099 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81808) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:43:43.268904 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81807) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:43:43.272285 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81808) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:43:43.317796 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81807) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:43:43.317986 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81807) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:43:43.319534 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81808) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:43:43.319801 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81808) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:43:43.473953 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81807) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:43:43.474260 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81807) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:43:43.474352 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81807) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:43:43.474591 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81807) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:43:43.474742 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81808) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:43:43.474838 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81807) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:43:43.474913 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81808) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:43:43.474975 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81807) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:43:43.475089 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81808) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:43:43.475338 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81808) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:43:43.475562 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81808) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:43:43.475778 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81808) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:43:43.497982 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81807) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:43:43.498149 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81808) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:43:43.498220 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81807) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:43:43.498347 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81808) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:43:43.498440 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81807) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:43:43.498584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81808) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:43:43.498714 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81807) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:43:43.498795 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81808) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:43:43.498872 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81807) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:43:43.499063 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81807) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:43:43.499185 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81808) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:43:43.499254 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81807) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:43:43.499316 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81808) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:43:43.499403 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81808) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:43:43.510286 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81807) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:43:43.510751 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81808) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:43:43.523384 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81807) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:43:43.523558 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81807) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:43:43.523720 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81808) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:43:43.523840 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81807) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:43:43.523909 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81808) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:43:43.523985 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81807) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:43:43.524048 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81808) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:43:43.524162 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81807) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:43:43.524305 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81808) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:43:43.524386 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81807) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:43:43.524449 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81808) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:43:43.524567 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81807) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:43:43.524698 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81808) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:43:43.524785 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81808) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 28 00:43:43.541586 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.541773 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 28 00:43:43.542127 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.542252 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.542324 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 28 00:43:43.542434 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 28 00:43:43.542583 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.542709 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.542815 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.542929 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 28 00:43:43.543051 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.543176 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.543299 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.543425 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.543592 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.544005 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.554067 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.554430 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.554703 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.554985 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.556820 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.557113 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.557396 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.557677 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.562050 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81807) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:43:43.564820 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81808) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:43:43.564991 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81807) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:43:43.565209 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.565512 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.565792 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.566047 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.566335 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.566584 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.566858 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.567130 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.567406 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.567685 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.567790 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81808) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:43:43.568000 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.568276 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.568568 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.568852 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.569119 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.569387 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.569664 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.569948 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.570202 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.570487 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.590513 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.592035 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81807) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:43:43.592300 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.593626 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.595130 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81808) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:43:43.595418 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.596828 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81807) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:43:43.597111 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.597389 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.600178 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81808) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:43:43.600461 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.600747 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.603839 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81807) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:43:43.604131 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.607548 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81808) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:43:43.607860 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.608132 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81807) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:43:43.608458 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.608810 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.609015 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.609258 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.611503 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.611853 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.612138 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.612256 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81808) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:43:43.612435 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.612738 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.613054 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.613324 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.613603 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.613864 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.614164 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.627966 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.628233 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.632076 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81807) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:43:43.632517 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.632925 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.635110 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.635403 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.638626 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81808) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:43:43.639911 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81807) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:43:43.642563 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.642892 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.643268 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81807) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:43:43.646542 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.646856 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.647139 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.647432 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.647688 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.647790 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81808) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:43:43.648116 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.650787 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81808) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:43:43.654078 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.654375 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.654662 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.654944 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.655224 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.655510 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.663708 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81807) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:43:43.664018 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.664303 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.664551 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.671193 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81808) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:43:43.671342 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.671459 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.671789 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.672063 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.673011 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.674539 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.674817 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.677475 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81807) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:43:43.677759 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.678039 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.678327 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.678606 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.678877 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.680422 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.681951 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.682234 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.684921 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81808) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:43:43.685209 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.685484 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.685766 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.686158 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.690124 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81807) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:43:43.690406 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.690700 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.690982 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.691262 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.691536 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.691845 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.697382 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81808) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:43:43.697669 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.697955 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.698234 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.698619 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.698900 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.699188 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.707445 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81807) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:43:43.710467 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81807) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:43:43.713362 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.714793 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.714918 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81808) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:43:43.716325 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81807) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:43:43.716585 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.716897 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.717795 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81808) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:43:43.720828 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.722132 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.723340 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.723560 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81808) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:43:43.723895 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.724293 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.724834 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81807) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:43:43.727706 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.727993 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.728279 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.728594 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.730641 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.732195 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81808) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:43:43.735057 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.735464 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.735795 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.736086 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.736527 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81807) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:43:43.736813 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.737095 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.743858 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81808) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:43:43.743988 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81807) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:43:43.744156 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.744292 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.744460 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.744546 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.744714 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.744995 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.745275 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.745562 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.745827 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.746096 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.746364 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.746633 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.746918 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.747202 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.747469 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81807) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.751268 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81808) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 28 00:43:43.751554 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.751871 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.752139 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.752422 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.752694 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.752978 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.753256 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.753532 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.753801 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.754080 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.754354 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.754618 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.754894 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81808) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 28 00:43:43.781259 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x560e31c949c0 pid: 81807 (default app) Aug 28 00:43:43.784733 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f3479-de2c-43f8-945d-83e5e235559c None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:43.785022 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f3479-de2c-43f8-945d-83e5e235559c None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:43.785292 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f3479-de2c-43f8-945d-83e5e235559c None None] PATH_INFO: `/v3` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:43.788791 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x560e31c949c0 pid: 81808 (default app) Aug 28 00:43:43.789453 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1/1] 10.222.0.49 () {50 vars in 791 bytes} [Sun Aug 28 00:43:43 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:43:50.318069 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa2e9c-ef25-4464-9bab-c478c69fbbfb None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:50.318623 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa2e9c-ef25-4464-9bab-c478c69fbbfb None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:50.318623 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa2e9c-ef25-4464-9bab-c478c69fbbfb None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:50.322990 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1/2] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:43:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:43:50.329321 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86097c1f-5744-4b95-8ac1-f6cffd36810b None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:50.330231 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86097c1f-5744-4b95-8ac1-f6cffd36810b None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:50.330231 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86097c1f-5744-4b95-8ac1-f6cffd36810b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:50.399999 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: INFO dbcounter [None req-86097c1f-5744-4b95-8ac1-f6cffd36810b None None] Registered counter for database keystone Aug 28 00:43:50.419617 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG oslo_db.sqlalchemy.engines [None req-86097c1f-5744-4b95-8ac1-f6cffd36810b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81807) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 28 00:43:50.427202 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writer thread running {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 28 00:43:50.608182 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG passlib.handlers.bcrypt [None req-86097c1f-5744-4b95-8ac1-f6cffd36810b None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81807) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 28 00:43:50.608517 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG passlib.handlers.bcrypt [None req-86097c1f-5744-4b95-8ac1-f6cffd36810b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81807) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 28 00:43:50.666233 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-86097c1f-5744-4b95-8ac1-f6cffd36810b None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:43:50.667905 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-86097c1f-5744-4b95-8ac1-f6cffd36810b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:43:50.802922 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 2/3] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:43:50 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 475 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 28 00:43:51.309214 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa2e9c-ef25-4464-9bab-c478c69fbbfb None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:51.382391 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: INFO dbcounter [None req-92aa2e9c-ef25-4464-9bab-c478c69fbbfb None None] Registered counter for database keystone Aug 28 00:43:51.404567 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG oslo_db.sqlalchemy.engines [None req-92aa2e9c-ef25-4464-9bab-c478c69fbbfb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81808) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 28 00:43:51.411999 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writer thread running {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 28 00:43:51.527841 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa2e9c-ef25-4464-9bab-c478c69fbbfb None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:51.532685 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0501354-f82c-4eb4-ad21-456fd2e216cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:51.533309 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0501354-f82c-4eb4-ad21-456fd2e216cd admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:51.533584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0501354-f82c-4eb4-ad21-456fd2e216cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:51.533852 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0501354-f82c-4eb4-ad21-456fd2e216cd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:51.542303 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0501354-f82c-4eb4-ad21-456fd2e216cd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:51.593321 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b0501354-f82c-4eb4-ad21-456fd2e216cd admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 28 00:43:51.593581 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0501354-f82c-4eb4-ad21-456fd2e216cd admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:51.603495 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 2/4] 10.222.0.49 () {58 vars in 1324 bytes} [Sun Aug 28 00:43:51 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 00:43:51.609866 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86097c1f-5744-4b95-8ac1-f6cffd36810b None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:51.624627 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86097c1f-5744-4b95-8ac1-f6cffd36810b None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:51.630345 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ee91f4-15ff-4c60-9c90-6829217a9916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:51.631474 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee91f4-15ff-4c60-9c90-6829217a9916 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:51.631784 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee91f4-15ff-4c60-9c90-6829217a9916 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:51.632051 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee91f4-15ff-4c60-9c90-6829217a9916 admin admin] PATH_INFO: `/v3/projects/8f4ff55387564b158cecc09304291ac9` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:51.633754 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ee91f4-15ff-4c60-9c90-6829217a9916 admin admin] RBAC: Authorizing `identity:get_project(project_id=8f4ff55387564b158cecc09304291ac9)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:51.686423 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: WARNING keystone.common.rbac_enforcer.enforcer [None req-49ee91f4-15ff-4c60-9c90-6829217a9916 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 28 00:43:51.686759 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ee91f4-15ff-4c60-9c90-6829217a9916 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:51.691765 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 3/5] 10.222.0.49 () {56 vars in 1207 bytes} [Sun Aug 28 00:43:51 2022] GET /identity/v3/projects/8f4ff55387564b158cecc09304291ac9 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:43:53.557174 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573bedf8-a6ad-4921-aeb8-bfe0d48afdc9 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:53.557719 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573bedf8-a6ad-4921-aeb8-bfe0d48afdc9 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:53.557719 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573bedf8-a6ad-4921-aeb8-bfe0d48afdc9 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:53.562000 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 3/6] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:43:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:43:53.568037 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73817d10-daa4-4332-8a6d-6e51409697ac None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:53.568486 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73817d10-daa4-4332-8a6d-6e51409697ac None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:53.568568 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73817d10-daa4-4332-8a6d-6e51409697ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:53.589876 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-73817d10-daa4-4332-8a6d-6e51409697ac None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:43:53.591524 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-73817d10-daa4-4332-8a6d-6e51409697ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:43:53.600037 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 4/7] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:43:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 28 00:43:53.863401 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573bedf8-a6ad-4921-aeb8-bfe0d48afdc9 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:53.877500 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573bedf8-a6ad-4921-aeb8-bfe0d48afdc9 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:53.882256 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee01a2-f0eb-40e1-8e32-d9f2a052f4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:53.882865 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee01a2-f0eb-40e1-8e32-d9f2a052f4a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:53.883146 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee01a2-f0eb-40e1-8e32-d9f2a052f4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:53.883420 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee01a2-f0eb-40e1-8e32-d9f2a052f4a9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:53.891810 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee01a2-f0eb-40e1-8e32-d9f2a052f4a9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:53.893614 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee01a2-f0eb-40e1-8e32-d9f2a052f4a9 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:53.902263 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 4/8] 10.222.0.49 () {58 vars in 1324 bytes} [Sun Aug 28 00:43:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 00:43:53.908104 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73817d10-daa4-4332-8a6d-6e51409697ac None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:53.918339 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73817d10-daa4-4332-8a6d-6e51409697ac None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:53.924173 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57121cae-0983-42a2-a4b6-aaaf512c7ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:53.924815 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57121cae-0983-42a2-a4b6-aaaf512c7ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:53.925096 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57121cae-0983-42a2-a4b6-aaaf512c7ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:53.925363 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57121cae-0983-42a2-a4b6-aaaf512c7ae1 admin admin] PATH_INFO: `/v3/users/8474eba1fd11486db87ca8aa2a114668` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:53.926825 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57121cae-0983-42a2-a4b6-aaaf512c7ae1 admin admin] RBAC: Authorizing `identity:get_user(user_id=8474eba1fd11486db87ca8aa2a114668)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:53.928717 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57121cae-0983-42a2-a4b6-aaaf512c7ae1 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:53.930267 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 5/9] 10.222.0.49 () {56 vars in 1198 bytes} [Sun Aug 28 00:43:53 2022] GET /identity/v3/users/8474eba1fd11486db87ca8aa2a114668 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:43:55.921324 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c584b-6622-4054-91da-3e0d5d9eeb90 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:55.921906 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c584b-6622-4054-91da-3e0d5d9eeb90 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:55.921906 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c584b-6622-4054-91da-3e0d5d9eeb90 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:55.923176 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 5/10] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:43:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:43:55.928883 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89017e-3305-43dc-b805-e011f48d695c None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:55.929349 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89017e-3305-43dc-b805-e011f48d695c None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:55.929509 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89017e-3305-43dc-b805-e011f48d695c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:55.950188 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-5a89017e-3305-43dc-b805-e011f48d695c None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:43:55.951409 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-5a89017e-3305-43dc-b805-e011f48d695c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:43:55.980444 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452dc340-6997-4292-a127-e5a1d9f270b3 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:55.980677 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452dc340-6997-4292-a127-e5a1d9f270b3 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:55.980898 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452dc340-6997-4292-a127-e5a1d9f270b3 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:55.982486 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 6/11] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:43:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:43:55.989781 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d4831e-9bc7-4a4a-a960-ba7e5d1476e7 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:55.990014 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d4831e-9bc7-4a4a-a960-ba7e5d1476e7 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:55.990390 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d4831e-9bc7-4a4a-a960-ba7e5d1476e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:56.035133 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG passlib.handlers.bcrypt [None req-86d4831e-9bc7-4a4a-a960-ba7e5d1476e7 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81808) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 28 00:43:56.035554 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG passlib.handlers.bcrypt [None req-86d4831e-9bc7-4a4a-a960-ba7e5d1476e7 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81808) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 28 00:43:56.042526 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 6/12] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:43:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:43:56.081000 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-86d4831e-9bc7-4a4a-a960-ba7e5d1476e7 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:43:56.082612 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-86d4831e-9bc7-4a4a-a960-ba7e5d1476e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:43:56.185019 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 7/13] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:43:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:43:56.305622 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a89017e-3305-43dc-b805-e011f48d695c None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:56.333306 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:56.416229 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a89017e-3305-43dc-b805-e011f48d695c None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:56.450551 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d4831e-9bc7-4a4a-a960-ba7e5d1476e7 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:56.451606 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dfa41e-fbf9-4f42-8aa9-325135372b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:56.452276 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dfa41e-fbf9-4f42-8aa9-325135372b2f None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:56.452557 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dfa41e-fbf9-4f42-8aa9-325135372b2f None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:56.452831 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dfa41e-fbf9-4f42-8aa9-325135372b2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:56.524730 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dfa41e-fbf9-4f42-8aa9-325135372b2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:56.526231 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dfa41e-fbf9-4f42-8aa9-325135372b2f None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:56.550264 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:56.560335 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d4831e-9bc7-4a4a-a960-ba7e5d1476e7 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:56.562985 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:56.600676 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec1cb7-9fd6-4e09-af0b-606c5269e9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:56.601791 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec1cb7-9fd6-4e09-af0b-606c5269e9da None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:56.602071 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec1cb7-9fd6-4e09-af0b-606c5269e9da None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:56.602343 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec1cb7-9fd6-4e09-af0b-606c5269e9da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:56.616197 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ec1cb7-9fd6-4e09-af0b-606c5269e9da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:43:56.625049 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-f2ec1cb7-9fd6-4e09-af0b-606c5269e9da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:43:56.625049 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:43:56.625049 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:43:56.625049 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:43:56.625049 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:43:56.625049 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:43:56.625049 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:43:56.625049 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:43:56.625049 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:43:56.625049 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:43:56.625049 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:43:56.625049 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:43:56.625049 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:43:56.625049 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:43:56.625049 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:43:56.625049 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:43:56.626267 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:43:56.626267 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:43:56.626267 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:43:56.626267 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:43:56.626267 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:43:56.626267 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:43:56.626267 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:43:56.626267 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:43:56.626267 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:43:56.626267 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:43:56.626267 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:43:56.626267 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:43:56.626267 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:43:56.626267 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:43:56.626267 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:43:56.626267 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:43:56.627385 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:43:56.627385 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:43:56.627385 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:43:56.627385 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:43:56.627385 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:43:56.627385 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:43:56.627385 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:43:56.627385 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:43:56.627385 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:43:56.627385 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:43:56.627385 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:43:56.627385 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:43:56.627385 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 8/14] 10.222.0.49 () {56 vars in 1096 bytes} [Sun Aug 28 00:43:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:43:56.632561 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec1cb7-9fd6-4e09-af0b-606c5269e9da None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:56.633043 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 7/15] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 28 00:43:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:43:56.638746 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dfa41e-fbf9-4f42-8aa9-325135372b2f None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:56.739550 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec1cb7-9fd6-4e09-af0b-606c5269e9da None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:56.747777 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dfa41e-fbf9-4f42-8aa9-325135372b2f None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:56.772176 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:56.778214 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8a1a0-bb2b-49de-87ab-a3629c4af102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:56.778838 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8a1a0-bb2b-49de-87ab-a3629c4af102 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:56.779122 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8a1a0-bb2b-49de-87ab-a3629c4af102 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:56.779392 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8a1a0-bb2b-49de-87ab-a3629c4af102 None admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:56.780119 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec8a1a0-bb2b-49de-87ab-a3629c4af102 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:43:56.780421 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec8a1a0-bb2b-49de-87ab-a3629c4af102 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:56.781918 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec8a1a0-bb2b-49de-87ab-a3629c4af102 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:56.784473 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e9054e-4013-4ac1-a99d-f58ec84ef6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:56.785114 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e9054e-4013-4ac1-a99d-f58ec84ef6eb None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:56.785389 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e9054e-4013-4ac1-a99d-f58ec84ef6eb None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:56.785658 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e9054e-4013-4ac1-a99d-f58ec84ef6eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:56.794728 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 9/16] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 28 00:43:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:43:56.799709 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e9054e-4013-4ac1-a99d-f58ec84ef6eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:56.800500 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8a1a0-bb2b-49de-87ab-a3629c4af102 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:56.801236 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e9054e-4013-4ac1-a99d-f58ec84ef6eb None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:56.821394 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-d7e9054e-4013-4ac1-a99d-f58ec84ef6eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:43:56.821394 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:43:56.821394 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:43:56.821394 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:43:56.821394 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:43:56.821394 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:43:56.821394 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:43:56.821394 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:43:56.821394 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:43:56.821394 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:43:56.821394 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:43:56.821394 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:43:56.821394 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:43:56.821394 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:43:56.821394 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:43:56.821394 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:43:56.822516 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:43:56.822516 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:43:56.822516 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:43:56.822516 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:43:56.822516 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:43:56.822516 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:43:56.822516 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:43:56.822516 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:43:56.822516 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:43:56.822516 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:43:56.822516 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:43:56.822516 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:43:56.822516 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:43:56.822516 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:43:56.822516 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:43:56.822516 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:43:56.822516 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:43:56.823510 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:43:56.823510 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:43:56.823510 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:43:56.823510 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 8/17] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:43:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:43:56.828407 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e9054e-4013-4ac1-a99d-f58ec84ef6eb None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:56.831018 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:56.911851 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8a1a0-bb2b-49de-87ab-a3629c4af102 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:56.935203 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e9054e-4013-4ac1-a99d-f58ec84ef6eb None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:56.950687 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6681c1d9-8d86-4328-8d30-0a3688b21eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:56.951430 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681c1d9-8d86-4328-8d30-0a3688b21eb2 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:56.951612 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681c1d9-8d86-4328-8d30-0a3688b21eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:56.951916 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681c1d9-8d86-4328-8d30-0a3688b21eb2 None admin] PATH_INFO: `/v3/users/8474eba1fd11486db87ca8aa2a114668` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:56.953492 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6681c1d9-8d86-4328-8d30-0a3688b21eb2 None admin] RBAC: Authorizing `identity:get_user(user_id=8474eba1fd11486db87ca8aa2a114668)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:56.954962 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6681c1d9-8d86-4328-8d30-0a3688b21eb2 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:56.957027 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 10/18] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 28 00:43:56 2022] GET /identity/v3/users/8474eba1fd11486db87ca8aa2a114668 => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:43:56.962942 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6681c1d9-8d86-4328-8d30-0a3688b21eb2 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:56.974832 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ca9ced-9aa7-45ae-987d-78fe09367ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:56.975826 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca9ced-9aa7-45ae-987d-78fe09367ea5 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:56.976250 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca9ced-9aa7-45ae-987d-78fe09367ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:56.976583 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca9ced-9aa7-45ae-987d-78fe09367ea5 None admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:56.977417 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ca9ced-9aa7-45ae-987d-78fe09367ea5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:43:56.977931 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ca9ced-9aa7-45ae-987d-78fe09367ea5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:56.980139 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ca9ced-9aa7-45ae-987d-78fe09367ea5 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:56.998200 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 9/19] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:43:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:43:57.072658 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:57.083227 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6681c1d9-8d86-4328-8d30-0a3688b21eb2 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:57.129699 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77731e94-8868-4a54-a0d2-e2a0b2827176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:57.130381 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77731e94-8868-4a54-a0d2-e2a0b2827176 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:57.130645 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77731e94-8868-4a54-a0d2-e2a0b2827176 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:57.131241 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77731e94-8868-4a54-a0d2-e2a0b2827176 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:57.132205 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77731e94-8868-4a54-a0d2-e2a0b2827176 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:57.133731 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77731e94-8868-4a54-a0d2-e2a0b2827176 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:57.135381 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 11/20] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:43:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:43:57.142302 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ca9ced-9aa7-45ae-987d-78fe09367ea5 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:43:57.189574 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:57.264997 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ca9ced-9aa7-45ae-987d-78fe09367ea5 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:43:57.301387 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa311f-280b-43a0-b6be-f1c49e220c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:43:57.302016 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa311f-280b-43a0-b6be-f1c49e220c62 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:57.302297 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa311f-280b-43a0-b6be-f1c49e220c62 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:57.302578 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa311f-280b-43a0-b6be-f1c49e220c62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:57.303324 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fa311f-280b-43a0-b6be-f1c49e220c62 None admin] RBAC: Adding query filter params (role.id=2e4889bb71f9434392c0baba59f2534e, scope.domain.id=default, user.id=8474eba1fd11486db87ca8aa2a114668) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:43:57.303634 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fa311f-280b-43a0-b6be-f1c49e220c62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:43:57.305157 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fa311f-280b-43a0-b6be-f1c49e220c62 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:43:57.312750 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 10/21] 10.222.0.49 () {56 vars in 1322 bytes} [Sun Aug 28 00:43:57 2022] GET /identity/v3/role_assignments?user.id=8474eba1fd11486db87ca8aa2a114668&scope.domain.id=default&role.id=2e4889bb71f9434392c0baba59f2534e => generated 233 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:43:59.138486 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c37c99-7b31-4d20-a40d-95e5a5bd4652 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:59.139475 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c37c99-7b31-4d20-a40d-95e5a5bd4652 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:59.139976 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c37c99-7b31-4d20-a40d-95e5a5bd4652 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:59.141544 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 12/22] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:43:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:43:59.150402 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8addfb2-4664-411c-93d1-d061dd302429 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:59.151332 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8addfb2-4664-411c-93d1-d061dd302429 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:59.151880 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8addfb2-4664-411c-93d1-d061dd302429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:59.180746 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-c8addfb2-4664-411c-93d1-d061dd302429 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:43:59.182317 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-c8addfb2-4664-411c-93d1-d061dd302429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:43:59.295073 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 11/23] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:43:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:43:59.466873 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3714e77-2337-4ef4-9fe2-db101e5435a8 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:59.467723 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3714e77-2337-4ef4-9fe2-db101e5435a8 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:59.468242 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3714e77-2337-4ef4-9fe2-db101e5435a8 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:59.469921 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 13/24] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:43:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:43:59.475862 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba4354-36c2-4172-a037-e9c0d6802a80 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:43:59.476472 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba4354-36c2-4172-a037-e9c0d6802a80 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:43:59.476979 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aba4354-36c2-4172-a037-e9c0d6802a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:43:59.504910 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-7aba4354-36c2-4172-a037-e9c0d6802a80 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:43:59.506549 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-7aba4354-36c2-4172-a037-e9c0d6802a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:43:59.540518 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:43:59.620677 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 12/25] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:43:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:43:59.875986 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3714e77-2337-4ef4-9fe2-db101e5435a8 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:00.020550 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3714e77-2337-4ef4-9fe2-db101e5435a8 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:00.051372 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055fec3f-3302-4353-bf28-9f5959b4b199 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:00.052088 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055fec3f-3302-4353-bf28-9f5959b4b199 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:00.052559 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055fec3f-3302-4353-bf28-9f5959b4b199 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:00.054571 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 13/26] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:44:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:44:00.060024 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80262376-0d7c-4cc9-b0a8-9f06bcda71f5 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:00.060603 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80262376-0d7c-4cc9-b0a8-9f06bcda71f5 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:00.061104 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80262376-0d7c-4cc9-b0a8-9f06bcda71f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:00.087630 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-80262376-0d7c-4cc9-b0a8-9f06bcda71f5 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:44:00.089339 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-80262376-0d7c-4cc9-b0a8-9f06bcda71f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:44:00.094113 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd87ca4-0861-43af-85ff-2f188f0c038f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:00.094827 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd87ca4-0861-43af-85ff-2f188f0c038f None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:00.095106 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd87ca4-0861-43af-85ff-2f188f0c038f None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:00.095377 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd87ca4-0861-43af-85ff-2f188f0c038f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:00.117824 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd87ca4-0861-43af-85ff-2f188f0c038f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:00.119681 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd87ca4-0861-43af-85ff-2f188f0c038f None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:00.139114 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-6bd87ca4-0861-43af-85ff-2f188f0c038f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:44:00.139114 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:44:00.139114 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:44:00.139114 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:44:00.139114 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:44:00.139114 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:44:00.139114 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:44:00.139114 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:44:00.139114 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:44:00.139114 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:44:00.139114 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:44:00.139114 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:44:00.139114 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:44:00.139114 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:44:00.139114 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:44:00.139114 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:44:00.140535 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:44:00.140535 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:44:00.140535 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:44:00.140535 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:44:00.140535 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:44:00.140535 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:44:00.140535 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:44:00.140535 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:44:00.140535 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:44:00.140535 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:44:00.140535 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:44:00.140535 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:44:00.140535 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:44:00.140535 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:44:00.140535 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:44:00.140535 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:44:00.140535 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:44:00.141364 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:44:00.141364 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:44:00.141364 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:44:00.141364 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 14/27] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:43:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:44:00.141364 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd87ca4-0861-43af-85ff-2f188f0c038f None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:00.163377 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:00.200149 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 14/28] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:44:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:44:00.202417 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa845c-55e8-45e4-9de2-cdc1fe53d518 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:00.202893 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa845c-55e8-45e4-9de2-cdc1fe53d518 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:00.203420 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa845c-55e8-45e4-9de2-cdc1fe53d518 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:00.204944 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 15/29] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:44:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:44:00.212852 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa845c-55e8-45e4-9de2-cdc1fe53d518 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:00.281262 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd87ca4-0861-43af-85ff-2f188f0c038f None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:00.324010 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc15b79d-6b1a-45f5-8fa3-2a85495584ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:00.325706 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc15b79d-6b1a-45f5-8fa3-2a85495584ec None admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:00.326200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc15b79d-6b1a-45f5-8fa3-2a85495584ec None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:00.326703 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc15b79d-6b1a-45f5-8fa3-2a85495584ec None admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:00.327623 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc15b79d-6b1a-45f5-8fa3-2a85495584ec None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:00.329362 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc15b79d-6b1a-45f5-8fa3-2a85495584ec None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:00.416578 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:00.452591 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa845c-55e8-45e4-9de2-cdc1fe53d518 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:00.478292 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 15/30] 10.222.0.49 () {60 vars in 1131 bytes} [Sun Aug 28 00:44:00 2022] POST /identity/v3/roles => generated 219 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:44:00.480605 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d99272b-4958-4b49-8a19-d74554605e32 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:00.481169 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d99272b-4958-4b49-8a19-d74554605e32 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:00.481909 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d99272b-4958-4b49-8a19-d74554605e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:00.514582 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-8d99272b-4958-4b49-8a19-d74554605e32 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:44:00.516584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-8d99272b-4958-4b49-8a19-d74554605e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:44:00.538778 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c94f404-f859-4b2f-9dc1-a7e112896fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:00.539872 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c94f404-f859-4b2f-9dc1-a7e112896fbc None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:00.540264 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c94f404-f859-4b2f-9dc1-a7e112896fbc None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:00.540752 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c94f404-f859-4b2f-9dc1-a7e112896fbc None admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:00.542155 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c94f404-f859-4b2f-9dc1-a7e112896fbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:00.542609 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c94f404-f859-4b2f-9dc1-a7e112896fbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:00.545340 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c94f404-f859-4b2f-9dc1-a7e112896fbc None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:00.584486 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 16/31] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:44:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:00.590817 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c94f404-f859-4b2f-9dc1-a7e112896fbc None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:00.609869 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 16/32] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:44:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:44:00.622209 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d99272b-4958-4b49-8a19-d74554605e32 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:00.626799 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:00.767638 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c94f404-f859-4b2f-9dc1-a7e112896fbc None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:00.768409 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d99272b-4958-4b49-8a19-d74554605e32 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:00.811535 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27973585-de4b-492b-b8dc-3c2627702889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:00.812207 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27973585-de4b-492b-b8dc-3c2627702889 None admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:00.812718 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27973585-de4b-492b-b8dc-3c2627702889 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:00.813074 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27973585-de4b-492b-b8dc-3c2627702889 None admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:00.813906 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27973585-de4b-492b-b8dc-3c2627702889 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:00.816066 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27973585-de4b-492b-b8dc-3c2627702889 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:00.835360 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 17/33] 10.222.0.49 () {60 vars in 1131 bytes} [Sun Aug 28 00:44:00 2022] POST /identity/v3/roles => generated 225 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:44:00.839336 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b9926-4a05-49e9-9bac-5f8dadb0e93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:00.839971 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b9926-4a05-49e9-9bac-5f8dadb0e93a None admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:00.840276 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b9926-4a05-49e9-9bac-5f8dadb0e93a None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:00.840569 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b9926-4a05-49e9-9bac-5f8dadb0e93a None admin] PATH_INFO: `/v3/projects` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:00.841275 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7b9926-4a05-49e9-9bac-5f8dadb0e93a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:00.842820 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7b9926-4a05-49e9-9bac-5f8dadb0e93a None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:00.876221 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c1fc3-cc18-427c-8893-52e3667d3878 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:00.876678 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c1fc3-cc18-427c-8893-52e3667d3878 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:00.876845 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c1fc3-cc18-427c-8893-52e3667d3878 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:00.878556 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 18/34] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:44:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:44:00.885985 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54aa60-e50c-4f3d-8c74-056cb1e4183f None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:00.886443 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54aa60-e50c-4f3d-8c74-056cb1e4183f None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:00.886706 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54aa60-e50c-4f3d-8c74-056cb1e4183f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:00.891649 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:00.930210 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-dc54aa60-e50c-4f3d-8c74-056cb1e4183f None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:44:00.931677 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-dc54aa60-e50c-4f3d-8c74-056cb1e4183f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:44:01.059646 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 17/35] 10.222.0.49 () {60 vars in 1141 bytes} [Sun Aug 28 00:44:00 2022] POST /identity/v3/projects => generated 301 bytes in 469 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:44:01.075296 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:01.089322 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 19/36] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:44:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:44:01.107348 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b9926-4a05-49e9-9bac-5f8dadb0e93a None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:01.268111 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b9926-4a05-49e9-9bac-5f8dadb0e93a None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:01.389228 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc54aa60-e50c-4f3d-8c74-056cb1e4183f None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:01.437327 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650fa525-823b-4937-b01f-18ccd5591164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:01.438389 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650fa525-823b-4937-b01f-18ccd5591164 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:01.439064 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650fa525-823b-4937-b01f-18ccd5591164 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:01.439349 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650fa525-823b-4937-b01f-18ccd5591164 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:01.460469 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650fa525-823b-4937-b01f-18ccd5591164 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:44:01.466969 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-650fa525-823b-4937-b01f-18ccd5591164 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:44:01.466969 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:44:01.466969 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:44:01.466969 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:44:01.466969 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:44:01.466969 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:44:01.466969 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:44:01.466969 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:44:01.466969 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:44:01.466969 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:44:01.466969 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:44:01.466969 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:44:01.466969 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:44:01.466969 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:44:01.466969 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:44:01.466969 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:44:01.468132 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:44:01.468132 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:44:01.468132 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:44:01.468132 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:44:01.468132 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:44:01.468132 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:44:01.468132 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:44:01.468132 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:44:01.468132 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:44:01.468132 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:44:01.468132 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:44:01.468132 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:44:01.468132 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:44:01.468132 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:44:01.468132 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:44:01.468132 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:44:01.468880 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:44:01.468880 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:44:01.468880 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:44:01.468880 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:44:01.468880 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:44:01.468880 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:44:01.468880 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:44:01.468880 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:44:01.468880 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:44:01.468880 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:44:01.468880 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:44:01.468880 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:44:01.468880 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 18/37] 10.222.0.49 () {56 vars in 1096 bytes} [Sun Aug 28 00:44:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:44:01.469502 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ceae1e-1cef-4299-a3f7-8eab361b890a None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:01.469788 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ceae1e-1cef-4299-a3f7-8eab361b890a None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:01.470107 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ceae1e-1cef-4299-a3f7-8eab361b890a None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:01.471988 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 19/38] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:44:01.474803 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ceae1e-1cef-4299-a3f7-8eab361b890a None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:01.516189 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc54aa60-e50c-4f3d-8c74-056cb1e4183f None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:01.540023 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:01.554257 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224a1a3b-655f-49b9-a4ae-4cbfac21ffbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:01.554921 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a1a3b-655f-49b9-a4ae-4cbfac21ffbe None admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:01.555197 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a1a3b-655f-49b9-a4ae-4cbfac21ffbe None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:01.555519 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a1a3b-655f-49b9-a4ae-4cbfac21ffbe None admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:01.556275 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224a1a3b-655f-49b9-a4ae-4cbfac21ffbe None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:01.557844 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224a1a3b-655f-49b9-a4ae-4cbfac21ffbe None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:01.576540 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 20/39] 10.222.0.49 () {60 vars in 1131 bytes} [Sun Aug 28 00:44:01 2022] POST /identity/v3/roles => generated 223 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:44:01.576540 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b40fcbc-da2b-42ad-b3a1-510e8a0f970e None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:01.576866 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b40fcbc-da2b-42ad-b3a1-510e8a0f970e None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:01.576866 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b40fcbc-da2b-42ad-b3a1-510e8a0f970e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:01.600885 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ceae1e-1cef-4299-a3f7-8eab361b890a None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:01.608206 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-6b40fcbc-da2b-42ad-b3a1-510e8a0f970e None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:44:01.609451 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-6b40fcbc-da2b-42ad-b3a1-510e8a0f970e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:44:01.657319 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc79af0-e38d-4363-9cd6-fa97ded04658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:01.658368 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc79af0-e38d-4363-9cd6-fa97ded04658 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:01.658904 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc79af0-e38d-4363-9cd6-fa97ded04658 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:01.659167 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc79af0-e38d-4363-9cd6-fa97ded04658 None admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:01.660249 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc79af0-e38d-4363-9cd6-fa97ded04658 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:01.662296 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc79af0-e38d-4363-9cd6-fa97ded04658 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:01.662468 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc79af0-e38d-4363-9cd6-fa97ded04658 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:01.678948 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 20/40] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 28 00:44:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:44:01.685122 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc79af0-e38d-4363-9cd6-fa97ded04658 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:01.686539 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:01.709730 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 21/41] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:44:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:44:01.834805 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc79af0-e38d-4363-9cd6-fa97ded04658 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:01.858623 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:01.874448 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a89290-98e7-4b5d-9f94-c3777c496227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:01.875494 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a89290-98e7-4b5d-9f94-c3777c496227 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:01.875852 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a89290-98e7-4b5d-9f94-c3777c496227 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:01.876236 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a89290-98e7-4b5d-9f94-c3777c496227 None admin] PATH_INFO: `/v3/users/8474eba1fd11486db87ca8aa2a114668` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:01.877787 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a89290-98e7-4b5d-9f94-c3777c496227 None admin] RBAC: Authorizing `identity:get_user(user_id=8474eba1fd11486db87ca8aa2a114668)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:01.879475 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a89290-98e7-4b5d-9f94-c3777c496227 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:01.881421 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 21/42] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 28 00:44:01 2022] GET /identity/v3/users/8474eba1fd11486db87ca8aa2a114668 => generated 247 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:01.887568 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b40fcbc-da2b-42ad-b3a1-510e8a0f970e None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:01.977910 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a89290-98e7-4b5d-9f94-c3777c496227 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:02.009401 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b40fcbc-da2b-42ad-b3a1-510e8a0f970e None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:02.048157 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1021530-7426-451d-86b2-dfb184241077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:02.048900 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1021530-7426-451d-86b2-dfb184241077 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:02.049181 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1021530-7426-451d-86b2-dfb184241077 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:02.049509 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1021530-7426-451d-86b2-dfb184241077 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:02.050755 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1021530-7426-451d-86b2-dfb184241077 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:02.052263 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1021530-7426-451d-86b2-dfb184241077 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:02.053879 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 22/43] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:44:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:02.059940 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1021530-7426-451d-86b2-dfb184241077 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:02.098303 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a89290-98e7-4b5d-9f94-c3777c496227 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:02.113704 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:02.146246 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a9bed-e794-4a6b-bc07-76631fb3f11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:02.146927 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a9bed-e794-4a6b-bc07-76631fb3f11c None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:02.147215 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a9bed-e794-4a6b-bc07-76631fb3f11c None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:02.147563 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a9bed-e794-4a6b-bc07-76631fb3f11c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:02.149010 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6a9bed-e794-4a6b-bc07-76631fb3f11c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:02.150507 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6a9bed-e794-4a6b-bc07-76631fb3f11c None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:02.152155 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 22/44] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:44:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:02.158821 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a9bed-e794-4a6b-bc07-76631fb3f11c None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:02.167591 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1021530-7426-451d-86b2-dfb184241077 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:02.215719 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba982c4d-65cd-4331-98a9-d45dca966df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:02.215719 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba982c4d-65cd-4331-98a9-d45dca966df5 None admin] REQUEST_METHOD: `PUT` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:02.215719 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba982c4d-65cd-4331-98a9-d45dca966df5 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:02.215719 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba982c4d-65cd-4331-98a9-d45dca966df5 None admin] PATH_INFO: `/v3/domains/default/users/8474eba1fd11486db87ca8aa2a114668/roles/2e4889bb71f9434392c0baba59f2534e` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:02.218654 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba982c4d-65cd-4331-98a9-d45dca966df5 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=8474eba1fd11486db87ca8aa2a114668, role_id=2e4889bb71f9434392c0baba59f2534e)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:02.220208 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba982c4d-65cd-4331-98a9-d45dca966df5 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:02.224301 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:02.238543 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 23/45] 10.222.0.49 () {58 vars in 1361 bytes} [Sun Aug 28 00:44:02 2022] PUT /identity/v3/domains/default/users/8474eba1fd11486db87ca8aa2a114668/roles/2e4889bb71f9434392c0baba59f2534e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:44:02.291418 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a9bed-e794-4a6b-bc07-76631fb3f11c None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:02.332515 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86311c56-dcbe-49c4-9a59-85139eec17a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:02.333167 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86311c56-dcbe-49c4-9a59-85139eec17a0 None admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:02.334399 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86311c56-dcbe-49c4-9a59-85139eec17a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:02.334399 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86311c56-dcbe-49c4-9a59-85139eec17a0 None admin] PATH_INFO: `/v3/projects` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:02.334399 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86311c56-dcbe-49c4-9a59-85139eec17a0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:02.335905 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86311c56-dcbe-49c4-9a59-85139eec17a0 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:02.369986 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 23/46] 10.222.0.49 () {60 vars in 1141 bytes} [Sun Aug 28 00:44:02 2022] POST /identity/v3/projects => generated 312 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:44:04.301206 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac4dc2-2b2c-4161-9831-9798bb468754 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:04.301798 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac4dc2-2b2c-4161-9831-9798bb468754 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:04.301798 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac4dc2-2b2c-4161-9831-9798bb468754 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:04.303087 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 24/47] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:44:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:44:04.308468 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4edb5-94d8-4e4e-a8ac-7e377ad6712d None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:04.308885 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4edb5-94d8-4e4e-a8ac-7e377ad6712d None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:04.309029 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f4edb5-94d8-4e4e-a8ac-7e377ad6712d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:04.332343 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-67f4edb5-94d8-4e4e-a8ac-7e377ad6712d None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:44:04.334867 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-67f4edb5-94d8-4e4e-a8ac-7e377ad6712d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:44:04.335919 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224437dd-dd32-4a9b-9568-f3da7364a77b None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:04.336416 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224437dd-dd32-4a9b-9568-f3da7364a77b None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:04.336736 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224437dd-dd32-4a9b-9568-f3da7364a77b None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:04.338093 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 25/48] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:44:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:44:04.343392 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd961c7f-23e6-4e8b-a607-6f53e5e3d940 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:04.343695 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd961c7f-23e6-4e8b-a607-6f53e5e3d940 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:04.343998 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd961c7f-23e6-4e8b-a607-6f53e5e3d940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:04.362264 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-bd961c7f-23e6-4e8b-a607-6f53e5e3d940 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:44:04.363468 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-bd961c7f-23e6-4e8b-a607-6f53e5e3d940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:44:04.407466 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 24/49] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:44:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:44:04.432940 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 26/50] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:44:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:44:04.672190 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f4edb5-94d8-4e4e-a8ac-7e377ad6712d None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:04.693694 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd961c7f-23e6-4e8b-a607-6f53e5e3d940 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:04.715897 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:04.743115 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:04.782507 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f4edb5-94d8-4e4e-a8ac-7e377ad6712d None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:04.811485 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd961c7f-23e6-4e8b-a607-6f53e5e3d940 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:04.819008 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cc6c93-71d7-4c54-b0f4-aaa0dd205295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:04.819654 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc6c93-71d7-4c54-b0f4-aaa0dd205295 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:04.819961 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc6c93-71d7-4c54-b0f4-aaa0dd205295 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:04.820230 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cc6c93-71d7-4c54-b0f4-aaa0dd205295 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:04.821378 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cc6c93-71d7-4c54-b0f4-aaa0dd205295 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:04.822837 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cc6c93-71d7-4c54-b0f4-aaa0dd205295 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:04.824489 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 25/51] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:44:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:04.830531 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cc6c93-71d7-4c54-b0f4-aaa0dd205295 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:04.847898 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93af8ddc-da13-418a-934d-9bb443c1e957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:04.848536 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af8ddc-da13-418a-934d-9bb443c1e957 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:04.848810 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af8ddc-da13-418a-934d-9bb443c1e957 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:04.849073 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af8ddc-da13-418a-934d-9bb443c1e957 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:04.859202 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93af8ddc-da13-418a-934d-9bb443c1e957 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:44:04.864116 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-93af8ddc-da13-418a-934d-9bb443c1e957 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:44:04.864116 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:44:04.864116 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:44:04.864116 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:44:04.864116 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:44:04.864116 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:44:04.864116 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:44:04.864116 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:44:04.864116 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:44:04.864116 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:44:04.864116 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:44:04.864116 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:44:04.864116 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:44:04.864116 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:44:04.864116 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:44:04.864116 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:44:04.864967 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:44:04.864967 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:44:04.864967 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:44:04.864967 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:44:04.864967 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:44:04.864967 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:44:04.864967 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:44:04.864967 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:44:04.864967 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:44:04.864967 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:44:04.864967 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:44:04.864967 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:44:04.864967 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:44:04.864967 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:44:04.864967 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:44:04.864967 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:44:04.865730 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:44:04.865730 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:44:04.865730 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:44:04.865730 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:44:04.865730 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:44:04.865730 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:44:04.865730 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:44:04.865730 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:44:04.865730 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:44:04.865730 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:44:04.865730 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:44:04.865730 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:44:04.865730 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 27/52] 10.222.0.49 () {56 vars in 1096 bytes} [Sun Aug 28 00:44:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:44:04.871225 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93af8ddc-da13-418a-934d-9bb443c1e957 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:04.935932 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cc6c93-71d7-4c54-b0f4-aaa0dd205295 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:04.945419 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:04.971510 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ead34b-0ba0-45fa-ae3b-d7bfe70ab28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:04.972169 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ead34b-0ba0-45fa-ae3b-d7bfe70ab28e None admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:04.972450 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ead34b-0ba0-45fa-ae3b-d7bfe70ab28e None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:04.972718 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ead34b-0ba0-45fa-ae3b-d7bfe70ab28e None admin] PATH_INFO: `/v3/projects` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:04.973414 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ead34b-0ba0-45fa-ae3b-d7bfe70ab28e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:04.974003 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93af8ddc-da13-418a-934d-9bb443c1e957 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:04.974900 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ead34b-0ba0-45fa-ae3b-d7bfe70ab28e None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:04.975739 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:05.004335 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 26/53] 10.222.0.49 () {60 vars in 1140 bytes} [Sun Aug 28 00:44:04 2022] POST /identity/v3/projects => generated 298 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:44:05.013117 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ded6d-0a10-4f7f-b26e-84c579152e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:05.013760 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ded6d-0a10-4f7f-b26e-84c579152e1d None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:05.014047 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ded6d-0a10-4f7f-b26e-84c579152e1d None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:05.014327 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ded6d-0a10-4f7f-b26e-84c579152e1d None admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:05.015036 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275ded6d-0a10-4f7f-b26e-84c579152e1d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:05.015348 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275ded6d-0a10-4f7f-b26e-84c579152e1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:05.016859 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275ded6d-0a10-4f7f-b26e-84c579152e1d None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:05.026939 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 28/54] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 28 00:44:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:44:05.033026 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ead34b-0ba0-45fa-ae3b-d7bfe70ab28e None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:05.149596 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ead34b-0ba0-45fa-ae3b-d7bfe70ab28e None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:05.189585 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75445ce7-2d44-47ea-9d8b-5239b8dcbc36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:05.190155 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75445ce7-2d44-47ea-9d8b-5239b8dcbc36 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:05.190436 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75445ce7-2d44-47ea-9d8b-5239b8dcbc36 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:05.190711 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75445ce7-2d44-47ea-9d8b-5239b8dcbc36 None admin] PATH_INFO: `/v3/users/8474eba1fd11486db87ca8aa2a114668` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:05.191927 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75445ce7-2d44-47ea-9d8b-5239b8dcbc36 None admin] RBAC: Authorizing `identity:get_user(user_id=8474eba1fd11486db87ca8aa2a114668)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:05.193402 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75445ce7-2d44-47ea-9d8b-5239b8dcbc36 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:05.195052 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 27/55] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 28 00:44:05 2022] GET /identity/v3/users/8474eba1fd11486db87ca8aa2a114668 => generated 247 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:05.200859 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ded6d-0a10-4f7f-b26e-84c579152e1d None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:05.428358 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ded6d-0a10-4f7f-b26e-84c579152e1d None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:05.471262 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ebea4e-ff18-473c-b8c2-95415b8d08f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:05.471858 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ebea4e-ff18-473c-b8c2-95415b8d08f0 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:05.472145 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ebea4e-ff18-473c-b8c2-95415b8d08f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:05.472446 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ebea4e-ff18-473c-b8c2-95415b8d08f0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:05.473663 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ebea4e-ff18-473c-b8c2-95415b8d08f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:05.475244 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ebea4e-ff18-473c-b8c2-95415b8d08f0 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:05.477050 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 29/56] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:44:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:05.483631 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75445ce7-2d44-47ea-9d8b-5239b8dcbc36 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:05.525167 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:05.622868 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75445ce7-2d44-47ea-9d8b-5239b8dcbc36 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:05.660495 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c3ba91-eece-4424-826d-2ab545b663b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:05.661118 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c3ba91-eece-4424-826d-2ab545b663b4 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:05.661480 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c3ba91-eece-4424-826d-2ab545b663b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:05.661688 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c3ba91-eece-4424-826d-2ab545b663b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:05.662582 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c3ba91-eece-4424-826d-2ab545b663b4 None admin] RBAC: Adding query filter params (role.id=2e4889bb71f9434392c0baba59f2534e, scope.domain.id=default, user.id=8474eba1fd11486db87ca8aa2a114668) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:05.663022 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c3ba91-eece-4424-826d-2ab545b663b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:05.664676 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c3ba91-eece-4424-826d-2ab545b663b4 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:05.671270 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 28/57] 10.222.0.49 () {56 vars in 1322 bytes} [Sun Aug 28 00:44:05 2022] GET /identity/v3/role_assignments?user.id=8474eba1fd11486db87ca8aa2a114668&scope.domain.id=default&role.id=2e4889bb71f9434392c0baba59f2534e => generated 530 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:06.955763 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada84444-905d-40e3-96e8-a16bbc6e0c93 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:06.956295 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada84444-905d-40e3-96e8-a16bbc6e0c93 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:06.956295 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada84444-905d-40e3-96e8-a16bbc6e0c93 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:06.957670 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 30/58] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:44:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:44:06.963474 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d6227-77d7-4730-bdc2-f232302204b7 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:06.963999 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d6227-77d7-4730-bdc2-f232302204b7 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:06.964095 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d6227-77d7-4730-bdc2-f232302204b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:06.987899 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-b34d6227-77d7-4730-bdc2-f232302204b7 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:44:06.989064 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-b34d6227-77d7-4730-bdc2-f232302204b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:44:07.078454 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 29/59] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:44:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:44:07.344757 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada84444-905d-40e3-96e8-a16bbc6e0c93 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:07.379629 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:07.456596 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada84444-905d-40e3-96e8-a16bbc6e0c93 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:07.493026 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287cfd09-ee08-4ab1-88c5-0e40a4bb3c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:07.493617 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287cfd09-ee08-4ab1-88c5-0e40a4bb3c84 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:07.493956 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287cfd09-ee08-4ab1-88c5-0e40a4bb3c84 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:07.494178 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287cfd09-ee08-4ab1-88c5-0e40a4bb3c84 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:07.495336 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287cfd09-ee08-4ab1-88c5-0e40a4bb3c84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:07.496958 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287cfd09-ee08-4ab1-88c5-0e40a4bb3c84 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:07.498564 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 31/60] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:44:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:07.504286 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d6227-77d7-4730-bdc2-f232302204b7 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:07.530172 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:07.618475 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d6227-77d7-4730-bdc2-f232302204b7 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:07.657359 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aca753d-8ba7-48e0-ba2e-44c49a31c2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:07.657991 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca753d-8ba7-48e0-ba2e-44c49a31c2fd None admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:07.658282 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca753d-8ba7-48e0-ba2e-44c49a31c2fd None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:07.658553 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca753d-8ba7-48e0-ba2e-44c49a31c2fd None admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:07.659255 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aca753d-8ba7-48e0-ba2e-44c49a31c2fd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:07.660807 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aca753d-8ba7-48e0-ba2e-44c49a31c2fd None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:07.692272 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 30/61] 10.222.0.49 () {60 vars in 1132 bytes} [Sun Aug 28 00:44:07 2022] POST /identity/v3/users => generated 275 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:44:10.655392 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cece55-7ac6-4750-bec7-0c28ee818843 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:10.655946 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cece55-7ac6-4750-bec7-0c28ee818843 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:10.656018 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cece55-7ac6-4750-bec7-0c28ee818843 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:10.657339 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 32/62] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:44:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:44:10.662888 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0994821c-c714-4980-8595-f5a329414b84 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:10.663788 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0994821c-c714-4980-8595-f5a329414b84 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:10.664260 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0994821c-c714-4980-8595-f5a329414b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:10.688759 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-0994821c-c714-4980-8595-f5a329414b84 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:44:10.690310 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-0994821c-c714-4980-8595-f5a329414b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:44:10.700984 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a5ad7-04e2-4729-907e-ce35a1598b35 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:10.701605 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a5ad7-04e2-4729-907e-ce35a1598b35 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:10.702092 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a5ad7-04e2-4729-907e-ce35a1598b35 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:10.703928 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 33/63] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:44:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:44:10.711986 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6fbeeb-27b7-4f46-ac1a-e0cc48a20321 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:10.713076 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6fbeeb-27b7-4f46-ac1a-e0cc48a20321 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:10.713963 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6fbeeb-27b7-4f46-ac1a-e0cc48a20321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:10.743172 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-2d6fbeeb-27b7-4f46-ac1a-e0cc48a20321 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:44:10.750994 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-2d6fbeeb-27b7-4f46-ac1a-e0cc48a20321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:44:10.781566 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 31/64] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:44:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:44:10.865266 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 34/65] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:44:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:44:11.140949 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b35233-b0c7-4b5e-87c0-608184d2f1ab None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:11.141634 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b35233-b0c7-4b5e-87c0-608184d2f1ab None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:11.142109 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b35233-b0c7-4b5e-87c0-608184d2f1ab None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:11.143656 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 32/66] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:44:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:44:11.149481 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f1d3a-1bfb-41cb-9336-9344436534cd None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:11.150023 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f1d3a-1bfb-41cb-9336-9344436534cd None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:11.150487 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f1d3a-1bfb-41cb-9336-9344436534cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:11.176702 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-5d1f1d3a-1bfb-41cb-9336-9344436534cd None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:44:11.178225 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-5d1f1d3a-1bfb-41cb-9336-9344436534cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:44:11.208802 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:11.267756 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b35233-b0c7-4b5e-87c0-608184d2f1ab None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:11.270134 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 35/67] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:44:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:44:11.280059 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:11.312678 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63019dfe-43b3-4146-a305-110d37f33fc9 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:11.313015 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63019dfe-43b3-4146-a305-110d37f33fc9 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:11.313246 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63019dfe-43b3-4146-a305-110d37f33fc9 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:11.314604 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 36/68] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:44:11.320228 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab249869-a7f9-420f-8989-541bedc1d7db None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:11.320514 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab249869-a7f9-420f-8989-541bedc1d7db None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:11.320795 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab249869-a7f9-420f-8989-541bedc1d7db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:11.349919 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-ab249869-a7f9-420f-8989-541bedc1d7db None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:44:11.351133 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-ab249869-a7f9-420f-8989-541bedc1d7db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:44:11.411176 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b35233-b0c7-4b5e-87c0-608184d2f1ab None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:11.422115 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 37/69] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:44:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:44:11.423506 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c2e7c-9ab4-41dc-a327-51005d8134f0 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:11.423896 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c2e7c-9ab4-41dc-a327-51005d8134f0 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:11.424235 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c2e7c-9ab4-41dc-a327-51005d8134f0 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:11.425679 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 38/70] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:44:11.426286 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c2e7c-9ab4-41dc-a327-51005d8134f0 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:11.458309 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689cf4a-591b-4724-b597-10936db7ffa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:11.459281 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689cf4a-591b-4724-b597-10936db7ffa8 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:11.459759 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689cf4a-591b-4724-b597-10936db7ffa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:11.460203 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689cf4a-591b-4724-b597-10936db7ffa8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:11.471179 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9689cf4a-591b-4724-b597-10936db7ffa8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:44:11.476509 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-9689cf4a-591b-4724-b597-10936db7ffa8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:44:11.476509 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:44:11.476509 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:44:11.476509 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:44:11.476509 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:44:11.476509 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:44:11.476509 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:44:11.476509 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:44:11.476509 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:44:11.476509 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:44:11.476509 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:44:11.476509 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:44:11.476509 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:44:11.476509 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:44:11.476509 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:44:11.476509 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:44:11.477359 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:44:11.477359 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:44:11.477359 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:44:11.477359 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:44:11.477359 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:44:11.477359 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:44:11.477359 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:44:11.477359 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:44:11.477359 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:44:11.477359 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:44:11.477359 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:44:11.477359 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:44:11.477359 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:44:11.477359 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:44:11.477359 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:44:11.477359 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:44:11.478124 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:44:11.478124 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:44:11.478124 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:44:11.478124 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:44:11.478124 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:44:11.478124 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:44:11.478124 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:44:11.478124 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:44:11.478124 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:44:11.478124 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:44:11.478124 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:44:11.478124 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:44:11.480734 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 33/71] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 28 00:44:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:44:11.482785 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b865c-fecf-494a-88ab-1213ab7172d9 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:11.483267 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b865c-fecf-494a-88ab-1213ab7172d9 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:11.483748 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b865c-fecf-494a-88ab-1213ab7172d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:11.503580 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-d32b865c-fecf-494a-88ab-1213ab7172d9 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:44:11.505374 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-d32b865c-fecf-494a-88ab-1213ab7172d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:44:11.559891 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:11.575146 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c2e7c-9ab4-41dc-a327-51005d8134f0 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:11.585375 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:11.591794 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 34/72] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:44:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:44:11.593141 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b865c-fecf-494a-88ab-1213ab7172d9 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:11.618162 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac76743-0516-4efd-85ce-74b5f3b01cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:11.618810 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac76743-0516-4efd-85ce-74b5f3b01cdc None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:11.619106 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac76743-0516-4efd-85ce-74b5f3b01cdc None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:11.619373 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac76743-0516-4efd-85ce-74b5f3b01cdc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:11.632749 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac76743-0516-4efd-85ce-74b5f3b01cdc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:44:11.639312 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-2ac76743-0516-4efd-85ce-74b5f3b01cdc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:44:11.639312 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:44:11.639312 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:44:11.639312 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:44:11.639312 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:44:11.639312 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:44:11.639312 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:44:11.639312 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:44:11.639312 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:44:11.639312 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:44:11.639312 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:44:11.639312 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:44:11.639312 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:44:11.639312 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:44:11.639312 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:44:11.639312 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:44:11.640187 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:44:11.640187 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:44:11.640187 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:44:11.640187 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:44:11.640187 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:44:11.640187 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:44:11.640187 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:44:11.640187 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:44:11.640187 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:44:11.640187 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:44:11.640187 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:44:11.640187 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:44:11.640187 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:44:11.640187 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:44:11.640187 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:44:11.640187 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:44:11.640974 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:44:11.640974 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:44:11.640974 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:44:11.640974 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:44:11.640974 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:44:11.640974 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:44:11.640974 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:44:11.640974 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:44:11.640974 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:44:11.640974 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:44:11.640974 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:44:11.640974 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:44:11.640974 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 39/73] 10.222.0.49 () {56 vars in 1096 bytes} [Sun Aug 28 00:44:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:44:11.641587 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac76743-0516-4efd-85ce-74b5f3b01cdc None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:11.714976 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b865c-fecf-494a-88ab-1213ab7172d9 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:11.752046 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda02a23-008d-44b8-a23f-f5176183848e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:11.752672 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda02a23-008d-44b8-a23f-f5176183848e None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:11.752957 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda02a23-008d-44b8-a23f-f5176183848e None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:11.753234 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda02a23-008d-44b8-a23f-f5176183848e None admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:11.753918 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda02a23-008d-44b8-a23f-f5176183848e None admin] RBAC: Adding query filter params (name=member) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:11.754193 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda02a23-008d-44b8-a23f-f5176183848e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:11.756079 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda02a23-008d-44b8-a23f-f5176183848e None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:11.764386 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 35/74] 10.222.0.49 () {56 vars in 1101 bytes} [Sun Aug 28 00:44:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:11.765251 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda02a23-008d-44b8-a23f-f5176183848e None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:11.768104 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac76743-0516-4efd-85ce-74b5f3b01cdc None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:11.805815 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4a878-8747-4c41-a9a6-fb30259ba6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:11.806456 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4a878-8747-4c41-a9a6-fb30259ba6a7 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:11.806740 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4a878-8747-4c41-a9a6-fb30259ba6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:11.807015 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4a878-8747-4c41-a9a6-fb30259ba6a7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:11.817792 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef4a878-8747-4c41-a9a6-fb30259ba6a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:44:11.822667 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-9ef4a878-8747-4c41-a9a6-fb30259ba6a7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:44:11.822667 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:44:11.822667 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:44:11.822667 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:44:11.822667 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:44:11.822667 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:44:11.822667 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:44:11.822667 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:44:11.822667 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:44:11.822667 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:44:11.822667 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:44:11.822667 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:44:11.822667 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:44:11.822667 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:44:11.822667 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:44:11.822667 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:44:11.823529 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:44:11.823529 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:44:11.823529 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:44:11.823529 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:44:11.823529 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:44:11.823529 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:44:11.823529 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:44:11.823529 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:44:11.823529 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:44:11.823529 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:44:11.823529 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:44:11.823529 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:44:11.823529 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:44:11.823529 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:44:11.823529 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:44:11.823529 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:44:11.824341 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:44:11.824341 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:44:11.824341 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:44:11.824341 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:44:11.824341 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:44:11.824341 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:44:11.824341 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:44:11.824341 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:44:11.824341 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:44:11.824341 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:44:11.824341 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:44:11.824341 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:44:11.824341 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 40/75] 10.222.0.49 () {56 vars in 1114 bytes} [Sun Aug 28 00:44:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:44:11.825002 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4a878-8747-4c41-a9a6-fb30259ba6a7 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:11.835633 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:11.838946 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:11.878590 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda02a23-008d-44b8-a23f-f5176183848e None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:11.914443 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d360d739-43d9-4441-a159-e018540d3572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:11.915078 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d360d739-43d9-4441-a159-e018540d3572 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:11.915393 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d360d739-43d9-4441-a159-e018540d3572 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:11.915627 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d360d739-43d9-4441-a159-e018540d3572 None admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:11.916323 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d360d739-43d9-4441-a159-e018540d3572 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:11.916616 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d360d739-43d9-4441-a159-e018540d3572 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:11.918092 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d360d739-43d9-4441-a159-e018540d3572 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:11.927366 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 36/76] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 28 00:44:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:11.932751 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d360d739-43d9-4441-a159-e018540d3572 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:11.932905 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4a878-8747-4c41-a9a6-fb30259ba6a7 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:11.968832 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895fdf03-8072-4c07-bd25-ca4f8e9992bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:11.969348 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895fdf03-8072-4c07-bd25-ca4f8e9992bb None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:11.969623 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895fdf03-8072-4c07-bd25-ca4f8e9992bb None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:11.969912 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895fdf03-8072-4c07-bd25-ca4f8e9992bb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:11.971081 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895fdf03-8072-4c07-bd25-ca4f8e9992bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:11.972552 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895fdf03-8072-4c07-bd25-ca4f8e9992bb None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:11.974271 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 41/77] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:44:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:11.974866 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895fdf03-8072-4c07-bd25-ca4f8e9992bb None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:12.036445 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d360d739-43d9-4441-a159-e018540d3572 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:12.053270 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:12.059011 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:12.071123 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5565f8e8-c224-48dd-83d0-a582a696e358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:12.071810 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565f8e8-c224-48dd-83d0-a582a696e358 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:12.072095 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565f8e8-c224-48dd-83d0-a582a696e358 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:12.072375 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565f8e8-c224-48dd-83d0-a582a696e358 None admin] PATH_INFO: `/v3/users/06cf6d63014b475ca19007466ceb7bb7` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:12.075140 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895fdf03-8072-4c07-bd25-ca4f8e9992bb None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:12.086341 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5565f8e8-c224-48dd-83d0-a582a696e358 None admin] RBAC: Authorizing `identity:get_user(user_id=06cf6d63014b475ca19007466ceb7bb7)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:12.087858 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5565f8e8-c224-48dd-83d0-a582a696e358 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:12.089544 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 37/78] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 28 00:44:11 2022] GET /identity/v3/users/06cf6d63014b475ca19007466ceb7bb7 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:12.094458 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5565f8e8-c224-48dd-83d0-a582a696e358 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:12.108628 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea8bb9d-dff6-4e5c-a10c-b20be2685da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:12.109244 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8bb9d-dff6-4e5c-a10c-b20be2685da0 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:12.109522 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8bb9d-dff6-4e5c-a10c-b20be2685da0 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:12.109792 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8bb9d-dff6-4e5c-a10c-b20be2685da0 None admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:12.110457 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea8bb9d-dff6-4e5c-a10c-b20be2685da0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:12.110767 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea8bb9d-dff6-4e5c-a10c-b20be2685da0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:12.112194 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea8bb9d-dff6-4e5c-a10c-b20be2685da0 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:12.120863 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 42/79] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 28 00:44:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:12.121842 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea8bb9d-dff6-4e5c-a10c-b20be2685da0 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:12.206835 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5565f8e8-c224-48dd-83d0-a582a696e358 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:12.222032 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea8bb9d-dff6-4e5c-a10c-b20be2685da0 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:12.240783 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cefa823-75e8-494f-a3ad-86ab34145f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:12.241427 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cefa823-75e8-494f-a3ad-86ab34145f70 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:12.241702 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cefa823-75e8-494f-a3ad-86ab34145f70 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:12.241967 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cefa823-75e8-494f-a3ad-86ab34145f70 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:12.252087 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cefa823-75e8-494f-a3ad-86ab34145f70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:44:12.255183 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85867061-415a-4362-aa06-0e7b7edcbafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:12.255855 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85867061-415a-4362-aa06-0e7b7edcbafa None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:12.256140 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85867061-415a-4362-aa06-0e7b7edcbafa None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:12.256415 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85867061-415a-4362-aa06-0e7b7edcbafa None admin] PATH_INFO: `/v3/users/8474eba1fd11486db87ca8aa2a114668` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:12.256922 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-4cefa823-75e8-494f-a3ad-86ab34145f70 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:44:12.256922 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:44:12.256922 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:44:12.256922 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:44:12.256922 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:44:12.256922 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:44:12.256922 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:44:12.256922 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:44:12.256922 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:44:12.256922 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:44:12.256922 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:44:12.256922 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:44:12.256922 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:44:12.256922 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:44:12.256922 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:44:12.256922 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:44:12.258010 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:44:12.258010 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:44:12.258010 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:44:12.258010 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:44:12.258010 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:44:12.258010 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:44:12.258010 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:44:12.258010 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:44:12.258010 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:44:12.258010 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:44:12.258010 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:44:12.258010 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:44:12.258010 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:44:12.258010 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:44:12.258010 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:44:12.258010 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:44:12.259015 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:44:12.259015 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:44:12.259015 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:44:12.259015 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:44:12.259015 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:44:12.259015 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:44:12.259015 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:44:12.259015 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:44:12.259015 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:44:12.259015 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:44:12.259015 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:44:12.259015 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:44:12.259782 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85867061-415a-4362-aa06-0e7b7edcbafa None admin] RBAC: Authorizing `identity:get_user(user_id=8474eba1fd11486db87ca8aa2a114668)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:12.259853 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 38/80] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 28 00:44:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:44:12.259853 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cefa823-75e8-494f-a3ad-86ab34145f70 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:12.260650 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85867061-415a-4362-aa06-0e7b7edcbafa None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:12.262758 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 43/81] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 28 00:44:12 2022] GET /identity/v3/users/8474eba1fd11486db87ca8aa2a114668 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:12.267575 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85867061-415a-4362-aa06-0e7b7edcbafa None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:12.278247 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:12.302502 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:12.362194 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cefa823-75e8-494f-a3ad-86ab34145f70 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:12.365364 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85867061-415a-4362-aa06-0e7b7edcbafa None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:12.396282 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e002019-5b69-444b-9918-911c2292e71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:12.396900 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e002019-5b69-444b-9918-911c2292e71a None admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:12.397164 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e002019-5b69-444b-9918-911c2292e71a None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:12.397435 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e002019-5b69-444b-9918-911c2292e71a None admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:12.398104 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e002019-5b69-444b-9918-911c2292e71a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:12.399475 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efd5b46-f058-4dc4-a5c2-246e1077f873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:12.399587 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e002019-5b69-444b-9918-911c2292e71a None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:12.400127 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd5b46-f058-4dc4-a5c2-246e1077f873 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:12.400414 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd5b46-f058-4dc4-a5c2-246e1077f873 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:12.400693 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd5b46-f058-4dc4-a5c2-246e1077f873 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:12.422226 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 39/82] 10.222.0.49 () {60 vars in 1132 bytes} [Sun Aug 28 00:44:12 2022] POST /identity/v3/users => generated 289 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:44:12.423290 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e002019-5b69-444b-9918-911c2292e71a None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:12.474241 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efd5b46-f058-4dc4-a5c2-246e1077f873 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:12.475706 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efd5b46-f058-4dc4-a5c2-246e1077f873 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:12.487059 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:12.547414 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:12.560496 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e002019-5b69-444b-9918-911c2292e71a None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:12.602254 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 44/83] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 28 00:44:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:44:12.603133 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efd5b46-f058-4dc4-a5c2-246e1077f873 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:12.606356 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa675a-3669-4d9c-b0ca-0247dd645d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:12.607002 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa675a-3669-4d9c-b0ca-0247dd645d6e None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:12.607278 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa675a-3669-4d9c-b0ca-0247dd645d6e None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:12.607547 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa675a-3669-4d9c-b0ca-0247dd645d6e None admin] PATH_INFO: `/v3/users/06cf6d63014b475ca19007466ceb7bb7` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:12.608745 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaa675a-3669-4d9c-b0ca-0247dd645d6e None admin] RBAC: Authorizing `identity:get_user(user_id=06cf6d63014b475ca19007466ceb7bb7)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:12.610196 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaa675a-3669-4d9c-b0ca-0247dd645d6e None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:12.612205 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 40/84] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 28 00:44:12 2022] GET /identity/v3/users/06cf6d63014b475ca19007466ceb7bb7 => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:12.612637 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa675a-3669-4d9c-b0ca-0247dd645d6e None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:12.724446 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efd5b46-f058-4dc4-a5c2-246e1077f873 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:12.735133 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:12.739973 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa675a-3669-4d9c-b0ca-0247dd645d6e None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:12.764949 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cbcf5f-0c05-4ede-a5a6-0f12a2f4556c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:12.765828 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbcf5f-0c05-4ede-a5a6-0f12a2f4556c None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:12.766389 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbcf5f-0c05-4ede-a5a6-0f12a2f4556c None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:12.767118 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbcf5f-0c05-4ede-a5a6-0f12a2f4556c None admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:12.768220 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cbcf5f-0c05-4ede-a5a6-0f12a2f4556c None admin] RBAC: Adding query filter params (name=member) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:12.769251 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cbcf5f-0c05-4ede-a5a6-0f12a2f4556c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:12.771446 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cbcf5f-0c05-4ede-a5a6-0f12a2f4556c None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:12.778134 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699e02a7-ef27-4ea5-83f1-173523c158ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:12.778755 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e02a7-ef27-4ea5-83f1-173523c158ea None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:12.779036 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e02a7-ef27-4ea5-83f1-173523c158ea None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:12.779310 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699e02a7-ef27-4ea5-83f1-173523c158ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:12.782623 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 45/85] 10.222.0.49 () {56 vars in 1101 bytes} [Sun Aug 28 00:44:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:12.784611 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cbcf5f-0c05-4ede-a5a6-0f12a2f4556c None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:12.822193 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:12.865018 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699e02a7-ef27-4ea5-83f1-173523c158ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:12.866568 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699e02a7-ef27-4ea5-83f1-173523c158ea None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:12.918776 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cbcf5f-0c05-4ede-a5a6-0f12a2f4556c None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:12.962541 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c01cfb-5148-4099-9b3c-00f6e4880e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:12.963750 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c01cfb-5148-4099-9b3c-00f6e4880e40 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:12.964200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c01cfb-5148-4099-9b3c-00f6e4880e40 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:12.964803 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c01cfb-5148-4099-9b3c-00f6e4880e40 None admin] PATH_INFO: `/v3/projects/a8086350f8e74846828edcab8c1d0577` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:12.966580 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c01cfb-5148-4099-9b3c-00f6e4880e40 None admin] RBAC: Authorizing `identity:get_project(project_id=a8086350f8e74846828edcab8c1d0577)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:12.968667 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c01cfb-5148-4099-9b3c-00f6e4880e40 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:12.970905 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 46/86] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 28 00:44:12 2022] GET /identity/v3/projects/a8086350f8e74846828edcab8c1d0577 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:12.971906 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c01cfb-5148-4099-9b3c-00f6e4880e40 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:12.991021 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 41/87] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 28 00:44:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:44:12.992079 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699e02a7-ef27-4ea5-83f1-173523c158ea None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:13.022763 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:13.066688 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:13.092028 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c01cfb-5148-4099-9b3c-00f6e4880e40 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:13.108275 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699e02a7-ef27-4ea5-83f1-173523c158ea None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:13.132765 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5cf001-bea4-47e4-ae65-a0e5c5ac8e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:13.133932 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5cf001-bea4-47e4-ae65-a0e5c5ac8e37 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:13.134348 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5cf001-bea4-47e4-ae65-a0e5c5ac8e37 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:13.135014 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5cf001-bea4-47e4-ae65-a0e5c5ac8e37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:13.146946 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bb5b6f-18ce-4aed-93c6-8c0091cd0a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:13.147595 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb5b6f-18ce-4aed-93c6-8c0091cd0a85 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:13.147923 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb5b6f-18ce-4aed-93c6-8c0091cd0a85 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:13.148202 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bb5b6f-18ce-4aed-93c6-8c0091cd0a85 None admin] PATH_INFO: `/v3/users/06cf6d63014b475ca19007466ceb7bb7` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:13.149395 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bb5b6f-18ce-4aed-93c6-8c0091cd0a85 None admin] RBAC: Authorizing `identity:get_user(user_id=06cf6d63014b475ca19007466ceb7bb7)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:13.151442 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bb5b6f-18ce-4aed-93c6-8c0091cd0a85 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:13.153318 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 42/88] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 28 00:44:12 2022] GET /identity/v3/users/06cf6d63014b475ca19007466ceb7bb7 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:13.154192 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bb5b6f-18ce-4aed-93c6-8c0091cd0a85 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:13.226489 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5cf001-bea4-47e4-ae65-a0e5c5ac8e37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:13.228000 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5cf001-bea4-47e4-ae65-a0e5c5ac8e37 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:13.270032 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:13.284268 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bb5b6f-18ce-4aed-93c6-8c0091cd0a85 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:13.328834 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:13.336395 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a47221-62c4-4903-8d56-70c90b704948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:13.337058 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 47/89] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 28 00:44:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:44:13.337547 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a47221-62c4-4903-8d56-70c90b704948 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:13.338000 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5cf001-bea4-47e4-ae65-a0e5c5ac8e37 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:13.338293 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a47221-62c4-4903-8d56-70c90b704948 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:13.338749 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a47221-62c4-4903-8d56-70c90b704948 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:13.339714 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a47221-62c4-4903-8d56-70c90b704948 None admin] RBAC: Adding query filter params (role.id=7ac2391cc85a4d138e95e27cd0d09b26, scope.project.id=a8086350f8e74846828edcab8c1d0577, user.id=06cf6d63014b475ca19007466ceb7bb7) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:13.340528 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a47221-62c4-4903-8d56-70c90b704948 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:13.343211 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a47221-62c4-4903-8d56-70c90b704948 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:13.351012 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 43/90] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 28 00:44:13 2022] GET /identity/v3/role_assignments?user.id=06cf6d63014b475ca19007466ceb7bb7&scope.project.id=a8086350f8e74846828edcab8c1d0577&role.id=7ac2391cc85a4d138e95e27cd0d09b26 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:13.352213 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a47221-62c4-4903-8d56-70c90b704948 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:13.476175 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a47221-62c4-4903-8d56-70c90b704948 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:13.524906 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b7da8-fb87-43a1-9045-cd82ad9e9d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:13.527715 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b7da8-fb87-43a1-9045-cd82ad9e9d21 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:13.528320 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b7da8-fb87-43a1-9045-cd82ad9e9d21 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:13.528787 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27b7da8-fb87-43a1-9045-cd82ad9e9d21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:13.601730 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5cf001-bea4-47e4-ae65-a0e5c5ac8e37 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:13.614435 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:13.625531 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27b7da8-fb87-43a1-9045-cd82ad9e9d21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:13.628209 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27b7da8-fb87-43a1-9045-cd82ad9e9d21 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:13.649376 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aff8726-ec45-4f9a-9641-918e10a89198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:13.650318 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff8726-ec45-4f9a-9641-918e10a89198 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:13.650514 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff8726-ec45-4f9a-9641-918e10a89198 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:13.650777 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff8726-ec45-4f9a-9641-918e10a89198 None admin] PATH_INFO: `/v3/projects/a8086350f8e74846828edcab8c1d0577` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:13.652122 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aff8726-ec45-4f9a-9641-918e10a89198 None admin] RBAC: Authorizing `identity:get_project(project_id=a8086350f8e74846828edcab8c1d0577)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:13.653930 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aff8726-ec45-4f9a-9641-918e10a89198 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:13.655713 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 48/91] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 28 00:44:13 2022] GET /identity/v3/projects/a8086350f8e74846828edcab8c1d0577 => generated 298 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:13.656479 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aff8726-ec45-4f9a-9641-918e10a89198 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:13.673717 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:13.770989 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 44/92] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 28 00:44:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:44:13.772184 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b7da8-fb87-43a1-9045-cd82ad9e9d21 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:13.897649 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aff8726-ec45-4f9a-9641-918e10a89198 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:13.953454 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb2aec-c4e2-4eeb-994c-71429954016f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:13.954171 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb2aec-c4e2-4eeb-994c-71429954016f None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:13.954462 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb2aec-c4e2-4eeb-994c-71429954016f None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:13.954739 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb2aec-c4e2-4eeb-994c-71429954016f None admin] PATH_INFO: `/v3/projects/a8086350f8e74846828edcab8c1d0577` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:13.958145 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:13.960489 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcb2aec-c4e2-4eeb-994c-71429954016f None admin] RBAC: Authorizing `identity:get_project(project_id=a8086350f8e74846828edcab8c1d0577)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:13.961991 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcb2aec-c4e2-4eeb-994c-71429954016f None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:13.964077 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 49/93] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 28 00:44:13 2022] GET /identity/v3/projects/a8086350f8e74846828edcab8c1d0577 => generated 298 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:13.964888 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb2aec-c4e2-4eeb-994c-71429954016f None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:13.969348 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27b7da8-fb87-43a1-9045-cd82ad9e9d21 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:14.033130 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15e388c-e29b-4d4c-b746-239b8aa48dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:14.034111 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e388c-e29b-4d4c-b746-239b8aa48dbf None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:14.034571 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e388c-e29b-4d4c-b746-239b8aa48dbf None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:14.035032 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e388c-e29b-4d4c-b746-239b8aa48dbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:14.036764 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15e388c-e29b-4d4c-b746-239b8aa48dbf None admin] RBAC: Adding query filter params (role.id=2e4889bb71f9434392c0baba59f2534e, scope.project.id=a8086350f8e74846828edcab8c1d0577, user.id=8474eba1fd11486db87ca8aa2a114668) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:14.037032 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15e388c-e29b-4d4c-b746-239b8aa48dbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:14.047690 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15e388c-e29b-4d4c-b746-239b8aa48dbf None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:14.050590 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 45/94] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 28 00:44:13 2022] GET /identity/v3/role_assignments?user.id=8474eba1fd11486db87ca8aa2a114668&scope.project.id=a8086350f8e74846828edcab8c1d0577&role.id=2e4889bb71f9434392c0baba59f2534e => generated 259 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:14.052267 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15e388c-e29b-4d4c-b746-239b8aa48dbf None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:14.127935 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:14.223737 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb2aec-c4e2-4eeb-994c-71429954016f None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:14.302314 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15e388c-e29b-4d4c-b746-239b8aa48dbf None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:14.307701 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a1dafa-651e-45b6-b796-c876651168b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:14.307701 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a1dafa-651e-45b6-b796-c876651168b8 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:14.307701 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a1dafa-651e-45b6-b796-c876651168b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:14.307701 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a1dafa-651e-45b6-b796-c876651168b8 None admin] PATH_INFO: `/v3/projects/5ff0ec6683c249d1963fb7c6a4a51ed9` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:14.309911 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a1dafa-651e-45b6-b796-c876651168b8 None admin] RBAC: Authorizing `identity:get_project(project_id=5ff0ec6683c249d1963fb7c6a4a51ed9)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:14.311405 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a1dafa-651e-45b6-b796-c876651168b8 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:14.313149 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 50/95] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 28 00:44:13 2022] GET /identity/v3/projects/5ff0ec6683c249d1963fb7c6a4a51ed9 => generated 312 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:14.319737 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a1dafa-651e-45b6-b796-c876651168b8 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:14.388983 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecef6a5-ad95-4d3d-8564-5a914f6d0801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:14.390005 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecef6a5-ad95-4d3d-8564-5a914f6d0801 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:14.390533 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecef6a5-ad95-4d3d-8564-5a914f6d0801 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:14.390992 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecef6a5-ad95-4d3d-8564-5a914f6d0801 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:14.392027 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecef6a5-ad95-4d3d-8564-5a914f6d0801 None admin] RBAC: Adding query filter params (role.id=5bcf10de71e7404aaef4d7878053be82, scope.project.id=a8086350f8e74846828edcab8c1d0577, user.id=06cf6d63014b475ca19007466ceb7bb7) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:14.392552 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecef6a5-ad95-4d3d-8564-5a914f6d0801 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:14.394223 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecef6a5-ad95-4d3d-8564-5a914f6d0801 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:14.413168 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 46/96] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 28 00:44:14 2022] GET /identity/v3/role_assignments?user.id=06cf6d63014b475ca19007466ceb7bb7&scope.project.id=a8086350f8e74846828edcab8c1d0577&role.id=5bcf10de71e7404aaef4d7878053be82 => generated 259 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:14.454364 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a1dafa-651e-45b6-b796-c876651168b8 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:14.505054 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a20521-a746-4f28-b973-b10894b455a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:14.505622 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a20521-a746-4f28-b973-b10894b455a4 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:14.505903 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a20521-a746-4f28-b973-b10894b455a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:14.506231 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a20521-a746-4f28-b973-b10894b455a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:14.507014 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a20521-a746-4f28-b973-b10894b455a4 None admin] RBAC: Adding query filter params (role.id=7ac2391cc85a4d138e95e27cd0d09b26, scope.project.id=5ff0ec6683c249d1963fb7c6a4a51ed9, user.id=06cf6d63014b475ca19007466ceb7bb7) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:14.507326 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a20521-a746-4f28-b973-b10894b455a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:14.508905 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a20521-a746-4f28-b973-b10894b455a4 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:14.524334 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 51/97] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 28 00:44:14 2022] GET /identity/v3/role_assignments?user.id=06cf6d63014b475ca19007466ceb7bb7&scope.project.id=5ff0ec6683c249d1963fb7c6a4a51ed9&role.id=7ac2391cc85a4d138e95e27cd0d09b26 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:44:14.558314 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554850b-3973-457a-8ea0-17f4eb0b0076 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:14.558633 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554850b-3973-457a-8ea0-17f4eb0b0076 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:14.558914 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554850b-3973-457a-8ea0-17f4eb0b0076 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:14.560419 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 47/98] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:44:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:44:14.566275 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b046af-37cc-4a7e-b415-3e8b5b5724f1 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:14.566580 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b046af-37cc-4a7e-b415-3e8b5b5724f1 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:14.566840 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b046af-37cc-4a7e-b415-3e8b5b5724f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:14.584093 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:14.588291 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-78b046af-37cc-4a7e-b415-3e8b5b5724f1 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:44:14.589965 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-78b046af-37cc-4a7e-b415-3e8b5b5724f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:44:14.682155 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 52/99] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:44:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:44:14.928490 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9bd951-3f77-4638-bf7b-11f4eb7ca949 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:14.928999 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9bd951-3f77-4638-bf7b-11f4eb7ca949 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:14.928999 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9bd951-3f77-4638-bf7b-11f4eb7ca949 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:14.930317 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 48/100] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:44:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:44:14.936126 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f7916b-72c8-4ba3-a091-308320b3e88d None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:14.936600 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f7916b-72c8-4ba3-a091-308320b3e88d None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:14.936670 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f7916b-72c8-4ba3-a091-308320b3e88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:14.960734 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-d0f7916b-72c8-4ba3-a091-308320b3e88d None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:44:14.961952 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-d0f7916b-72c8-4ba3-a091-308320b3e88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:44:15.049195 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 53/101] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:44:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:44:15.165430 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9bd951-3f77-4638-bf7b-11f4eb7ca949 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:15.197093 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:15.296630 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9bd951-3f77-4638-bf7b-11f4eb7ca949 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:15.342799 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff582c-9bc8-4101-aa05-78ab6a63c4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:15.343451 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff582c-9bc8-4101-aa05-78ab6a63c4a3 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:15.343760 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff582c-9bc8-4101-aa05-78ab6a63c4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:15.344035 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff582c-9bc8-4101-aa05-78ab6a63c4a3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:15.358374 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dff582c-9bc8-4101-aa05-78ab6a63c4a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:44:15.363247 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-5dff582c-9bc8-4101-aa05-78ab6a63c4a3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 00:44:15.363247 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:44:15.363247 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:44:15.363247 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:44:15.363247 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:44:15.363247 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:44:15.363247 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:44:15.363247 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:44:15.363247 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:44:15.363247 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:44:15.363247 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:44:15.363247 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:44:15.363247 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:44:15.363247 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:44:15.363247 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:44:15.363247 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:44:15.364118 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:44:15.364118 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:44:15.364118 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:44:15.364118 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:44:15.364118 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:44:15.364118 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:44:15.364118 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:44:15.364118 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:44:15.364118 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:44:15.364118 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:44:15.364118 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:44:15.364118 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:44:15.364118 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:44:15.364118 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:44:15.364118 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:44:15.364118 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:44:15.366260 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:44:15.366260 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:44:15.366260 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:44:15.366260 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:44:15.366260 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:44:15.366260 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:44:15.366260 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:44:15.366260 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:44:15.366260 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:44:15.366260 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:44:15.366260 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 00:44:15.366260 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:44:15.366260 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 49/102] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 28 00:44:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:44:15.372817 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f7916b-72c8-4ba3-a091-308320b3e88d None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:15.489344 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:15.507397 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff582c-9bc8-4101-aa05-78ab6a63c4a3 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:15.574844 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f7916b-72c8-4ba3-a091-308320b3e88d None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:15.641459 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d1dd4d-c49b-4d26-8c04-a9bf77d09dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:15.642435 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d1dd4d-c49b-4d26-8c04-a9bf77d09dcd None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:15.642904 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d1dd4d-c49b-4d26-8c04-a9bf77d09dcd None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:15.643394 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d1dd4d-c49b-4d26-8c04-a9bf77d09dcd None admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:15.644285 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d1dd4d-c49b-4d26-8c04-a9bf77d09dcd None admin] RBAC: Adding query filter params (name=reader) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:15.644777 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d1dd4d-c49b-4d26-8c04-a9bf77d09dcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:15.652045 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d1dd4d-c49b-4d26-8c04-a9bf77d09dcd None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:15.667898 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 54/103] 10.222.0.49 () {56 vars in 1101 bytes} [Sun Aug 28 00:44:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:15.675623 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d1dd4d-c49b-4d26-8c04-a9bf77d09dcd None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:15.682437 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:15.713405 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff582c-9bc8-4101-aa05-78ab6a63c4a3 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:15.813090 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118d2f24-9570-46b2-a3ff-a81911d2f046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:15.813665 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d2f24-9570-46b2-a3ff-a81911d2f046 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:15.813944 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d2f24-9570-46b2-a3ff-a81911d2f046 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:15.814213 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d2f24-9570-46b2-a3ff-a81911d2f046 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:15.815354 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118d2f24-9570-46b2-a3ff-a81911d2f046 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:15.818462 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118d2f24-9570-46b2-a3ff-a81911d2f046 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:15.818797 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 50/104] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:44:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:15.833502 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118d2f24-9570-46b2-a3ff-a81911d2f046 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:15.860087 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d1dd4d-c49b-4d26-8c04-a9bf77d09dcd None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:15.901029 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:15.910693 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc51a3-8e52-43c2-aee0-15ea3cd28b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:15.911606 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc51a3-8e52-43c2-aee0-15ea3cd28b5b None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:15.912302 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc51a3-8e52-43c2-aee0-15ea3cd28b5b None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:15.912791 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc51a3-8e52-43c2-aee0-15ea3cd28b5b None admin] PATH_INFO: `/v3/users/e7e2c36eb6ee4f8d8467526f55d6d424` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:15.938732 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcc51a3-8e52-43c2-aee0-15ea3cd28b5b None admin] RBAC: Authorizing `identity:get_user(user_id=e7e2c36eb6ee4f8d8467526f55d6d424)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:15.941149 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcc51a3-8e52-43c2-aee0-15ea3cd28b5b None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:15.943919 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 55/105] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 28 00:44:15 2022] GET /identity/v3/users/e7e2c36eb6ee4f8d8467526f55d6d424 => generated 289 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:44:15.950170 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc51a3-8e52-43c2-aee0-15ea3cd28b5b None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:16.043706 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118d2f24-9570-46b2-a3ff-a81911d2f046 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:16.112700 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d03ea-9d84-441c-9838-7f466f1e7267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:16.112700 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d03ea-9d84-441c-9838-7f466f1e7267 None admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:16.112700 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d03ea-9d84-441c-9838-7f466f1e7267 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:16.112700 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d03ea-9d84-441c-9838-7f466f1e7267 None admin] PATH_INFO: `/v3/projects` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:16.113072 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972d03ea-9d84-441c-9838-7f466f1e7267 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:16.114073 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972d03ea-9d84-441c-9838-7f466f1e7267 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:16.162638 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc51a3-8e52-43c2-aee0-15ea3cd28b5b None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:16.165882 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 51/106] 10.222.0.49 () {60 vars in 1141 bytes} [Sun Aug 28 00:44:15 2022] POST /identity/v3/projects => generated 302 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:44:16.231402 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab5355-b5d1-40d1-a270-351807d729af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:16.232495 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab5355-b5d1-40d1-a270-351807d729af None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:16.232970 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab5355-b5d1-40d1-a270-351807d729af None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:16.233434 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab5355-b5d1-40d1-a270-351807d729af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:16.308698 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:16.311642 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d29a05-dee2-4d59-ae57-dcc2ba890508 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:16.311967 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d29a05-dee2-4d59-ae57-dcc2ba890508 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:16.312251 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d29a05-dee2-4d59-ae57-dcc2ba890508 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:16.316001 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 52/107] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:44:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:44:16.322186 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e7761-2d54-4d15-882d-6a616fe1a216 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:16.322471 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e7761-2d54-4d15-882d-6a616fe1a216 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:16.322754 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e7761-2d54-4d15-882d-6a616fe1a216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:16.328254 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ab5355-b5d1-40d1-a270-351807d729af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:16.329941 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ab5355-b5d1-40d1-a270-351807d729af None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:16.342616 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:16.368977 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-6b2e7761-2d54-4d15-882d-6a616fe1a216 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:44:16.370141 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-6b2e7761-2d54-4d15-882d-6a616fe1a216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:44:16.517291 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 56/108] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 28 00:44:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:44:16.518792 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 53/109] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:44:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:44:16.524998 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e7761-2d54-4d15-882d-6a616fe1a216 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:16.572847 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7baed76-1db2-4bfc-90a5-59b5d5f4b5b2 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:16.573431 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7baed76-1db2-4bfc-90a5-59b5d5f4b5b2 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:16.573882 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7baed76-1db2-4bfc-90a5-59b5d5f4b5b2 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:16.576053 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 57/110] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:44:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:44:16.584317 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1a6af-74ca-400e-834c-36679a8c0a59 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:16.584847 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1a6af-74ca-400e-834c-36679a8c0a59 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:16.585284 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1a6af-74ca-400e-834c-36679a8c0a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:16.605211 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-d6e1a6af-74ca-400e-834c-36679a8c0a59 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:44:16.606469 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-d6e1a6af-74ca-400e-834c-36679a8c0a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:44:16.679994 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e7761-2d54-4d15-882d-6a616fe1a216 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:16.686323 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 58/111] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:44:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:44:16.731401 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14019993-a9dc-497e-9266-7658d6d451e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:16.732583 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14019993-a9dc-497e-9266-7658d6d451e2 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:16.733029 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14019993-a9dc-497e-9266-7658d6d451e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:16.733462 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14019993-a9dc-497e-9266-7658d6d451e2 None admin] PATH_INFO: `/v3/projects/a8086350f8e74846828edcab8c1d0577` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:16.734752 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14019993-a9dc-497e-9266-7658d6d451e2 None admin] RBAC: Authorizing `identity:get_project(project_id=a8086350f8e74846828edcab8c1d0577)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:16.736521 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14019993-a9dc-497e-9266-7658d6d451e2 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:16.738344 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 54/112] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 28 00:44:16 2022] GET /identity/v3/projects/a8086350f8e74846828edcab8c1d0577 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:16.744537 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e1a6af-74ca-400e-834c-36679a8c0a59 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:16.763782 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:16.853814 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14019993-a9dc-497e-9266-7658d6d451e2 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:16.859689 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:16.861359 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e1a6af-74ca-400e-834c-36679a8c0a59 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:16.903401 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c09da1-2a3c-40b8-9f8b-072cdb6a770c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:16.903401 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c09da1-2a3c-40b8-9f8b-072cdb6a770c None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:16.903401 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c09da1-2a3c-40b8-9f8b-072cdb6a770c None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:16.903401 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c09da1-2a3c-40b8-9f8b-072cdb6a770c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:16.903844 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c09da1-2a3c-40b8-9f8b-072cdb6a770c None admin] RBAC: Adding query filter params (role.id=708b4012bb2645b6aa4af9606988ce56, scope.project.id=a8086350f8e74846828edcab8c1d0577, user.id=e7e2c36eb6ee4f8d8467526f55d6d424) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:16.903844 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c09da1-2a3c-40b8-9f8b-072cdb6a770c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:16.905247 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c09da1-2a3c-40b8-9f8b-072cdb6a770c None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:16.912062 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 59/113] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 28 00:44:16 2022] GET /identity/v3/role_assignments?user.id=e7e2c36eb6ee4f8d8467526f55d6d424&scope.project.id=a8086350f8e74846828edcab8c1d0577&role.id=708b4012bb2645b6aa4af9606988ce56 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:17.019860 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14019993-a9dc-497e-9266-7658d6d451e2 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:17.078583 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48600329-8b36-41f7-80a9-4e427fb39c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:17.079354 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48600329-8b36-41f7-80a9-4e427fb39c91 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:17.079530 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48600329-8b36-41f7-80a9-4e427fb39c91 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:17.079836 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48600329-8b36-41f7-80a9-4e427fb39c91 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:17.096290 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48600329-8b36-41f7-80a9-4e427fb39c91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:44:17.101575 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-48600329-8b36-41f7-80a9-4e427fb39c91 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:44:17.101575 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:44:17.101575 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:44:17.101575 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:44:17.101575 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:44:17.101575 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:44:17.101575 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:44:17.101575 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:44:17.101575 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:44:17.101575 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:44:17.101575 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:44:17.101575 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:44:17.101575 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:44:17.101575 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:44:17.101575 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:44:17.101575 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:44:17.102474 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:44:17.102474 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:44:17.102474 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:44:17.102474 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:44:17.102474 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:44:17.102474 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:44:17.102474 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:44:17.102474 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:44:17.102474 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:44:17.102474 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:44:17.102474 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:44:17.102474 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:44:17.102474 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:44:17.102474 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:44:17.102474 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:44:17.102474 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:44:17.103245 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:44:17.103245 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:44:17.103245 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:44:17.103245 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:44:17.103245 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:44:17.103245 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:44:17.103245 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:44:17.103245 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:44:17.103245 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:44:17.103245 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:44:17.103245 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:44:17.103245 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:44:17.103245 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 55/114] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 28 00:44:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:44:17.110048 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c09da1-2a3c-40b8-9f8b-072cdb6a770c None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:17.206501 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:17.234056 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c09da1-2a3c-40b8-9f8b-072cdb6a770c None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:17.275440 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d5eb6b-4102-48a1-a78c-64b64bfcafd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:17.276019 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5eb6b-4102-48a1-a78c-64b64bfcafd0 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:17.276433 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5eb6b-4102-48a1-a78c-64b64bfcafd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:17.276713 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d5eb6b-4102-48a1-a78c-64b64bfcafd0 None admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:17.277400 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d5eb6b-4102-48a1-a78c-64b64bfcafd0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:17.277753 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d5eb6b-4102-48a1-a78c-64b64bfcafd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:17.279162 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d5eb6b-4102-48a1-a78c-64b64bfcafd0 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:17.288561 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 60/115] 10.222.0.49 () {56 vars in 1101 bytes} [Sun Aug 28 00:44:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:17.294175 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48600329-8b36-41f7-80a9-4e427fb39c91 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:17.331787 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d5eb6b-4102-48a1-a78c-64b64bfcafd0 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:17.389516 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:17.493755 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48600329-8b36-41f7-80a9-4e427fb39c91 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:17.538849 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d5eb6b-4102-48a1-a78c-64b64bfcafd0 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:17.567840 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d0b2a-a6a2-4d2c-89c0-24fa325f6ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:17.568547 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d0b2a-a6a2-4d2c-89c0-24fa325f6ce8 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:17.568831 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d0b2a-a6a2-4d2c-89c0-24fa325f6ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:17.569143 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d0b2a-a6a2-4d2c-89c0-24fa325f6ce8 None admin] PATH_INFO: `/v3/users/06cf6d63014b475ca19007466ceb7bb7` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:17.571075 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183d0b2a-a6a2-4d2c-89c0-24fa325f6ce8 None admin] RBAC: Authorizing `identity:get_user(user_id=06cf6d63014b475ca19007466ceb7bb7)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:17.572580 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183d0b2a-a6a2-4d2c-89c0-24fa325f6ce8 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:17.575349 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 56/116] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 28 00:44:17 2022] GET /identity/v3/users/06cf6d63014b475ca19007466ceb7bb7 => generated 275 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:17.582056 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d0b2a-a6a2-4d2c-89c0-24fa325f6ce8 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:17.628802 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888301ed-7140-4721-a919-1e05e9e49d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:17.629456 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888301ed-7140-4721-a919-1e05e9e49d41 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:17.629743 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888301ed-7140-4721-a919-1e05e9e49d41 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:17.630021 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888301ed-7140-4721-a919-1e05e9e49d41 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:17.641287 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888301ed-7140-4721-a919-1e05e9e49d41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:44:17.647865 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-888301ed-7140-4721-a919-1e05e9e49d41 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:44:17.647865 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:44:17.647865 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:44:17.647865 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:44:17.647865 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:44:17.647865 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:44:17.647865 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:44:17.647865 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:44:17.647865 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:44:17.647865 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:44:17.647865 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:44:17.647865 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:44:17.647865 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:44:17.647865 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:44:17.647865 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:44:17.647865 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:44:17.648733 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:44:17.648733 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:44:17.648733 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:44:17.648733 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:44:17.648733 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:44:17.648733 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:44:17.648733 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:44:17.648733 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:44:17.648733 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:44:17.648733 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:44:17.648733 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:44:17.648733 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:44:17.648733 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:44:17.648733 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:44:17.648733 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:44:17.648733 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:44:17.649476 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:44:17.649476 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:44:17.649476 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:44:17.649476 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:44:17.649476 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:44:17.649476 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:44:17.649476 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:44:17.649476 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:44:17.649476 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:44:17.649476 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:44:17.649476 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:44:17.649476 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:44:17.649476 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 61/117] 10.222.0.49 () {56 vars in 1096 bytes} [Sun Aug 28 00:44:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:44:17.650657 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934848a7-bb49-4759-a478-513408c3f503 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:17.651757 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934848a7-bb49-4759-a478-513408c3f503 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:17.651757 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934848a7-bb49-4759-a478-513408c3f503 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:17.653585 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 62/118] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:44:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:44:17.658933 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934848a7-bb49-4759-a478-513408c3f503 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:17.664011 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:17.766062 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d0b2a-a6a2-4d2c-89c0-24fa325f6ce8 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:17.807697 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:17.816219 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254d09d-27fd-4b64-815e-d62399d570f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:17.817257 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254d09d-27fd-4b64-815e-d62399d570f6 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:17.817531 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254d09d-27fd-4b64-815e-d62399d570f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:17.817810 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254d09d-27fd-4b64-815e-d62399d570f6 None admin] PATH_INFO: `/v3/projects/a8086350f8e74846828edcab8c1d0577` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:17.819021 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e254d09d-27fd-4b64-815e-d62399d570f6 None admin] RBAC: Authorizing `identity:get_project(project_id=a8086350f8e74846828edcab8c1d0577)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:17.821231 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e254d09d-27fd-4b64-815e-d62399d570f6 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:17.823268 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 57/119] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 28 00:44:17 2022] GET /identity/v3/projects/a8086350f8e74846828edcab8c1d0577 => generated 298 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:17.825063 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8fca01-ad25-44b8-a7de-8161d6a7d586 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:17.825480 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8fca01-ad25-44b8-a7de-8161d6a7d586 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:17.825890 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8fca01-ad25-44b8-a7de-8161d6a7d586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:17.829460 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934848a7-bb49-4759-a478-513408c3f503 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:17.845061 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-6a8fca01-ad25-44b8-a7de-8161d6a7d586 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:44:17.846353 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-6a8fca01-ad25-44b8-a7de-8161d6a7d586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:44:17.872556 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb06e56a-036c-4d0b-895e-b5d9d8f81d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:17.873605 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb06e56a-036c-4d0b-895e-b5d9d8f81d78 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:17.874075 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb06e56a-036c-4d0b-895e-b5d9d8f81d78 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:17.874533 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb06e56a-036c-4d0b-895e-b5d9d8f81d78 None admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:17.875518 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb06e56a-036c-4d0b-895e-b5d9d8f81d78 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:17.876455 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb06e56a-036c-4d0b-895e-b5d9d8f81d78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:17.879229 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb06e56a-036c-4d0b-895e-b5d9d8f81d78 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:17.889255 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 63/120] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 28 00:44:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:17.891081 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d93e79-7145-4d16-8574-ba0c67d265c1 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:17.891572 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d93e79-7145-4d16-8574-ba0c67d265c1 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:17.892061 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d93e79-7145-4d16-8574-ba0c67d265c1 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:17.893806 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 64/121] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:44:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:44:17.894771 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d93e79-7145-4d16-8574-ba0c67d265c1 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:17.919502 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 58/122] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:44:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:44:17.920543 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8fca01-ad25-44b8-a7de-8161d6a7d586 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:17.982142 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:18.056465 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d93e79-7145-4d16-8574-ba0c67d265c1 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:18.096140 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3bfa3c-4375-4c93-bccd-a3d7624ccbc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:18.097280 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3bfa3c-4375-4c93-bccd-a3d7624ccbc1 None admin] REQUEST_METHOD: `PUT` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:18.097940 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3bfa3c-4375-4c93-bccd-a3d7624ccbc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:18.098418 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3bfa3c-4375-4c93-bccd-a3d7624ccbc1 None admin] PATH_INFO: `/v3/projects/a8086350f8e74846828edcab8c1d0577/users/06cf6d63014b475ca19007466ceb7bb7/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:18.100609 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3bfa3c-4375-4c93-bccd-a3d7624ccbc1 None admin] RBAC: Authorizing `identity:create_grant(project_id=a8086350f8e74846828edcab8c1d0577, user_id=06cf6d63014b475ca19007466ceb7bb7, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:18.102347 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3bfa3c-4375-4c93-bccd-a3d7624ccbc1 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:18.106664 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8fca01-ad25-44b8-a7de-8161d6a7d586 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:18.129987 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 65/123] 10.222.0.49 () {58 vars in 1439 bytes} [Sun Aug 28 00:44:17 2022] PUT /identity/v3/projects/a8086350f8e74846828edcab8c1d0577/users/06cf6d63014b475ca19007466ceb7bb7/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:44:18.132850 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b8c38-f903-42e8-ab0f-e462e13fd733 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:18.133147 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b8c38-f903-42e8-ab0f-e462e13fd733 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:18.133624 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b8c38-f903-42e8-ab0f-e462e13fd733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:18.164318 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:18.171932 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-b26b8c38-f903-42e8-ab0f-e462e13fd733 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:44:18.173192 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-b26b8c38-f903-42e8-ab0f-e462e13fd733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:44:18.174596 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3248d9d4-5664-4b76-86b3-ae0ff596db5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:18.175316 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248d9d4-5664-4b76-86b3-ae0ff596db5a None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:18.175552 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248d9d4-5664-4b76-86b3-ae0ff596db5a None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:18.175854 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248d9d4-5664-4b76-86b3-ae0ff596db5a None admin] PATH_INFO: `/v3/users/8474eba1fd11486db87ca8aa2a114668` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:18.177329 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3248d9d4-5664-4b76-86b3-ae0ff596db5a None admin] RBAC: Authorizing `identity:get_user(user_id=8474eba1fd11486db87ca8aa2a114668)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:18.178822 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3248d9d4-5664-4b76-86b3-ae0ff596db5a None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:18.180497 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 59/124] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 28 00:44:17 2022] GET /identity/v3/users/8474eba1fd11486db87ca8aa2a114668 => generated 247 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:18.186364 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3248d9d4-5664-4b76-86b3-ae0ff596db5a None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:18.314534 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 66/125] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:44:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:44:18.315432 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26b8c38-f903-42e8-ab0f-e462e13fd733 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:18.390088 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3248d9d4-5664-4b76-86b3-ae0ff596db5a None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:18.434813 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:18.461337 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d55666b-8bdb-4163-b0ef-d235c59025c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:18.462001 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d55666b-8bdb-4163-b0ef-d235c59025c6 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:18.462480 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d55666b-8bdb-4163-b0ef-d235c59025c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:18.462764 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d55666b-8bdb-4163-b0ef-d235c59025c6 None admin] PATH_INFO: `/v3/projects/a8086350f8e74846828edcab8c1d0577` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:18.468744 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d55666b-8bdb-4163-b0ef-d235c59025c6 None admin] RBAC: Authorizing `identity:get_project(project_id=a8086350f8e74846828edcab8c1d0577)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:18.471038 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d55666b-8bdb-4163-b0ef-d235c59025c6 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:18.473896 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 60/126] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 28 00:44:18 2022] GET /identity/v3/projects/a8086350f8e74846828edcab8c1d0577 => generated 298 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:44:18.480216 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d55666b-8bdb-4163-b0ef-d235c59025c6 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:18.535858 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26b8c38-f903-42e8-ab0f-e462e13fd733 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:18.572235 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:18.601912 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d55666b-8bdb-4163-b0ef-d235c59025c6 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:18.617006 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba5fb41-441d-4091-8401-1768d749e2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:18.617740 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5fb41-441d-4091-8401-1768d749e2e4 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:18.618033 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5fb41-441d-4091-8401-1768d749e2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:18.618352 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5fb41-441d-4091-8401-1768d749e2e4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:18.634178 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba5fb41-441d-4091-8401-1768d749e2e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:44:18.639538 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-aba5fb41-441d-4091-8401-1768d749e2e4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:44:18.639538 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:44:18.639538 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:44:18.639538 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:44:18.639538 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:44:18.639538 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:44:18.639538 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:44:18.639538 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:44:18.639538 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:44:18.639538 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:44:18.639538 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:44:18.639538 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:44:18.639538 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:44:18.639538 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:44:18.639538 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:44:18.639538 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:44:18.640461 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:44:18.640461 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:44:18.640461 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:44:18.640461 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:44:18.640461 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:44:18.640461 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:44:18.640461 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:44:18.640461 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:44:18.640461 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:44:18.640461 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:44:18.640461 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:44:18.640461 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:44:18.640461 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:44:18.640461 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:44:18.640461 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:44:18.640461 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:44:18.641235 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:44:18.641235 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:44:18.641235 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:44:18.641235 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:44:18.641235 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:44:18.641235 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:44:18.641235 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:44:18.641235 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:44:18.641235 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:44:18.641235 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:44:18.641235 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:44:18.641235 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:44:18.643566 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 67/127] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 28 00:44:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:44:18.649373 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba5fb41-441d-4091-8401-1768d749e2e4 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:18.669556 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cecb6b-502d-4be5-9ccd-5545f1ca5ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:18.670389 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cecb6b-502d-4be5-9ccd-5545f1ca5ac3 None admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:18.670674 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cecb6b-502d-4be5-9ccd-5545f1ca5ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:18.671024 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cecb6b-502d-4be5-9ccd-5545f1ca5ac3 None admin] PATH_INFO: `/v3/projects/a8086350f8e74846828edcab8c1d0577/users/8474eba1fd11486db87ca8aa2a114668/roles/2e4889bb71f9434392c0baba59f2534e` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:18.677859 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cecb6b-502d-4be5-9ccd-5545f1ca5ac3 None admin] RBAC: Authorizing `identity:create_grant(project_id=a8086350f8e74846828edcab8c1d0577, user_id=8474eba1fd11486db87ca8aa2a114668, role_id=2e4889bb71f9434392c0baba59f2534e)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:18.679644 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cecb6b-502d-4be5-9ccd-5545f1ca5ac3 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:18.712212 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 61/128] 10.222.0.49 () {58 vars in 1439 bytes} [Sun Aug 28 00:44:18 2022] PUT /identity/v3/projects/a8086350f8e74846828edcab8c1d0577/users/8474eba1fd11486db87ca8aa2a114668/roles/2e4889bb71f9434392c0baba59f2534e => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:44:18.797447 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba5fb41-441d-4091-8401-1768d749e2e4 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:18.809263 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cecb6b-502d-4be5-9ccd-5545f1ca5ac3 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:18.817725 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:18.863301 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a298e-a7d2-4b82-96e2-8c9b8c7ff869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:18.863952 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a298e-a7d2-4b82-96e2-8c9b8c7ff869 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:18.864231 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a298e-a7d2-4b82-96e2-8c9b8c7ff869 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:18.867953 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a298e-a7d2-4b82-96e2-8c9b8c7ff869 None admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:18.868717 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634a298e-a7d2-4b82-96e2-8c9b8c7ff869 None admin] RBAC: Adding query filter params (name=member) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:18.869027 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634a298e-a7d2-4b82-96e2-8c9b8c7ff869 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:18.871299 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634a298e-a7d2-4b82-96e2-8c9b8c7ff869 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:18.887746 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 68/129] 10.222.0.49 () {56 vars in 1101 bytes} [Sun Aug 28 00:44:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:44:18.893598 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a298e-a7d2-4b82-96e2-8c9b8c7ff869 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:18.983024 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cecb6b-502d-4be5-9ccd-5545f1ca5ac3 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:19.010977 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:19.023308 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de6ab9e-e336-4730-99bc-98d05a3acf4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:19.024235 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6ab9e-e336-4730-99bc-98d05a3acf4f None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:19.024546 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6ab9e-e336-4730-99bc-98d05a3acf4f None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:19.025371 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de6ab9e-e336-4730-99bc-98d05a3acf4f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:19.038805 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de6ab9e-e336-4730-99bc-98d05a3acf4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:44:19.044768 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-8de6ab9e-e336-4730-99bc-98d05a3acf4f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:44:19.044768 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:44:19.044768 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:44:19.044768 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:44:19.044768 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:44:19.044768 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:44:19.044768 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:44:19.044768 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:44:19.044768 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:44:19.044768 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:44:19.044768 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:44:19.044768 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:44:19.044768 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:44:19.044768 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:44:19.044768 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:44:19.044768 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:44:19.045621 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:44:19.045621 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:44:19.045621 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:44:19.045621 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:44:19.045621 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:44:19.045621 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:44:19.045621 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:44:19.045621 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:44:19.045621 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:44:19.045621 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:44:19.045621 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:44:19.045621 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:44:19.045621 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:44:19.045621 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:44:19.045621 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:44:19.045621 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:44:19.046606 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:44:19.046606 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:44:19.046606 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:44:19.046606 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:44:19.046606 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:44:19.046606 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:44:19.046606 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:44:19.046606 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:44:19.046606 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:44:19.046606 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:44:19.046606 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:44:19.046606 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:44:19.046606 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 62/130] 10.222.0.49 () {56 vars in 1114 bytes} [Sun Aug 28 00:44:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:44:19.054951 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de6ab9e-e336-4730-99bc-98d05a3acf4f None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:19.106095 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a298e-a7d2-4b82-96e2-8c9b8c7ff869 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:19.145319 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116fd88c-bf56-4b39-aea7-a2ad60ff620c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:19.145916 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116fd88c-bf56-4b39-aea7-a2ad60ff620c None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:19.146134 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116fd88c-bf56-4b39-aea7-a2ad60ff620c None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:19.146405 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116fd88c-bf56-4b39-aea7-a2ad60ff620c None admin] PATH_INFO: `/v3/users/06cf6d63014b475ca19007466ceb7bb7` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:19.147545 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116fd88c-bf56-4b39-aea7-a2ad60ff620c None admin] RBAC: Authorizing `identity:get_user(user_id=06cf6d63014b475ca19007466ceb7bb7)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:19.149043 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116fd88c-bf56-4b39-aea7-a2ad60ff620c None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:19.151032 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 69/131] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 28 00:44:18 2022] GET /identity/v3/users/06cf6d63014b475ca19007466ceb7bb7 => generated 275 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:19.157428 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116fd88c-bf56-4b39-aea7-a2ad60ff620c None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:19.207035 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:19.265349 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116fd88c-bf56-4b39-aea7-a2ad60ff620c None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:19.303690 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de6ab9e-e336-4730-99bc-98d05a3acf4f None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:19.304210 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e56db0-b59e-4d02-95e3-134f07e47f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:19.304210 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e56db0-b59e-4d02-95e3-134f07e47f2f None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:19.304210 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e56db0-b59e-4d02-95e3-134f07e47f2f None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:19.304210 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e56db0-b59e-4d02-95e3-134f07e47f2f None admin] PATH_INFO: `/v3/projects/5ff0ec6683c249d1963fb7c6a4a51ed9` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:19.305310 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e56db0-b59e-4d02-95e3-134f07e47f2f None admin] RBAC: Authorizing `identity:get_project(project_id=5ff0ec6683c249d1963fb7c6a4a51ed9)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:19.306883 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e56db0-b59e-4d02-95e3-134f07e47f2f None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:19.308764 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 70/132] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 28 00:44:19 2022] GET /identity/v3/projects/5ff0ec6683c249d1963fb7c6a4a51ed9 => generated 312 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:44:19.308764 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb6f32-6364-4d31-99ee-8fa4fb864988 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:19.308764 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb6f32-6364-4d31-99ee-8fa4fb864988 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:19.308764 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abb6f32-6364-4d31-99ee-8fa4fb864988 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:19.323996 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 71/133] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:44:19 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:44:19.323996 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abb6f32-6364-4d31-99ee-8fa4fb864988 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:19.376436 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c879b68-c458-48b0-92ba-eefa8f137a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:19.377462 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c879b68-c458-48b0-92ba-eefa8f137a8b None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:19.377935 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c879b68-c458-48b0-92ba-eefa8f137a8b None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:19.378400 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c879b68-c458-48b0-92ba-eefa8f137a8b None admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:19.379274 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c879b68-c458-48b0-92ba-eefa8f137a8b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:19.379791 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c879b68-c458-48b0-92ba-eefa8f137a8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:19.381467 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c879b68-c458-48b0-92ba-eefa8f137a8b None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:19.390769 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 63/134] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 28 00:44:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:19.396973 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9886c-c4ee-4136-a518-1198c1c5bbec None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:19.397503 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9886c-c4ee-4136-a518-1198c1c5bbec None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:19.397967 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9886c-c4ee-4136-a518-1198c1c5bbec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:19.436832 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-22b9886c-c4ee-4136-a518-1198c1c5bbec None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:44:19.438023 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abb6f32-6364-4d31-99ee-8fa4fb864988 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:19.438738 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-22b9886c-c4ee-4136-a518-1198c1c5bbec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:44:19.454084 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:19.480307 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8fcd82-f2e3-458f-ab43-14c8ec94018f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:19.481407 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8fcd82-f2e3-458f-ab43-14c8ec94018f None admin] REQUEST_METHOD: `PUT` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:19.481930 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8fcd82-f2e3-458f-ab43-14c8ec94018f None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:19.482393 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8fcd82-f2e3-458f-ab43-14c8ec94018f None admin] PATH_INFO: `/v3/projects/5ff0ec6683c249d1963fb7c6a4a51ed9/users/06cf6d63014b475ca19007466ceb7bb7/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:19.484628 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8fcd82-f2e3-458f-ab43-14c8ec94018f None admin] RBAC: Authorizing `identity:create_grant(project_id=5ff0ec6683c249d1963fb7c6a4a51ed9, user_id=06cf6d63014b475ca19007466ceb7bb7, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:19.486375 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8fcd82-f2e3-458f-ab43-14c8ec94018f None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:19.512015 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 72/135] 10.222.0.49 () {58 vars in 1439 bytes} [Sun Aug 28 00:44:19 2022] PUT /identity/v3/projects/5ff0ec6683c249d1963fb7c6a4a51ed9/users/06cf6d63014b475ca19007466ceb7bb7/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:44:19.513322 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8fcd82-f2e3-458f-ab43-14c8ec94018f None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:19.518028 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:19.575833 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 64/136] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:44:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:44:19.581886 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d72c5-5538-4b63-b460-854819a21ec4 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:19.582181 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d72c5-5538-4b63-b460-854819a21ec4 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:19.582443 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322d72c5-5538-4b63-b460-854819a21ec4 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:19.583839 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 65/137] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:44:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:44:19.589702 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14128b4-51c4-474f-a6d1-364d67946980 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:19.589999 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14128b4-51c4-474f-a6d1-364d67946980 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:19.590280 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14128b4-51c4-474f-a6d1-364d67946980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:19.621739 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-d14128b4-51c4-474f-a6d1-364d67946980 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:44:19.623020 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-d14128b4-51c4-474f-a6d1-364d67946980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:44:19.654515 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8fcd82-f2e3-458f-ab43-14c8ec94018f None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:19.695372 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c144a182-0283-47b4-b14b-afbebf2fef78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:19.696064 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c144a182-0283-47b4-b14b-afbebf2fef78 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:19.696322 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c144a182-0283-47b4-b14b-afbebf2fef78 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:19.696597 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c144a182-0283-47b4-b14b-afbebf2fef78 None admin] PATH_INFO: `/v3/users/06cf6d63014b475ca19007466ceb7bb7` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:19.697732 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c144a182-0283-47b4-b14b-afbebf2fef78 None admin] RBAC: Authorizing `identity:get_user(user_id=06cf6d63014b475ca19007466ceb7bb7)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:19.699208 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c144a182-0283-47b4-b14b-afbebf2fef78 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:19.701283 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 73/138] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 28 00:44:19 2022] GET /identity/v3/users/06cf6d63014b475ca19007466ceb7bb7 => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:19.712561 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c144a182-0283-47b4-b14b-afbebf2fef78 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:19.754334 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 66/139] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:44:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:44:19.795509 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:19.867296 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c144a182-0283-47b4-b14b-afbebf2fef78 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:19.910814 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3710d4-b67f-4d12-9c80-bfeca0da036c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:19.911387 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3710d4-b67f-4d12-9c80-bfeca0da036c None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:19.911688 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3710d4-b67f-4d12-9c80-bfeca0da036c None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:19.911974 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3710d4-b67f-4d12-9c80-bfeca0da036c None admin] PATH_INFO: `/v3/projects/a8086350f8e74846828edcab8c1d0577` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:19.913131 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3710d4-b67f-4d12-9c80-bfeca0da036c None admin] RBAC: Authorizing `identity:get_project(project_id=a8086350f8e74846828edcab8c1d0577)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:19.914612 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3710d4-b67f-4d12-9c80-bfeca0da036c None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:19.916315 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 74/140] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 28 00:44:19 2022] GET /identity/v3/projects/a8086350f8e74846828edcab8c1d0577 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:44:19.922242 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14128b4-51c4-474f-a6d1-364d67946980 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:20.005592 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3710d4-b67f-4d12-9c80-bfeca0da036c None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:20.101885 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14128b4-51c4-474f-a6d1-364d67946980 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:20.114536 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:20.182769 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a38cf-8d8a-4e1e-a94a-c7006ad02f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:20.183375 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a38cf-8d8a-4e1e-a94a-c7006ad02f92 None admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:20.183658 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a38cf-8d8a-4e1e-a94a-c7006ad02f92 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:20.184038 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a38cf-8d8a-4e1e-a94a-c7006ad02f92 None admin] PATH_INFO: `/v3/projects/a8086350f8e74846828edcab8c1d0577/users/06cf6d63014b475ca19007466ceb7bb7/roles/5bcf10de71e7404aaef4d7878053be82` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:20.189005 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533a38cf-8d8a-4e1e-a94a-c7006ad02f92 None admin] RBAC: Authorizing `identity:create_grant(project_id=a8086350f8e74846828edcab8c1d0577, user_id=06cf6d63014b475ca19007466ceb7bb7, role_id=5bcf10de71e7404aaef4d7878053be82)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:20.190523 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533a38cf-8d8a-4e1e-a94a-c7006ad02f92 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:20.216458 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 67/141] 10.222.0.49 () {58 vars in 1439 bytes} [Sun Aug 28 00:44:19 2022] PUT /identity/v3/projects/a8086350f8e74846828edcab8c1d0577/users/06cf6d63014b475ca19007466ceb7bb7/roles/5bcf10de71e7404aaef4d7878053be82 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:44:20.219490 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a38cf-8d8a-4e1e-a94a-c7006ad02f92 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:20.235367 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3710d4-b67f-4d12-9c80-bfeca0da036c None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:20.249375 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:20.283024 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae7fef8-f85a-482c-aa7a-2bde432cc23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:20.283691 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7fef8-f85a-482c-aa7a-2bde432cc23d None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:20.284682 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7fef8-f85a-482c-aa7a-2bde432cc23d None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:20.284985 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae7fef8-f85a-482c-aa7a-2bde432cc23d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:20.286267 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae7fef8-f85a-482c-aa7a-2bde432cc23d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:20.288033 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae7fef8-f85a-482c-aa7a-2bde432cc23d None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:20.290187 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 75/142] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:44:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:44:20.296830 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae7fef8-f85a-482c-aa7a-2bde432cc23d None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:20.479725 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae7fef8-f85a-482c-aa7a-2bde432cc23d None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:20.481786 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a38cf-8d8a-4e1e-a94a-c7006ad02f92 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:20.521647 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79987f83-1e18-41d9-a145-1efe208f9727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:20.522306 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79987f83-1e18-41d9-a145-1efe208f9727 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:20.522587 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79987f83-1e18-41d9-a145-1efe208f9727 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:20.522865 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79987f83-1e18-41d9-a145-1efe208f9727 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:20.540422 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576301bd-e2e3-4d95-9183-ee7063d4fe40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:20.541049 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576301bd-e2e3-4d95-9183-ee7063d4fe40 None admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:20.541329 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576301bd-e2e3-4d95-9183-ee7063d4fe40 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:20.541598 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576301bd-e2e3-4d95-9183-ee7063d4fe40 None admin] PATH_INFO: `/v3/users` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:20.546208 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576301bd-e2e3-4d95-9183-ee7063d4fe40 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:20.547732 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576301bd-e2e3-4d95-9183-ee7063d4fe40 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:20.549920 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79987f83-1e18-41d9-a145-1efe208f9727 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:44:20.560808 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-79987f83-1e18-41d9-a145-1efe208f9727 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 00:44:20.560808 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:44:20.560808 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:44:20.560808 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:44:20.560808 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:44:20.560808 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:44:20.560808 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:44:20.560808 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:44:20.560808 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:44:20.560808 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:44:20.560808 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:44:20.560808 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:44:20.560808 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:44:20.560808 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:44:20.560808 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:44:20.560808 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:44:20.561696 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:44:20.561696 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:44:20.561696 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:44:20.561696 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:44:20.561696 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:44:20.561696 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:44:20.561696 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:44:20.561696 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:44:20.561696 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:44:20.561696 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:44:20.561696 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:44:20.561696 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:44:20.561696 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:44:20.561696 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:44:20.561696 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:44:20.561696 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:44:20.562441 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:44:20.562441 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:44:20.562441 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:44:20.562441 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:44:20.562441 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:44:20.562441 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:44:20.562441 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:44:20.562441 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:44:20.562441 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:44:20.562441 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:44:20.562441 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 00:44:20.562441 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:44:20.564842 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 68/143] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 28 00:44:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:44:20.571144 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79987f83-1e18-41d9-a145-1efe208f9727 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:20.611503 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 76/144] 10.222.0.49 () {60 vars in 1132 bytes} [Sun Aug 28 00:44:20 2022] POST /identity/v3/users => generated 283 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:44:20.628132 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:20.723252 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79987f83-1e18-41d9-a145-1efe208f9727 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:20.761559 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef53bdd0-a73b-4dab-b1a1-8c2e132b8085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:20.762142 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef53bdd0-a73b-4dab-b1a1-8c2e132b8085 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:20.762428 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef53bdd0-a73b-4dab-b1a1-8c2e132b8085 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:20.762704 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef53bdd0-a73b-4dab-b1a1-8c2e132b8085 None admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:20.763389 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef53bdd0-a73b-4dab-b1a1-8c2e132b8085 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:20.763721 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef53bdd0-a73b-4dab-b1a1-8c2e132b8085 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:20.765379 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef53bdd0-a73b-4dab-b1a1-8c2e132b8085 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:20.775173 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 69/145] 10.222.0.49 () {56 vars in 1101 bytes} [Sun Aug 28 00:44:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:20.780947 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576301bd-e2e3-4d95-9183-ee7063d4fe40 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:20.820573 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:20.908024 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576301bd-e2e3-4d95-9183-ee7063d4fe40 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:20.941985 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e7144-85a8-4f78-bd91-b3a9d0ddd72b None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:20.942312 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e7144-85a8-4f78-bd91-b3a9d0ddd72b None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:20.942545 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e7144-85a8-4f78-bd91-b3a9d0ddd72b None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:20.944147 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 70/146] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:44:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:44:20.949709 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de287a6-5c9c-457b-aa5e-547e0ac250c3 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:20.950011 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de287a6-5c9c-457b-aa5e-547e0ac250c3 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:20.950265 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de287a6-5c9c-457b-aa5e-547e0ac250c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:20.954104 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867079d0-6e68-4683-b209-4c7db675b28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:20.954762 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867079d0-6e68-4683-b209-4c7db675b28b None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:20.955149 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867079d0-6e68-4683-b209-4c7db675b28b None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:20.955780 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867079d0-6e68-4683-b209-4c7db675b28b None admin] PATH_INFO: `/v3/users/e7e2c36eb6ee4f8d8467526f55d6d424` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:20.957564 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867079d0-6e68-4683-b209-4c7db675b28b None admin] RBAC: Authorizing `identity:get_user(user_id=e7e2c36eb6ee4f8d8467526f55d6d424)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:20.959999 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867079d0-6e68-4683-b209-4c7db675b28b None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:20.961846 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 77/147] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 28 00:44:20 2022] GET /identity/v3/users/e7e2c36eb6ee4f8d8467526f55d6d424 => generated 289 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:20.968236 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867079d0-6e68-4683-b209-4c7db675b28b None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:20.980855 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-1de287a6-5c9c-457b-aa5e-547e0ac250c3 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:44:20.982078 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-1de287a6-5c9c-457b-aa5e-547e0ac250c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:44:21.085406 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:21.089467 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867079d0-6e68-4683-b209-4c7db675b28b None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:21.149032 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 71/148] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:44:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:44:21.155030 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d0a39-45a0-466d-845b-8400e0346ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:21.156044 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d0a39-45a0-466d-845b-8400e0346ca9 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:21.156513 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d0a39-45a0-466d-845b-8400e0346ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:21.156970 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d0a39-45a0-466d-845b-8400e0346ca9 None admin] PATH_INFO: `/v3/projects/a8086350f8e74846828edcab8c1d0577` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:21.158704 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4d0a39-45a0-466d-845b-8400e0346ca9 None admin] RBAC: Authorizing `identity:get_project(project_id=a8086350f8e74846828edcab8c1d0577)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:21.160495 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4d0a39-45a0-466d-845b-8400e0346ca9 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:21.162397 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 78/149] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 28 00:44:20 2022] GET /identity/v3/projects/a8086350f8e74846828edcab8c1d0577 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:44:21.169068 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de287a6-5c9c-457b-aa5e-547e0ac250c3 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:21.205108 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:21.315210 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de287a6-5c9c-457b-aa5e-547e0ac250c3 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:21.366223 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cc4f2d-d5eb-466f-ae30-9f029dfa16f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:21.367227 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc4f2d-d5eb-466f-ae30-9f029dfa16f6 None admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:21.367716 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc4f2d-d5eb-466f-ae30-9f029dfa16f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:21.368181 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc4f2d-d5eb-466f-ae30-9f029dfa16f6 None admin] PATH_INFO: `/v3/projects/a8086350f8e74846828edcab8c1d0577/users/e7e2c36eb6ee4f8d8467526f55d6d424/roles/708b4012bb2645b6aa4af9606988ce56` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:21.372636 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cc4f2d-d5eb-466f-ae30-9f029dfa16f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=a8086350f8e74846828edcab8c1d0577, user_id=e7e2c36eb6ee4f8d8467526f55d6d424, role_id=708b4012bb2645b6aa4af9606988ce56)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:21.374333 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cc4f2d-d5eb-466f-ae30-9f029dfa16f6 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:21.395998 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 72/150] 10.222.0.49 () {58 vars in 1439 bytes} [Sun Aug 28 00:44:21 2022] PUT /identity/v3/projects/a8086350f8e74846828edcab8c1d0577/users/e7e2c36eb6ee4f8d8467526f55d6d424/roles/708b4012bb2645b6aa4af9606988ce56 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:44:21.523811 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d0a39-45a0-466d-845b-8400e0346ca9 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:21.649423 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d0a39-45a0-466d-845b-8400e0346ca9 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:21.689387 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba475c5c-2755-4706-a5d6-a9f272a84f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:21.690421 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba475c5c-2755-4706-a5d6-a9f272a84f18 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:21.690885 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba475c5c-2755-4706-a5d6-a9f272a84f18 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:21.691358 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba475c5c-2755-4706-a5d6-a9f272a84f18 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:21.693352 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c82889-bf2e-4644-9878-da8193dac109 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:21.694158 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c82889-bf2e-4644-9878-da8193dac109 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:21.694653 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c82889-bf2e-4644-9878-da8193dac109 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:21.696252 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 73/151] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:44:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:44:21.701886 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843abf70-df28-460d-8c07-ee8514fb8927 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:21.702445 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843abf70-df28-460d-8c07-ee8514fb8927 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:21.702917 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843abf70-df28-460d-8c07-ee8514fb8927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:21.715344 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba475c5c-2755-4706-a5d6-a9f272a84f18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:44:21.726728 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-ba475c5c-2755-4706-a5d6-a9f272a84f18 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:44:21.726728 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:44:21.726728 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:44:21.726728 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:44:21.726728 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:44:21.726728 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:44:21.726728 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:44:21.726728 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:44:21.726728 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:44:21.726728 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:44:21.726728 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:44:21.726728 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:44:21.726728 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:44:21.726728 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:44:21.726728 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:44:21.726728 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:44:21.727615 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:44:21.727615 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:44:21.727615 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:44:21.727615 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:44:21.727615 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:44:21.727615 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:44:21.727615 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:44:21.727615 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:44:21.727615 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:44:21.727615 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:44:21.727615 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:44:21.727615 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:44:21.727615 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:44:21.727615 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:44:21.727615 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:44:21.727615 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:44:21.730406 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:44:21.730406 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:44:21.730406 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:44:21.730406 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:44:21.730406 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:44:21.730406 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:44:21.730406 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:44:21.730406 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:44:21.730406 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:44:21.730406 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:44:21.730406 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:44:21.730406 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:44:21.730406 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 79/152] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 28 00:44:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:44:21.735779 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-843abf70-df28-460d-8c07-ee8514fb8927 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:44:21.737013 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-843abf70-df28-460d-8c07-ee8514fb8927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:44:21.741085 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba475c5c-2755-4706-a5d6-a9f272a84f18 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:21.774477 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:21.832137 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 74/153] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:44:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:44:21.901081 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba475c5c-2755-4706-a5d6-a9f272a84f18 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:21.939058 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26b515-be54-4371-a02a-21f74cee3b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:21.939695 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26b515-be54-4371-a02a-21f74cee3b8e None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:21.939984 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26b515-be54-4371-a02a-21f74cee3b8e None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:21.940254 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26b515-be54-4371-a02a-21f74cee3b8e None admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:21.940948 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df26b515-be54-4371-a02a-21f74cee3b8e None admin] RBAC: Adding query filter params (name=member) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:21.941246 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df26b515-be54-4371-a02a-21f74cee3b8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:21.942655 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df26b515-be54-4371-a02a-21f74cee3b8e None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:21.956389 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 80/154] 10.222.0.49 () {56 vars in 1101 bytes} [Sun Aug 28 00:44:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:44:21.962087 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843abf70-df28-460d-8c07-ee8514fb8927 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:21.982505 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:22.105139 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843abf70-df28-460d-8c07-ee8514fb8927 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:22.149448 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccce197-9e01-4235-b1a3-67fa83f8873d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:22.150088 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccce197-9e01-4235-b1a3-67fa83f8873d None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:22.150364 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccce197-9e01-4235-b1a3-67fa83f8873d None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:22.150636 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccce197-9e01-4235-b1a3-67fa83f8873d None admin] PATH_INFO: `/v3/users/06cf6d63014b475ca19007466ceb7bb7` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:22.151875 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccce197-9e01-4235-b1a3-67fa83f8873d None admin] RBAC: Authorizing `identity:get_user(user_id=06cf6d63014b475ca19007466ceb7bb7)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:22.153444 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccce197-9e01-4235-b1a3-67fa83f8873d None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:22.155243 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 75/155] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 28 00:44:21 2022] GET /identity/v3/users/06cf6d63014b475ca19007466ceb7bb7 => generated 275 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:22.160920 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26b515-be54-4371-a02a-21f74cee3b8e None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:22.225240 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccce197-9e01-4235-b1a3-67fa83f8873d None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:22.317957 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:22.336586 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:22.343918 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26b515-be54-4371-a02a-21f74cee3b8e None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:22.357517 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccce197-9e01-4235-b1a3-67fa83f8873d None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:22.397085 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a6f7b0-3601-43f9-84a6-0cff663efad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:22.398013 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6f7b0-3601-43f9-84a6-0cff663efad6 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:22.398500 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6f7b0-3601-43f9-84a6-0cff663efad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:22.398957 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a6f7b0-3601-43f9-84a6-0cff663efad6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:22.405904 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f79795f-3a4b-4784-a6c6-2f0a27f8d252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:22.406469 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79795f-3a4b-4784-a6c6-2f0a27f8d252 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:22.406749 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79795f-3a4b-4784-a6c6-2f0a27f8d252 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:22.407019 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79795f-3a4b-4784-a6c6-2f0a27f8d252 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:22.412333 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a6f7b0-3601-43f9-84a6-0cff663efad6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:44:22.417744 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-47a6f7b0-3601-43f9-84a6-0cff663efad6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:44:22.417744 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:44:22.417744 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:44:22.417744 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:44:22.417744 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:44:22.417744 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:44:22.417744 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:44:22.417744 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:44:22.417744 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:44:22.417744 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:44:22.417744 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:44:22.417744 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:44:22.417744 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:44:22.417744 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:44:22.417744 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:44:22.417744 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:44:22.418872 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:44:22.418872 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:44:22.418872 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:44:22.418872 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:44:22.418872 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:44:22.418872 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:44:22.418872 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:44:22.418872 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:44:22.418872 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:44:22.418872 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:44:22.418872 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:44:22.418872 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:44:22.418872 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:44:22.418872 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:44:22.418872 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:44:22.418872 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:44:22.419996 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:44:22.419996 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:44:22.419996 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:44:22.419996 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:44:22.419996 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:44:22.419996 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:44:22.419996 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:44:22.419996 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:44:22.419996 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:44:22.419996 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:44:22.419996 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:44:22.419996 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:44:22.422128 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 76/156] 10.222.0.49 () {56 vars in 1096 bytes} [Sun Aug 28 00:44:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:44:22.431339 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a6f7b0-3601-43f9-84a6-0cff663efad6 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:22.535232 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f79795f-3a4b-4784-a6c6-2f0a27f8d252 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:22.536983 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f79795f-3a4b-4784-a6c6-2f0a27f8d252 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:22.546303 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a6f7b0-3601-43f9-84a6-0cff663efad6 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:22.585301 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e704457-45c0-46a4-8acb-4152ac189e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:22.586223 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e704457-45c0-46a4-8acb-4152ac189e0c None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:22.586670 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e704457-45c0-46a4-8acb-4152ac189e0c None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:22.587107 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e704457-45c0-46a4-8acb-4152ac189e0c None admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:22.587998 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e704457-45c0-46a4-8acb-4152ac189e0c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:22.588494 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e704457-45c0-46a4-8acb-4152ac189e0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:22.590219 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e704457-45c0-46a4-8acb-4152ac189e0c None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:22.598376 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:22.602149 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 77/157] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 28 00:44:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:44:22.603596 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829692d-9066-4e84-92ed-f4d548e51d90 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:22.603973 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829692d-9066-4e84-92ed-f4d548e51d90 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:22.604351 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829692d-9066-4e84-92ed-f4d548e51d90 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:22.606203 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 78/158] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:44:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:44:22.612145 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880d015-e00a-4aeb-b0fa-b4e212368bd9 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:22.612417 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880d015-e00a-4aeb-b0fa-b4e212368bd9 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:22.612688 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880d015-e00a-4aeb-b0fa-b4e212368bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:22.637706 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-5880d015-e00a-4aeb-b0fa-b4e212368bd9 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:44:22.638947 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-5880d015-e00a-4aeb-b0fa-b4e212368bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:44:22.667320 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:22.681925 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 81/159] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 28 00:44:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:44:22.683332 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f79795f-3a4b-4784-a6c6-2f0a27f8d252 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:22.806290 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f79795f-3a4b-4784-a6c6-2f0a27f8d252 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:22.847073 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9762fb71-2451-459e-82da-fe283b1f966c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:22.847804 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762fb71-2451-459e-82da-fe283b1f966c None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:22.848081 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762fb71-2451-459e-82da-fe283b1f966c None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:22.848350 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762fb71-2451-459e-82da-fe283b1f966c None admin] PATH_INFO: `/v3/users/8474eba1fd11486db87ca8aa2a114668` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:22.849499 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9762fb71-2451-459e-82da-fe283b1f966c None admin] RBAC: Authorizing `identity:get_user(user_id=8474eba1fd11486db87ca8aa2a114668)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:22.850947 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9762fb71-2451-459e-82da-fe283b1f966c None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:22.852849 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 82/160] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 28 00:44:22 2022] GET /identity/v3/users/8474eba1fd11486db87ca8aa2a114668 => generated 247 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:22.853783 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9762fb71-2451-459e-82da-fe283b1f966c None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:22.885644 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 79/161] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:44:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:44:22.887002 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5880d015-e00a-4aeb-b0fa-b4e212368bd9 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:22.930210 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:22.993201 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9762fb71-2451-459e-82da-fe283b1f966c None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:23.047961 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ff54a7-594d-4958-a037-ef0e0b0bc1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:23.048809 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff54a7-594d-4958-a037-ef0e0b0bc1e2 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:23.049088 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff54a7-594d-4958-a037-ef0e0b0bc1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:23.049359 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff54a7-594d-4958-a037-ef0e0b0bc1e2 None admin] PATH_INFO: `/v3/projects/a8086350f8e74846828edcab8c1d0577` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:23.050533 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ff54a7-594d-4958-a037-ef0e0b0bc1e2 None admin] RBAC: Authorizing `identity:get_project(project_id=a8086350f8e74846828edcab8c1d0577)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:23.052030 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ff54a7-594d-4958-a037-ef0e0b0bc1e2 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:23.054526 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 83/162] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 28 00:44:22 2022] GET /identity/v3/projects/a8086350f8e74846828edcab8c1d0577 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:23.062989 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ff54a7-594d-4958-a037-ef0e0b0bc1e2 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:23.210595 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ff54a7-594d-4958-a037-ef0e0b0bc1e2 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:23.245790 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:23.274678 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5880d015-e00a-4aeb-b0fa-b4e212368bd9 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:23.282314 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c3bfe9-b81d-4e99-be54-d72aea6b1141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:23.282934 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c3bfe9-b81d-4e99-be54-d72aea6b1141 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:23.283208 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c3bfe9-b81d-4e99-be54-d72aea6b1141 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:23.283472 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c3bfe9-b81d-4e99-be54-d72aea6b1141 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:23.284243 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c3bfe9-b81d-4e99-be54-d72aea6b1141 None admin] RBAC: Adding query filter params (role.id=7ac2391cc85a4d138e95e27cd0d09b26, scope.project.id=a8086350f8e74846828edcab8c1d0577, user.id=06cf6d63014b475ca19007466ceb7bb7) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:23.284546 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c3bfe9-b81d-4e99-be54-d72aea6b1141 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:23.286011 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c3bfe9-b81d-4e99-be54-d72aea6b1141 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:23.298729 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 84/163] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 28 00:44:23 2022] GET /identity/v3/role_assignments?user.id=06cf6d63014b475ca19007466ceb7bb7&scope.project.id=a8086350f8e74846828edcab8c1d0577&role.id=7ac2391cc85a4d138e95e27cd0d09b26 => generated 608 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:23.334106 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c3bfe9-b81d-4e99-be54-d72aea6b1141 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:23.339069 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:23.353432 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44dfc7-014d-421c-a59c-292ac38f74c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:23.354078 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44dfc7-014d-421c-a59c-292ac38f74c5 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:23.354358 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44dfc7-014d-421c-a59c-292ac38f74c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:23.354629 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44dfc7-014d-421c-a59c-292ac38f74c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:23.495557 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de44dfc7-014d-421c-a59c-292ac38f74c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:23.497623 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de44dfc7-014d-421c-a59c-292ac38f74c5 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:23.588273 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c3bfe9-b81d-4e99-be54-d72aea6b1141 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:23.665160 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae362e-e752-4850-968e-0996ab0ad2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:23.665838 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae362e-e752-4850-968e-0996ab0ad2f0 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:23.666122 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae362e-e752-4850-968e-0996ab0ad2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:23.666397 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae362e-e752-4850-968e-0996ab0ad2f0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:23.692830 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ae362e-e752-4850-968e-0996ab0ad2f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:44:23.696662 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 80/164] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 28 00:44:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 810 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:44:23.698408 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-a3ae362e-e752-4850-968e-0996ab0ad2f0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:44:23.698408 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:44:23.698408 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:44:23.698408 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:44:23.698408 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:44:23.698408 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:44:23.698408 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:44:23.698408 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:44:23.698408 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:44:23.698408 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:44:23.698408 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:44:23.698408 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:44:23.698408 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:44:23.698408 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:44:23.698408 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:44:23.698408 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:44:23.699262 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:44:23.699262 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:44:23.699262 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:44:23.699262 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:44:23.699262 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:44:23.699262 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:44:23.699262 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:44:23.699262 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:44:23.699262 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:44:23.699262 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:44:23.699262 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:44:23.699262 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:44:23.699262 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:44:23.699262 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:44:23.699262 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:44:23.699262 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:44:23.700370 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:44:23.700370 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:44:23.700370 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:44:23.700370 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:44:23.700370 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:44:23.700370 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:44:23.700370 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:44:23.700370 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:44:23.700370 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:44:23.700370 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:44:23.700370 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:44:23.700370 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:44:23.700370 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 85/165] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 28 00:44:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:44:23.705873 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44dfc7-014d-421c-a59c-292ac38f74c5 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:23.711567 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae362e-e752-4850-968e-0996ab0ad2f0 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:23.789121 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:23.873090 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:23.947150 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44dfc7-014d-421c-a59c-292ac38f74c5 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:23.969068 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae362e-e752-4850-968e-0996ab0ad2f0 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:24.019495 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d57b7e5-4f6f-4da3-b5e2-a864dca21c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:24.020149 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57b7e5-4f6f-4da3-b5e2-a864dca21c71 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:24.020480 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57b7e5-4f6f-4da3-b5e2-a864dca21c71 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:24.020750 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d57b7e5-4f6f-4da3-b5e2-a864dca21c71 None admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:24.021880 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d57b7e5-4f6f-4da3-b5e2-a864dca21c71 None admin] RBAC: Adding query filter params (name=member) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:24.022188 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d57b7e5-4f6f-4da3-b5e2-a864dca21c71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:24.023752 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d57b7e5-4f6f-4da3-b5e2-a864dca21c71 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:24.033469 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c8fd0-bc34-45c6-a06b-31bc0af54eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:24.034490 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c8fd0-bc34-45c6-a06b-31bc0af54eb0 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:24.034964 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c8fd0-bc34-45c6-a06b-31bc0af54eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:24.035426 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c8fd0-bc34-45c6-a06b-31bc0af54eb0 None admin] PATH_INFO: `/v3/projects/a8086350f8e74846828edcab8c1d0577` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:24.036849 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020c8fd0-bc34-45c6-a06b-31bc0af54eb0 None admin] RBAC: Authorizing `identity:get_project(project_id=a8086350f8e74846828edcab8c1d0577)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:24.037540 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 86/166] 10.222.0.49 () {56 vars in 1101 bytes} [Sun Aug 28 00:44:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:24.038802 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020c8fd0-bc34-45c6-a06b-31bc0af54eb0 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:24.040777 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 81/167] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 28 00:44:23 2022] GET /identity/v3/projects/a8086350f8e74846828edcab8c1d0577 => generated 298 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:24.046708 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c8fd0-bc34-45c6-a06b-31bc0af54eb0 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:24.046859 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d57b7e5-4f6f-4da3-b5e2-a864dca21c71 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:24.162139 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d57b7e5-4f6f-4da3-b5e2-a864dca21c71 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:24.178433 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:24.204292 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a133f0-4db6-4c8c-8622-caa97e3be486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:24.204933 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a133f0-4db6-4c8c-8622-caa97e3be486 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:24.205515 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a133f0-4db6-4c8c-8622-caa97e3be486 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:24.205799 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a133f0-4db6-4c8c-8622-caa97e3be486 None admin] PATH_INFO: `/v3/users/06cf6d63014b475ca19007466ceb7bb7` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:24.206066 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:24.206935 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a133f0-4db6-4c8c-8622-caa97e3be486 None admin] RBAC: Authorizing `identity:get_user(user_id=06cf6d63014b475ca19007466ceb7bb7)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:24.211339 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a133f0-4db6-4c8c-8622-caa97e3be486 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:24.211339 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 87/168] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 28 00:44:24 2022] GET /identity/v3/users/06cf6d63014b475ca19007466ceb7bb7 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:24.212142 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d43022-7da1-45d0-b593-04b7fbbff989 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:24.212269 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d43022-7da1-45d0-b593-04b7fbbff989 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:24.212693 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d43022-7da1-45d0-b593-04b7fbbff989 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:24.214074 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 88/169] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:44:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:44:24.221318 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431ffa8-7058-492c-a351-1da26bf2d671 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:24.222419 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431ffa8-7058-492c-a351-1da26bf2d671 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:24.222698 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431ffa8-7058-492c-a351-1da26bf2d671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:24.226724 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c8fd0-bc34-45c6-a06b-31bc0af54eb0 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:24.258752 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-4431ffa8-7058-492c-a351-1da26bf2d671 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:44:24.259989 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-4431ffa8-7058-492c-a351-1da26bf2d671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:44:24.290321 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb0992c-05fe-4a45-9887-52e6fded8ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:24.291013 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0992c-05fe-4a45-9887-52e6fded8ddb None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:24.291284 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0992c-05fe-4a45-9887-52e6fded8ddb None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:24.291518 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0992c-05fe-4a45-9887-52e6fded8ddb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:24.292249 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb0992c-05fe-4a45-9887-52e6fded8ddb None admin] RBAC: Adding query filter params (role.id=2e4889bb71f9434392c0baba59f2534e, scope.project.id=a8086350f8e74846828edcab8c1d0577, user.id=8474eba1fd11486db87ca8aa2a114668) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:24.292560 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb0992c-05fe-4a45-9887-52e6fded8ddb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:24.294318 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb0992c-05fe-4a45-9887-52e6fded8ddb None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:24.309704 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 82/170] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 28 00:44:24 2022] GET /identity/v3/role_assignments?user.id=8474eba1fd11486db87ca8aa2a114668&scope.project.id=a8086350f8e74846828edcab8c1d0577&role.id=2e4889bb71f9434392c0baba59f2534e => generated 608 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:24.310387 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb0992c-05fe-4a45-9887-52e6fded8ddb None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:24.387817 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 89/171] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:44:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:44:24.496084 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb0992c-05fe-4a45-9887-52e6fded8ddb None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:24.543576 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64080c71-2cd2-4826-a5e0-7a951e45887b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:24.544585 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64080c71-2cd2-4826-a5e0-7a951e45887b None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:24.545267 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64080c71-2cd2-4826-a5e0-7a951e45887b None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:24.545737 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64080c71-2cd2-4826-a5e0-7a951e45887b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:24.584145 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:24.628504 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64080c71-2cd2-4826-a5e0-7a951e45887b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:24.630091 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64080c71-2cd2-4826-a5e0-7a951e45887b None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:24.753962 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 83/172] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 28 00:44:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:44:24.760020 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4431ffa8-7058-492c-a351-1da26bf2d671 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:24.864096 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d67ff7-24f7-4bf7-ad0d-0e4d8e13be2d None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:24.864273 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d67ff7-24f7-4bf7-ad0d-0e4d8e13be2d None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:24.864546 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d67ff7-24f7-4bf7-ad0d-0e4d8e13be2d None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:24.865914 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 84/173] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:44:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:44:24.871857 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397b6ff-e8a7-4800-a26e-a067f9d785cd None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:24.872209 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397b6ff-e8a7-4800-a26e-a067f9d785cd None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:24.872485 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6397b6ff-e8a7-4800-a26e-a067f9d785cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:24.891907 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4431ffa8-7058-492c-a351-1da26bf2d671 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:24.906421 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-6397b6ff-e8a7-4800-a26e-a067f9d785cd None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:44:24.907603 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-6397b6ff-e8a7-4800-a26e-a067f9d785cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:44:24.920026 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:24.954627 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0db0ec5-b8f4-4eb4-a521-18cf76e0a851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:24.955581 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db0ec5-b8f4-4eb4-a521-18cf76e0a851 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:24.955887 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db0ec5-b8f4-4eb4-a521-18cf76e0a851 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:24.956155 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db0ec5-b8f4-4eb4-a521-18cf76e0a851 None admin] PATH_INFO: `/v3/projects/5ff0ec6683c249d1963fb7c6a4a51ed9` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:24.958170 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0db0ec5-b8f4-4eb4-a521-18cf76e0a851 None admin] RBAC: Authorizing `identity:get_project(project_id=5ff0ec6683c249d1963fb7c6a4a51ed9)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:24.959631 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0db0ec5-b8f4-4eb4-a521-18cf76e0a851 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:24.961293 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 90/174] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 28 00:44:24 2022] GET /identity/v3/projects/5ff0ec6683c249d1963fb7c6a4a51ed9 => generated 312 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:24.962513 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a2422-d5b2-4b84-83af-945fb1d5798f None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:24.962786 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a2422-d5b2-4b84-83af-945fb1d5798f None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:24.963053 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a2422-d5b2-4b84-83af-945fb1d5798f None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:24.967690 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 91/175] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:44:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:44:24.967997 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a2422-d5b2-4b84-83af-945fb1d5798f None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:24.996660 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:25.022392 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 85/176] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:44:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:44:25.024122 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e15204-ba3c-4d95-aed6-c54630444438 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:25.024694 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e15204-ba3c-4d95-aed6-c54630444438 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:25.025217 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e15204-ba3c-4d95-aed6-c54630444438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:25.074880 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-07e15204-ba3c-4d95-aed6-c54630444438 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:44:25.076181 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-07e15204-ba3c-4d95-aed6-c54630444438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:44:25.103895 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a2422-d5b2-4b84-83af-945fb1d5798f None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:25.145070 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5057dad-5c6b-4dc1-bb08-7fdb93e60a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:25.146030 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5057dad-5c6b-4dc1-bb08-7fdb93e60a98 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:25.146318 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5057dad-5c6b-4dc1-bb08-7fdb93e60a98 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:25.146590 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5057dad-5c6b-4dc1-bb08-7fdb93e60a98 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:25.162554 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5057dad-5c6b-4dc1-bb08-7fdb93e60a98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:44:25.167439 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-f5057dad-5c6b-4dc1-bb08-7fdb93e60a98 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:44:25.167439 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:44:25.167439 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:44:25.167439 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:44:25.167439 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:44:25.167439 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:44:25.167439 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:44:25.167439 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:44:25.167439 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:44:25.167439 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:44:25.167439 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:44:25.167439 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:44:25.167439 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:44:25.167439 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:44:25.167439 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:44:25.167439 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:44:25.168603 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:44:25.168603 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:44:25.168603 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:44:25.168603 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:44:25.168603 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:44:25.168603 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:44:25.168603 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:44:25.168603 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:44:25.168603 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:44:25.168603 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:44:25.168603 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:44:25.168603 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:44:25.168603 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:44:25.168603 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:44:25.168603 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:44:25.168603 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:44:25.169436 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:44:25.169436 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:44:25.169436 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:44:25.169436 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:44:25.169436 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:44:25.169436 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:44:25.169436 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:44:25.169436 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:44:25.169436 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:44:25.169436 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:44:25.169436 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:44:25.169436 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:44:25.169436 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 92/177] 10.222.0.49 () {56 vars in 1114 bytes} [Sun Aug 28 00:44:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:44:25.170145 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5057dad-5c6b-4dc1-bb08-7fdb93e60a98 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:25.219259 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:25.265099 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 86/178] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:44:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:44:25.268976 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e15204-ba3c-4d95-aed6-c54630444438 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:25.294283 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5057dad-5c6b-4dc1-bb08-7fdb93e60a98 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:25.331247 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa431ef6-3550-4151-ae2c-1070033f0ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:25.331916 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa431ef6-3550-4151-ae2c-1070033f0ce9 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:25.332200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa431ef6-3550-4151-ae2c-1070033f0ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:25.332471 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa431ef6-3550-4151-ae2c-1070033f0ce9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:25.333565 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa431ef6-3550-4151-ae2c-1070033f0ce9 None admin] RBAC: Adding query filter params (role.id=7ac2391cc85a4d138e95e27cd0d09b26, scope.project.id=5ff0ec6683c249d1963fb7c6a4a51ed9, user.id=06cf6d63014b475ca19007466ceb7bb7) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:25.333879 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa431ef6-3550-4151-ae2c-1070033f0ce9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:25.335606 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa431ef6-3550-4151-ae2c-1070033f0ce9 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:25.343038 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 93/179] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 28 00:44:25 2022] GET /identity/v3/role_assignments?user.id=06cf6d63014b475ca19007466ceb7bb7&scope.project.id=5ff0ec6683c249d1963fb7c6a4a51ed9&role.id=7ac2391cc85a4d138e95e27cd0d09b26 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:25.343908 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa431ef6-3550-4151-ae2c-1070033f0ce9 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:25.502843 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e15204-ba3c-4d95-aed6-c54630444438 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:25.507759 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa431ef6-3550-4151-ae2c-1070033f0ce9 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:25.510276 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:25.545833 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0346808-9c3a-405a-93f6-3c0356e08a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:25.547732 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0346808-9c3a-405a-93f6-3c0356e08a78 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:25.548011 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0346808-9c3a-405a-93f6-3c0356e08a78 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:25.548278 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0346808-9c3a-405a-93f6-3c0356e08a78 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:25.557062 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:25.577930 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0346808-9c3a-405a-93f6-3c0356e08a78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:44:25.583971 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-c0346808-9c3a-405a-93f6-3c0356e08a78 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:44:25.583971 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:44:25.583971 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:44:25.583971 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:44:25.583971 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:44:25.583971 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:44:25.583971 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:44:25.583971 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:44:25.583971 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:44:25.583971 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:44:25.583971 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:44:25.583971 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:44:25.583971 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:44:25.583971 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:44:25.583971 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:44:25.583971 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:44:25.584920 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:44:25.584920 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:44:25.584920 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:44:25.584920 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:44:25.584920 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:44:25.584920 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:44:25.584920 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:44:25.584920 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:44:25.584920 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:44:25.584920 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:44:25.584920 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:44:25.584920 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:44:25.584920 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:44:25.584920 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:44:25.584920 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:44:25.584920 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:44:25.585692 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:44:25.585692 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:44:25.585692 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:44:25.585692 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:44:25.585692 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:44:25.585692 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:44:25.585692 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:44:25.585692 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:44:25.585692 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:44:25.585692 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:44:25.585692 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:44:25.585692 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:44:25.585692 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 94/180] 10.222.0.49 () {56 vars in 1096 bytes} [Sun Aug 28 00:44:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:44:25.591133 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ae0b1-e24c-44a4-93cc-c73d844c2e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:25.591813 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ae0b1-e24c-44a4-93cc-c73d844c2e87 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:25.592097 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ae0b1-e24c-44a4-93cc-c73d844c2e87 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:25.592367 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ae0b1-e24c-44a4-93cc-c73d844c2e87 None admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:25.593065 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ae0b1-e24c-44a4-93cc-c73d844c2e87 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:25.593366 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ae0b1-e24c-44a4-93cc-c73d844c2e87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:25.594525 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0346808-9c3a-405a-93f6-3c0356e08a78 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:25.596235 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ae0b1-e24c-44a4-93cc-c73d844c2e87 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:25.614935 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 87/181] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 28 00:44:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:25.624153 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ae0b1-e24c-44a4-93cc-c73d844c2e87 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:25.737693 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0346808-9c3a-405a-93f6-3c0356e08a78 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:25.779458 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b123a224-17a6-43cc-8893-2b6c559dd27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:25.780871 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123a224-17a6-43cc-8893-2b6c559dd27e None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:25.781367 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123a224-17a6-43cc-8893-2b6c559dd27e None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:25.781813 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ae0b1-e24c-44a4-93cc-c73d844c2e87 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:25.782048 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123a224-17a6-43cc-8893-2b6c559dd27e None admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:25.782930 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b123a224-17a6-43cc-8893-2b6c559dd27e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:25.783437 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b123a224-17a6-43cc-8893-2b6c559dd27e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:25.785063 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b123a224-17a6-43cc-8893-2b6c559dd27e None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:25.795604 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 95/182] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 28 00:44:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:25.796772 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b123a224-17a6-43cc-8893-2b6c559dd27e None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:25.818922 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf321994-f219-4838-bf3d-533195326381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:25.819562 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf321994-f219-4838-bf3d-533195326381 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:25.819879 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf321994-f219-4838-bf3d-533195326381 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:25.820146 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf321994-f219-4838-bf3d-533195326381 None admin] PATH_INFO: `/v3/users/06cf6d63014b475ca19007466ceb7bb7` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:25.821302 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf321994-f219-4838-bf3d-533195326381 None admin] RBAC: Authorizing `identity:get_user(user_id=06cf6d63014b475ca19007466ceb7bb7)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:25.823015 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf321994-f219-4838-bf3d-533195326381 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:25.829086 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 88/183] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 28 00:44:25 2022] GET /identity/v3/users/06cf6d63014b475ca19007466ceb7bb7 => generated 275 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:44:25.829086 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf321994-f219-4838-bf3d-533195326381 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:25.832199 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:25.882774 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:25.915469 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b123a224-17a6-43cc-8893-2b6c559dd27e None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:25.939241 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf321994-f219-4838-bf3d-533195326381 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:25.950235 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb8d8c9-5e59-4b71-ab6d-3fd82f94ce04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:25.951194 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb8d8c9-5e59-4b71-ab6d-3fd82f94ce04 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:25.951601 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb8d8c9-5e59-4b71-ab6d-3fd82f94ce04 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:25.951935 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb8d8c9-5e59-4b71-ab6d-3fd82f94ce04 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:25.963081 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb8d8c9-5e59-4b71-ab6d-3fd82f94ce04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:44:25.968565 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-ffb8d8c9-5e59-4b71-ab6d-3fd82f94ce04 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 00:44:25.968565 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:44:25.968565 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:44:25.968565 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:44:25.968565 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:44:25.968565 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:44:25.968565 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:44:25.968565 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:44:25.968565 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:44:25.968565 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:44:25.968565 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:44:25.968565 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:44:25.968565 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:44:25.968565 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:44:25.968565 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:44:25.968565 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:44:25.969601 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:44:25.969601 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:44:25.969601 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:44:25.969601 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:44:25.969601 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:44:25.969601 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:44:25.969601 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:44:25.969601 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:44:25.969601 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:44:25.969601 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:44:25.969601 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:44:25.969601 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:44:25.969601 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:44:25.969601 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:44:25.969601 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:44:25.969601 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:44:25.970410 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:44:25.970410 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:44:25.970410 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:44:25.970410 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:44:25.970410 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:44:25.970410 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:44:25.970410 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:44:25.970410 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:44:25.970410 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:44:25.970410 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:44:25.970410 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 00:44:25.970410 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:44:25.970410 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 96/184] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 28 00:44:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:44:25.971066 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb8d8c9-5e59-4b71-ab6d-3fd82f94ce04 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:25.981986 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65def8fe-7079-4b40-a374-c8709d31d3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:25.982654 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65def8fe-7079-4b40-a374-c8709d31d3ac None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:25.982989 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65def8fe-7079-4b40-a374-c8709d31d3ac None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:25.983264 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65def8fe-7079-4b40-a374-c8709d31d3ac None admin] PATH_INFO: `/v3/users/e5a7f5ec7c1a4fcea14bc3db525ee17b` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:25.998072 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65def8fe-7079-4b40-a374-c8709d31d3ac None admin] RBAC: Authorizing `identity:get_user(user_id=e5a7f5ec7c1a4fcea14bc3db525ee17b)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:25.999754 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65def8fe-7079-4b40-a374-c8709d31d3ac None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:26.006297 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 89/185] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 28 00:44:25 2022] GET /identity/v3/users/e5a7f5ec7c1a4fcea14bc3db525ee17b => generated 283 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:26.006297 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb169e-6e76-42f1-9047-390c71a2c076 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:26.006297 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb169e-6e76-42f1-9047-390c71a2c076 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:26.006297 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fb169e-6e76-42f1-9047-390c71a2c076 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:26.006297 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 90/186] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:44:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:44:26.006297 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fb169e-6e76-42f1-9047-390c71a2c076 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:26.062598 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:26.078251 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb8d8c9-5e59-4b71-ab6d-3fd82f94ce04 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:26.111687 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7734fd-101b-4a72-8866-b3c777fdf81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:26.112269 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7734fd-101b-4a72-8866-b3c777fdf81d None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:26.112599 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7734fd-101b-4a72-8866-b3c777fdf81d None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:26.112824 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7734fd-101b-4a72-8866-b3c777fdf81d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:26.117388 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fb169e-6e76-42f1-9047-390c71a2c076 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:26.127482 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:26.153516 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7c48b-9e74-4866-8fa4-7a8242d3a0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:26.154222 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7c48b-9e74-4866-8fa4-7a8242d3a0c9 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:26.154523 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7c48b-9e74-4866-8fa4-7a8242d3a0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:26.154799 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7c48b-9e74-4866-8fa4-7a8242d3a0c9 None admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:26.155526 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb7c48b-9e74-4866-8fa4-7a8242d3a0c9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:26.155853 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb7c48b-9e74-4866-8fa4-7a8242d3a0c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:26.157235 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb7c48b-9e74-4866-8fa4-7a8242d3a0c9 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:26.165818 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 91/187] 10.222.0.49 () {56 vars in 1101 bytes} [Sun Aug 28 00:44:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:26.167077 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c3401-e4b6-47a4-a4ad-6f69c0383e0b None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:26.167362 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c3401-e4b6-47a4-a4ad-6f69c0383e0b None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:26.167628 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c3401-e4b6-47a4-a4ad-6f69c0383e0b None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:26.169025 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 92/188] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:44:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:44:26.169597 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c3401-e4b6-47a4-a4ad-6f69c0383e0b None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:26.193195 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7734fd-101b-4a72-8866-b3c777fdf81d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:26.194697 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7734fd-101b-4a72-8866-b3c777fdf81d None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:26.274248 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c3401-e4b6-47a4-a4ad-6f69c0383e0b None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:26.283317 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:26.301492 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 97/189] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 28 00:44:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:44:26.307396 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7d61c-5aaf-40a1-91b2-139053b67508 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:26.307691 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7d61c-5aaf-40a1-91b2-139053b67508 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:26.307970 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7d61c-5aaf-40a1-91b2-139053b67508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:26.310048 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23803397-9bf2-4b00-9cbc-eaec94534830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:26.310664 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23803397-9bf2-4b00-9cbc-eaec94534830 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:26.310940 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23803397-9bf2-4b00-9cbc-eaec94534830 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:26.311209 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23803397-9bf2-4b00-9cbc-eaec94534830 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:26.326574 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-88b7d61c-5aaf-40a1-91b2-139053b67508 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:44:26.327733 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-88b7d61c-5aaf-40a1-91b2-139053b67508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:44:26.350778 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:26.381527 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23803397-9bf2-4b00-9cbc-eaec94534830 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:26.383072 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23803397-9bf2-4b00-9cbc-eaec94534830 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:26.394878 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 98/190] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:44:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:44:26.395758 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b7d61c-5aaf-40a1-91b2-139053b67508 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:26.515544 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 93/191] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 28 00:44:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:44:26.519693 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b7d61c-5aaf-40a1-91b2-139053b67508 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:26.521379 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a7a7ef-bba3-4377-ba32-d291be88902a None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:26.521667 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a7a7ef-bba3-4377-ba32-d291be88902a None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:26.521938 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a7a7ef-bba3-4377-ba32-d291be88902a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:26.535892 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:26.540337 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-84a7a7ef-bba3-4377-ba32-d291be88902a None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:44:26.541536 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-84a7a7ef-bba3-4377-ba32-d291be88902a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:44:26.559864 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9efc4ec-06c5-4d61-8e59-8c1e6c669efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:26.560511 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9efc4ec-06c5-4d61-8e59-8c1e6c669efb None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:26.560791 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9efc4ec-06c5-4d61-8e59-8c1e6c669efb None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:26.561070 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9efc4ec-06c5-4d61-8e59-8c1e6c669efb None admin] PATH_INFO: `/v3/users/e7e2c36eb6ee4f8d8467526f55d6d424` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:26.562627 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9efc4ec-06c5-4d61-8e59-8c1e6c669efb None admin] RBAC: Authorizing `identity:get_user(user_id=e7e2c36eb6ee4f8d8467526f55d6d424)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:26.564148 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9efc4ec-06c5-4d61-8e59-8c1e6c669efb None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:26.570333 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 99/192] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 28 00:44:26 2022] GET /identity/v3/users/e7e2c36eb6ee4f8d8467526f55d6d424 => generated 289 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:26.570333 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9efc4ec-06c5-4d61-8e59-8c1e6c669efb None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:26.611823 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:26.618609 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 94/193] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:44:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:44:26.619594 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a7a7ef-bba3-4377-ba32-d291be88902a None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:26.690685 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9efc4ec-06c5-4d61-8e59-8c1e6c669efb None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:26.732178 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122363dd-d78e-4982-9e60-7351503e7608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:26.732822 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122363dd-d78e-4982-9e60-7351503e7608 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:26.733101 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122363dd-d78e-4982-9e60-7351503e7608 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:26.733365 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122363dd-d78e-4982-9e60-7351503e7608 None admin] PATH_INFO: `/v3/projects/a8086350f8e74846828edcab8c1d0577` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:26.734526 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122363dd-d78e-4982-9e60-7351503e7608 None admin] RBAC: Authorizing `identity:get_project(project_id=a8086350f8e74846828edcab8c1d0577)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:26.735966 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122363dd-d78e-4982-9e60-7351503e7608 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:26.737612 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 100/194] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 28 00:44:26 2022] GET /identity/v3/projects/a8086350f8e74846828edcab8c1d0577 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:26.739877 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a7a7ef-bba3-4377-ba32-d291be88902a None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:26.743241 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122363dd-d78e-4982-9e60-7351503e7608 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:26.778022 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095171a9-32e9-4921-8008-277f9635236c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:26.778663 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095171a9-32e9-4921-8008-277f9635236c None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:26.778963 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095171a9-32e9-4921-8008-277f9635236c None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:26.779208 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095171a9-32e9-4921-8008-277f9635236c None admin] PATH_INFO: `/v3/projects/8dc5332abd014a54adc53ca64239c322` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:26.780487 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095171a9-32e9-4921-8008-277f9635236c None admin] RBAC: Authorizing `identity:get_project(project_id=8dc5332abd014a54adc53ca64239c322)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:26.781977 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095171a9-32e9-4921-8008-277f9635236c None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:26.788777 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 95/195] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 28 00:44:26 2022] GET /identity/v3/projects/8dc5332abd014a54adc53ca64239c322 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:26.788777 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095171a9-32e9-4921-8008-277f9635236c None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:26.801697 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:26.859607 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122363dd-d78e-4982-9e60-7351503e7608 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:26.865131 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:26.896585 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f7f25-0bae-4850-afaf-aeea9856509f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:26.897201 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f7f25-0bae-4850-afaf-aeea9856509f None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:26.897477 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f7f25-0bae-4850-afaf-aeea9856509f None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:26.897747 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f7f25-0bae-4850-afaf-aeea9856509f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:26.903085 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095171a9-32e9-4921-8008-277f9635236c None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:26.938796 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d7e84-7a2e-4559-909b-7f446ce34313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:26.939457 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d7e84-7a2e-4559-909b-7f446ce34313 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:26.939771 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d7e84-7a2e-4559-909b-7f446ce34313 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:26.940046 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d7e84-7a2e-4559-909b-7f446ce34313 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:26.941285 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20d7e84-7a2e-4559-909b-7f446ce34313 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:26.942769 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20d7e84-7a2e-4559-909b-7f446ce34313 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:26.944501 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 96/196] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:44:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:26.945316 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d7e84-7a2e-4559-909b-7f446ce34313 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:26.974751 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962f7f25-0bae-4850-afaf-aeea9856509f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:26.976278 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962f7f25-0bae-4850-afaf-aeea9856509f None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:27.026089 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:27.048745 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d7e84-7a2e-4559-909b-7f446ce34313 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:27.076586 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 101/197] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 28 00:44:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:44:27.077445 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f7f25-0bae-4850-afaf-aeea9856509f None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:27.085575 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05051a03-6c18-411a-a37e-e2a75cfc0894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:27.086193 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05051a03-6c18-411a-a37e-e2a75cfc0894 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:27.086470 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05051a03-6c18-411a-a37e-e2a75cfc0894 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:27.086741 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05051a03-6c18-411a-a37e-e2a75cfc0894 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:27.087479 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05051a03-6c18-411a-a37e-e2a75cfc0894 None admin] RBAC: Adding query filter params (role.id=5bcf10de71e7404aaef4d7878053be82, scope.project.id=a8086350f8e74846828edcab8c1d0577, user.id=06cf6d63014b475ca19007466ceb7bb7) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:27.087833 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05051a03-6c18-411a-a37e-e2a75cfc0894 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:27.089292 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05051a03-6c18-411a-a37e-e2a75cfc0894 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:27.092407 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:27.107698 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 97/198] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 28 00:44:26 2022] GET /identity/v3/role_assignments?user.id=06cf6d63014b475ca19007466ceb7bb7&scope.project.id=a8086350f8e74846828edcab8c1d0577&role.id=5bcf10de71e7404aaef4d7878053be82 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:27.107698 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05051a03-6c18-411a-a37e-e2a75cfc0894 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:27.194549 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f7f25-0bae-4850-afaf-aeea9856509f None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:27.217922 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05051a03-6c18-411a-a37e-e2a75cfc0894 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:27.234514 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2667ec8b-a1f2-4aba-9959-c96f47888279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:27.235143 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667ec8b-a1f2-4aba-9959-c96f47888279 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:27.235422 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667ec8b-a1f2-4aba-9959-c96f47888279 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:27.235720 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667ec8b-a1f2-4aba-9959-c96f47888279 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:27.236474 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2667ec8b-a1f2-4aba-9959-c96f47888279 None admin] RBAC: Adding query filter params (role.id=2e4889bb71f9434392c0baba59f2534e, scope.project.id=8dc5332abd014a54adc53ca64239c322, user.id=e5a7f5ec7c1a4fcea14bc3db525ee17b) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:27.236783 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2667ec8b-a1f2-4aba-9959-c96f47888279 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:27.238239 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2667ec8b-a1f2-4aba-9959-c96f47888279 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:27.251733 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 102/199] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 28 00:44:27 2022] GET /identity/v3/role_assignments?user.id=e5a7f5ec7c1a4fcea14bc3db525ee17b&scope.project.id=8dc5332abd014a54adc53ca64239c322&role.id=2e4889bb71f9434392c0baba59f2534e => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:27.251733 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2667ec8b-a1f2-4aba-9959-c96f47888279 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:27.265941 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dbe069-2ec3-497b-9383-82696c25c953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:27.266602 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dbe069-2ec3-497b-9383-82696c25c953 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:27.266909 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dbe069-2ec3-497b-9383-82696c25c953 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:27.267267 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dbe069-2ec3-497b-9383-82696c25c953 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:27.275044 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:27.284450 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dbe069-2ec3-497b-9383-82696c25c953 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:44:27.290975 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-b7dbe069-2ec3-497b-9383-82696c25c953 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:44:27.290975 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:44:27.290975 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:44:27.290975 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:44:27.290975 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:44:27.290975 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:44:27.290975 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:44:27.290975 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:44:27.290975 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:44:27.290975 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:44:27.290975 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:44:27.290975 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:44:27.290975 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:44:27.290975 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:44:27.290975 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:44:27.290975 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:44:27.291976 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:44:27.291976 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:44:27.291976 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:44:27.291976 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:44:27.291976 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:44:27.291976 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:44:27.291976 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:44:27.291976 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:44:27.291976 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:44:27.291976 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:44:27.291976 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:44:27.291976 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:44:27.291976 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:44:27.291976 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:44:27.291976 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:44:27.291976 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:44:27.292770 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:44:27.292770 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:44:27.292770 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:44:27.292770 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:44:27.292770 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:44:27.292770 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:44:27.292770 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:44:27.292770 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:44:27.292770 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:44:27.292770 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:44:27.292770 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:44:27.292770 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:44:27.292770 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 98/200] 10.222.0.49 () {56 vars in 1114 bytes} [Sun Aug 28 00:44:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:44:27.293515 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dbe069-2ec3-497b-9383-82696c25c953 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:27.378013 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:27.391281 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2667ec8b-a1f2-4aba-9959-c96f47888279 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:27.423252 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dbe069-2ec3-497b-9383-82696c25c953 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:27.427801 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb7f32-c70e-4f7a-9650-ae18565e99bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:27.428473 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb7f32-c70e-4f7a-9650-ae18565e99bc None admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:27.428809 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb7f32-c70e-4f7a-9650-ae18565e99bc None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:27.429141 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb7f32-c70e-4f7a-9650-ae18565e99bc None admin] PATH_INFO: `/v3/users` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:27.429886 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cb7f32-c70e-4f7a-9650-ae18565e99bc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:27.431434 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cb7f32-c70e-4f7a-9650-ae18565e99bc None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:27.457803 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 103/201] 10.222.0.49 () {60 vars in 1132 bytes} [Sun Aug 28 00:44:27 2022] POST /identity/v3/users => generated 297 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:44:27.458906 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb7f32-c70e-4f7a-9650-ae18565e99bc None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:27.461730 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ee4d5-16c4-4f1a-86c8-70bb2d420d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:27.462640 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ee4d5-16c4-4f1a-86c8-70bb2d420d41 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:27.462987 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ee4d5-16c4-4f1a-86c8-70bb2d420d41 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:27.463375 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546ee4d5-16c4-4f1a-86c8-70bb2d420d41 None admin] PATH_INFO: `/v3/projects/a8086350f8e74846828edcab8c1d0577` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:27.465677 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546ee4d5-16c4-4f1a-86c8-70bb2d420d41 None admin] RBAC: Authorizing `identity:get_project(project_id=a8086350f8e74846828edcab8c1d0577)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:27.467489 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546ee4d5-16c4-4f1a-86c8-70bb2d420d41 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:27.469589 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 99/202] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 28 00:44:27 2022] GET /identity/v3/projects/a8086350f8e74846828edcab8c1d0577 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:27.476030 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ee4d5-16c4-4f1a-86c8-70bb2d420d41 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:27.567101 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:27.613129 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb7f32-c70e-4f7a-9650-ae18565e99bc None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:27.619187 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546ee4d5-16c4-4f1a-86c8-70bb2d420d41 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:27.656859 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:27.663274 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e00d03f-e3a3-4fae-b836-8751c56d1184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:27.664024 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00d03f-e3a3-4fae-b836-8751c56d1184 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:27.665026 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00d03f-e3a3-4fae-b836-8751c56d1184 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:27.665026 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e00d03f-e3a3-4fae-b836-8751c56d1184 None admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:27.665301 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e00d03f-e3a3-4fae-b836-8751c56d1184 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:27.665609 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e00d03f-e3a3-4fae-b836-8751c56d1184 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:27.667062 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e00d03f-e3a3-4fae-b836-8751c56d1184 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:27.669550 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62449d54-1383-491c-a05c-2ae4837a5d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:27.670229 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62449d54-1383-491c-a05c-2ae4837a5d60 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:27.670512 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62449d54-1383-491c-a05c-2ae4837a5d60 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:27.670785 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62449d54-1383-491c-a05c-2ae4837a5d60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:27.671542 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62449d54-1383-491c-a05c-2ae4837a5d60 None admin] RBAC: Adding query filter params (role.id=708b4012bb2645b6aa4af9606988ce56, scope.project.id=a8086350f8e74846828edcab8c1d0577, user.id=e7e2c36eb6ee4f8d8467526f55d6d424) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:27.671884 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62449d54-1383-491c-a05c-2ae4837a5d60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:27.675572 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62449d54-1383-491c-a05c-2ae4837a5d60 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:27.680062 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 104/203] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 28 00:44:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:27.681196 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 100/204] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 28 00:44:27 2022] GET /identity/v3/role_assignments?user.id=e7e2c36eb6ee4f8d8467526f55d6d424&scope.project.id=a8086350f8e74846828edcab8c1d0577&role.id=708b4012bb2645b6aa4af9606988ce56 => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:27.692866 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e00d03f-e3a3-4fae-b836-8751c56d1184 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:27.832010 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e00d03f-e3a3-4fae-b836-8751c56d1184 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:27.868859 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:27.875032 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470ca0b8-8421-4b13-9988-a90d6dc2889e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:27.875724 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ca0b8-8421-4b13-9988-a90d6dc2889e None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:27.876013 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ca0b8-8421-4b13-9988-a90d6dc2889e None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:27.876285 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ca0b8-8421-4b13-9988-a90d6dc2889e None admin] PATH_INFO: `/v3/users/e5a7f5ec7c1a4fcea14bc3db525ee17b` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:27.877830 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470ca0b8-8421-4b13-9988-a90d6dc2889e None admin] RBAC: Authorizing `identity:get_user(user_id=e5a7f5ec7c1a4fcea14bc3db525ee17b)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:27.879331 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470ca0b8-8421-4b13-9988-a90d6dc2889e None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:27.881264 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 105/205] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 28 00:44:27 2022] GET /identity/v3/users/e5a7f5ec7c1a4fcea14bc3db525ee17b => generated 283 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:27.887326 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62449d54-1383-491c-a05c-2ae4837a5d60 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:28.004411 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62449d54-1383-491c-a05c-2ae4837a5d60 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:28.048919 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0934352-5fc3-4f6b-8453-5c31e936bd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:28.050430 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0934352-5fc3-4f6b-8453-5c31e936bd6f None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:28.050918 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0934352-5fc3-4f6b-8453-5c31e936bd6f None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:28.051426 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0934352-5fc3-4f6b-8453-5c31e936bd6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:28.156084 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:28.170581 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0934352-5fc3-4f6b-8453-5c31e936bd6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:28.172124 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0934352-5fc3-4f6b-8453-5c31e936bd6f None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:28.325592 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 101/206] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 28 00:44:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:44:28.331441 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470ca0b8-8421-4b13-9988-a90d6dc2889e None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:28.522587 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470ca0b8-8421-4b13-9988-a90d6dc2889e None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:28.572419 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b60fe8-c0b3-4481-977e-45ed77ce71d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:28.573447 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b60fe8-c0b3-4481-977e-45ed77ce71d6 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:28.574341 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b60fe8-c0b3-4481-977e-45ed77ce71d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:28.575011 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b60fe8-c0b3-4481-977e-45ed77ce71d6 None admin] PATH_INFO: `/v3/projects/8dc5332abd014a54adc53ca64239c322` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:28.576322 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b60fe8-c0b3-4481-977e-45ed77ce71d6 None admin] RBAC: Authorizing `identity:get_project(project_id=8dc5332abd014a54adc53ca64239c322)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:28.577724 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b60fe8-c0b3-4481-977e-45ed77ce71d6 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:28.583724 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 106/207] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 28 00:44:28 2022] GET /identity/v3/projects/8dc5332abd014a54adc53ca64239c322 => generated 302 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:28.587722 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0934352-5fc3-4f6b-8453-5c31e936bd6f None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:28.680080 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:28.688217 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0934352-5fc3-4f6b-8453-5c31e936bd6f None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:28.724242 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b52523-02e0-4bb4-97a9-0c574b3ad21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:28.724860 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b52523-02e0-4bb4-97a9-0c574b3ad21b None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:28.725137 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b52523-02e0-4bb4-97a9-0c574b3ad21b None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:28.725402 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b52523-02e0-4bb4-97a9-0c574b3ad21b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:28.726139 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b52523-02e0-4bb4-97a9-0c574b3ad21b None admin] RBAC: Adding query filter params (role.id=5bcf10de71e7404aaef4d7878053be82, scope.project.id=8dc5332abd014a54adc53ca64239c322, user.id=e5a7f5ec7c1a4fcea14bc3db525ee17b) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:28.726440 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b52523-02e0-4bb4-97a9-0c574b3ad21b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:28.727942 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b52523-02e0-4bb4-97a9-0c574b3ad21b None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:28.739633 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 102/208] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 28 00:44:28 2022] GET /identity/v3/role_assignments?user.id=e5a7f5ec7c1a4fcea14bc3db525ee17b&scope.project.id=8dc5332abd014a54adc53ca64239c322&role.id=5bcf10de71e7404aaef4d7878053be82 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:29.293341 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956cd148-55c0-4a0e-af6f-8865942db2fe None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:29.293883 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956cd148-55c0-4a0e-af6f-8865942db2fe None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:29.293883 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956cd148-55c0-4a0e-af6f-8865942db2fe None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:29.295265 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 107/209] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:44:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:44:29.300789 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7623ff6e-7b16-4f96-893e-78e7d25d10f2 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:29.301717 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7623ff6e-7b16-4f96-893e-78e7d25d10f2 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:29.302190 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7623ff6e-7b16-4f96-893e-78e7d25d10f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:29.320796 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-7623ff6e-7b16-4f96-893e-78e7d25d10f2 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:44:29.322347 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-7623ff6e-7b16-4f96-893e-78e7d25d10f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:44:29.393789 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 103/210] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:44:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:44:29.677352 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956cd148-55c0-4a0e-af6f-8865942db2fe None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:29.724033 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f6d2c-cafb-4793-845c-1423fafd8fa9 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:29.724622 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f6d2c-cafb-4793-845c-1423fafd8fa9 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:29.725123 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171f6d2c-cafb-4793-845c-1423fafd8fa9 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:29.733127 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 104/211] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:44:29 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:44:29.738425 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ee4ba-9d37-43c5-86ab-c4c20a4587df None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:29.738733 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ee4ba-9d37-43c5-86ab-c4c20a4587df None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:29.738964 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ee4ba-9d37-43c5-86ab-c4c20a4587df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:29.757709 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-670ee4ba-9d37-43c5-86ab-c4c20a4587df None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:44:29.759238 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-670ee4ba-9d37-43c5-86ab-c4c20a4587df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:44:29.765406 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:29.805924 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956cd148-55c0-4a0e-af6f-8865942db2fe None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:29.845913 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2307f-7c61-4937-93f1-df041bfe2c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:29.846556 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2307f-7c61-4937-93f1-df041bfe2c5b None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:29.846838 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2307f-7c61-4937-93f1-df041bfe2c5b None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:29.847105 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2307f-7c61-4937-93f1-df041bfe2c5b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:29.852128 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 105/212] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:44:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:44:29.862184 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae2307f-7c61-4937-93f1-df041bfe2c5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:44:29.867547 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-cae2307f-7c61-4937-93f1-df041bfe2c5b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:44:29.867547 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:44:29.867547 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:44:29.867547 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:44:29.867547 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:44:29.867547 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:44:29.867547 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:44:29.867547 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:44:29.867547 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:44:29.867547 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:44:29.867547 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:44:29.867547 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:44:29.867547 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:44:29.867547 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:44:29.867547 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:44:29.867547 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:44:29.868439 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:44:29.868439 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:44:29.868439 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:44:29.868439 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:44:29.868439 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:44:29.868439 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:44:29.868439 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:44:29.868439 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:44:29.868439 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:44:29.868439 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:44:29.868439 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:44:29.868439 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:44:29.868439 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:44:29.868439 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:44:29.868439 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:44:29.868439 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:44:29.869259 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:44:29.869259 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:44:29.869259 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:44:29.869259 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:44:29.869259 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:44:29.869259 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:44:29.869259 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:44:29.869259 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:44:29.869259 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:44:29.869259 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:44:29.869259 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:44:29.869259 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:44:29.871607 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 108/213] 10.222.0.49 () {56 vars in 1096 bytes} [Sun Aug 28 00:44:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:44:29.884844 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ee4ba-9d37-43c5-86ab-c4c20a4587df None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:29.911070 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:29.918027 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2ebed-710c-408b-94dc-271b17c0eab6 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:29.918370 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2ebed-710c-408b-94dc-271b17c0eab6 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:29.918640 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2ebed-710c-408b-94dc-271b17c0eab6 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:29.920163 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 109/214] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:44:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:44:29.925838 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9105d63-f088-4af9-b396-fe8d6d686da1 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:29.925838 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9105d63-f088-4af9-b396-fe8d6d686da1 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:29.925838 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9105d63-f088-4af9-b396-fe8d6d686da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:29.943247 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-d9105d63-f088-4af9-b396-fe8d6d686da1 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:44:29.944798 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-d9105d63-f088-4af9-b396-fe8d6d686da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:44:29.991830 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ee4ba-9d37-43c5-86ab-c4c20a4587df None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:30.027532 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 110/215] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:44:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:44:30.037811 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda981e5-8189-42b3-bd1d-cef0aef33b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:30.038718 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda981e5-8189-42b3-bd1d-cef0aef33b0b None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:30.039181 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda981e5-8189-42b3-bd1d-cef0aef33b0b None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:30.039632 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda981e5-8189-42b3-bd1d-cef0aef33b0b None admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:30.040539 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda981e5-8189-42b3-bd1d-cef0aef33b0b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:30.041027 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda981e5-8189-42b3-bd1d-cef0aef33b0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:30.042666 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda981e5-8189-42b3-bd1d-cef0aef33b0b None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:30.052401 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 106/216] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 28 00:44:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:30.058265 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9105d63-f088-4af9-b396-fe8d6d686da1 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:30.123351 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda981e5-8189-42b3-bd1d-cef0aef33b0b None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:30.124338 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:30.176437 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9105d63-f088-4af9-b396-fe8d6d686da1 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:30.215151 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:30.219511 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1acc01d-b75e-46f1-bb05-c8c48ebc0911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:30.220183 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1acc01d-b75e-46f1-bb05-c8c48ebc0911 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:30.220457 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1acc01d-b75e-46f1-bb05-c8c48ebc0911 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:30.220889 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1acc01d-b75e-46f1-bb05-c8c48ebc0911 None admin] PATH_INFO: `/v3/users/e5a7f5ec7c1a4fcea14bc3db525ee17b` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:30.222113 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1acc01d-b75e-46f1-bb05-c8c48ebc0911 None admin] RBAC: Authorizing `identity:get_user(user_id=e5a7f5ec7c1a4fcea14bc3db525ee17b)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:30.224300 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1acc01d-b75e-46f1-bb05-c8c48ebc0911 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:30.229260 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 111/217] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 28 00:44:30 2022] GET /identity/v3/users/e5a7f5ec7c1a4fcea14bc3db525ee17b => generated 283 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:30.234959 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1acc01d-b75e-46f1-bb05-c8c48ebc0911 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:30.241035 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda981e5-8189-42b3-bd1d-cef0aef33b0b None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:30.278164 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e2e2d8-6861-42e9-82dc-01b48b08c379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:30.279270 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2e2d8-6861-42e9-82dc-01b48b08c379 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:30.279776 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2e2d8-6861-42e9-82dc-01b48b08c379 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:30.280235 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2e2d8-6861-42e9-82dc-01b48b08c379 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:30.292223 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e2e2d8-6861-42e9-82dc-01b48b08c379 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:44:30.298504 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-b5e2e2d8-6861-42e9-82dc-01b48b08c379 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:44:30.298504 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:44:30.298504 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:44:30.298504 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:44:30.298504 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:44:30.298504 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:44:30.298504 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:44:30.298504 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:44:30.298504 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:44:30.298504 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:44:30.298504 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:44:30.298504 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:44:30.298504 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:44:30.298504 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:44:30.298504 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:44:30.298504 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:44:30.299390 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:44:30.299390 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:44:30.299390 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:44:30.299390 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:44:30.299390 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:44:30.299390 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:44:30.299390 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:44:30.299390 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:44:30.299390 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:44:30.299390 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:44:30.299390 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:44:30.299390 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:44:30.299390 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:44:30.299390 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:44:30.299390 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:44:30.299390 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:44:30.300203 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:44:30.300203 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:44:30.300203 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:44:30.300203 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:44:30.300203 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:44:30.300203 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:44:30.300203 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:44:30.300203 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:44:30.300203 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:44:30.300203 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:44:30.300203 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:44:30.300203 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:44:30.302482 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 107/218] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 28 00:44:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:44:30.309401 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e2e2d8-6861-42e9-82dc-01b48b08c379 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:30.345088 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1acc01d-b75e-46f1-bb05-c8c48ebc0911 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:30.371897 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:30.383128 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d9077b-6471-4565-876e-0c7cfa167c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:30.383792 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d9077b-6471-4565-876e-0c7cfa167c45 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:30.384048 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d9077b-6471-4565-876e-0c7cfa167c45 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:30.384317 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d9077b-6471-4565-876e-0c7cfa167c45 None admin] PATH_INFO: `/v3/projects/8dc5332abd014a54adc53ca64239c322` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:30.385524 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d9077b-6471-4565-876e-0c7cfa167c45 None admin] RBAC: Authorizing `identity:get_project(project_id=8dc5332abd014a54adc53ca64239c322)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:30.387005 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d9077b-6471-4565-876e-0c7cfa167c45 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:30.393400 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 112/219] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 28 00:44:30 2022] GET /identity/v3/projects/8dc5332abd014a54adc53ca64239c322 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:30.393400 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d9077b-6471-4565-876e-0c7cfa167c45 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:30.426106 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e2e2d8-6861-42e9-82dc-01b48b08c379 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:30.465578 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05241b4-d9ff-4054-8c77-3aa170b5ea2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:30.466133 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05241b4-d9ff-4054-8c77-3aa170b5ea2a None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:30.466409 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05241b4-d9ff-4054-8c77-3aa170b5ea2a None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:30.466677 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05241b4-d9ff-4054-8c77-3aa170b5ea2a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:30.467835 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05241b4-d9ff-4054-8c77-3aa170b5ea2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:30.469419 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05241b4-d9ff-4054-8c77-3aa170b5ea2a None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:30.475718 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 108/220] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:44:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:44:30.476686 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05241b4-d9ff-4054-8c77-3aa170b5ea2a None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:30.488915 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:30.501718 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d9077b-6471-4565-876e-0c7cfa167c45 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:30.539989 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dfe403-af59-4145-9d4a-ae80012d6335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:30.540609 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dfe403-af59-4145-9d4a-ae80012d6335 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:30.540880 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dfe403-af59-4145-9d4a-ae80012d6335 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:30.541149 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dfe403-af59-4145-9d4a-ae80012d6335 None admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:30.541818 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dfe403-af59-4145-9d4a-ae80012d6335 None admin] RBAC: Adding query filter params (name=member) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:30.542114 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dfe403-af59-4145-9d4a-ae80012d6335 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:30.543656 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dfe403-af59-4145-9d4a-ae80012d6335 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:30.552967 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 113/221] 10.222.0.49 () {56 vars in 1101 bytes} [Sun Aug 28 00:44:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:30.552967 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dfe403-af59-4145-9d4a-ae80012d6335 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:30.600630 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05241b4-d9ff-4054-8c77-3aa170b5ea2a None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:30.618253 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:30.646479 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e52c56-bb18-4dd8-8336-fe29f6ac7a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:30.647170 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e52c56-bb18-4dd8-8336-fe29f6ac7a97 None admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:30.647446 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e52c56-bb18-4dd8-8336-fe29f6ac7a97 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:30.647747 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e52c56-bb18-4dd8-8336-fe29f6ac7a97 None admin] PATH_INFO: `/v3/projects/8dc5332abd014a54adc53ca64239c322/users/e5a7f5ec7c1a4fcea14bc3db525ee17b/roles/2e4889bb71f9434392c0baba59f2534e` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:30.649705 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e52c56-bb18-4dd8-8336-fe29f6ac7a97 None admin] RBAC: Authorizing `identity:create_grant(project_id=8dc5332abd014a54adc53ca64239c322, user_id=e5a7f5ec7c1a4fcea14bc3db525ee17b, role_id=2e4889bb71f9434392c0baba59f2534e)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:30.651163 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e52c56-bb18-4dd8-8336-fe29f6ac7a97 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:30.667594 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 109/222] 10.222.0.49 () {58 vars in 1439 bytes} [Sun Aug 28 00:44:30 2022] PUT /identity/v3/projects/8dc5332abd014a54adc53ca64239c322/users/e5a7f5ec7c1a4fcea14bc3db525ee17b/roles/2e4889bb71f9434392c0baba59f2534e => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:44:30.668239 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e52c56-bb18-4dd8-8336-fe29f6ac7a97 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:30.699089 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dfe403-af59-4145-9d4a-ae80012d6335 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:30.744020 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ea2be-7df7-41f8-96b8-d95017dd2c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:30.744644 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ea2be-7df7-41f8-96b8-d95017dd2c2f None admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:30.744920 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ea2be-7df7-41f8-96b8-d95017dd2c2f None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:30.745187 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ea2be-7df7-41f8-96b8-d95017dd2c2f None admin] PATH_INFO: `/v3/users` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:30.745863 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7ea2be-7df7-41f8-96b8-d95017dd2c2f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:30.747406 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7ea2be-7df7-41f8-96b8-d95017dd2c2f None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:30.750124 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:30.772794 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 114/223] 10.222.0.49 () {60 vars in 1132 bytes} [Sun Aug 28 00:44:30 2022] POST /identity/v3/users => generated 297 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:44:30.773912 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b277806-77f3-4045-b0a7-f7451c06a072 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:30.774201 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b277806-77f3-4045-b0a7-f7451c06a072 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:30.774474 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b277806-77f3-4045-b0a7-f7451c06a072 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:30.780240 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 115/224] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:44:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:44:30.781841 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c3009-524b-41e7-954f-446a1609dbe0 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:30.782130 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c3009-524b-41e7-954f-446a1609dbe0 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:30.782472 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818c3009-524b-41e7-954f-446a1609dbe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:30.804486 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-818c3009-524b-41e7-954f-446a1609dbe0 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:44:30.804486 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-818c3009-524b-41e7-954f-446a1609dbe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:44:30.819427 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e52c56-bb18-4dd8-8336-fe29f6ac7a97 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:30.869233 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bbe1f6-e7f2-4741-acb5-494b90e06377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:30.869952 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bbe1f6-e7f2-4741-acb5-494b90e06377 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:30.870232 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bbe1f6-e7f2-4741-acb5-494b90e06377 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:30.870914 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bbe1f6-e7f2-4741-acb5-494b90e06377 None admin] PATH_INFO: `/v3/users/b933e37e0ed9461ab0611be07d3e2c9e` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:30.889085 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bbe1f6-e7f2-4741-acb5-494b90e06377 None admin] RBAC: Authorizing `identity:get_user(user_id=b933e37e0ed9461ab0611be07d3e2c9e)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:30.891297 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bbe1f6-e7f2-4741-acb5-494b90e06377 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:30.893811 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 110/225] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 28 00:44:30 2022] GET /identity/v3/users/b933e37e0ed9461ab0611be07d3e2c9e => generated 297 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:30.899390 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bbe1f6-e7f2-4741-acb5-494b90e06377 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:30.902166 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 116/226] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:44:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:44:31.023836 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bbe1f6-e7f2-4741-acb5-494b90e06377 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:31.052689 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:31.066302 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf30b1b3-128a-4b6a-b6a3-a996c84960f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:31.066930 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf30b1b3-128a-4b6a-b6a3-a996c84960f9 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:31.067211 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf30b1b3-128a-4b6a-b6a3-a996c84960f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:31.067481 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf30b1b3-128a-4b6a-b6a3-a996c84960f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:31.151655 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf30b1b3-128a-4b6a-b6a3-a996c84960f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:31.153354 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf30b1b3-128a-4b6a-b6a3-a996c84960f9 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:31.184284 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c3009-524b-41e7-954f-446a1609dbe0 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:31.237248 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:31.286193 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 111/227] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 28 00:44:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:44:31.292803 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf30b1b3-128a-4b6a-b6a3-a996c84960f9 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:31.310323 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818c3009-524b-41e7-954f-446a1609dbe0 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:31.327231 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:31.352019 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18502ed-98c9-43d4-9808-212c6d63a63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:31.352679 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18502ed-98c9-43d4-9808-212c6d63a63a None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:31.352943 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18502ed-98c9-43d4-9808-212c6d63a63a None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:31.353217 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18502ed-98c9-43d4-9808-212c6d63a63a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:31.366078 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18502ed-98c9-43d4-9808-212c6d63a63a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:44:31.371405 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-f18502ed-98c9-43d4-9808-212c6d63a63a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:44:31.371405 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:44:31.371405 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:44:31.371405 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:44:31.371405 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:44:31.371405 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:44:31.371405 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:44:31.371405 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:44:31.371405 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:44:31.371405 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:44:31.371405 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:44:31.371405 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:44:31.371405 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:44:31.371405 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:44:31.371405 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:44:31.371405 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:44:31.372338 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:44:31.372338 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:44:31.372338 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:44:31.372338 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:44:31.372338 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:44:31.372338 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:44:31.372338 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:44:31.372338 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:44:31.372338 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:44:31.372338 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:44:31.372338 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:44:31.372338 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:44:31.372338 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:44:31.372338 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:44:31.372338 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:44:31.372338 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:44:31.373155 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:44:31.373155 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:44:31.373155 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:44:31.373155 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:44:31.373155 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:44:31.373155 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:44:31.373155 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:44:31.373155 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:44:31.373155 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:44:31.373155 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:44:31.373155 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:44:31.373155 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:44:31.373155 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 117/228] 10.222.0.49 () {56 vars in 1114 bytes} [Sun Aug 28 00:44:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:44:31.381249 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18502ed-98c9-43d4-9808-212c6d63a63a None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:31.445643 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf30b1b3-128a-4b6a-b6a3-a996c84960f9 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:31.506193 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18502ed-98c9-43d4-9808-212c6d63a63a None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:31.536120 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:31.540742 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26669012-99bd-4262-9538-9b5da2d2dbe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:31.541331 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26669012-99bd-4262-9538-9b5da2d2dbe8 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:31.541618 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26669012-99bd-4262-9538-9b5da2d2dbe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:31.541890 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26669012-99bd-4262-9538-9b5da2d2dbe8 None admin] PATH_INFO: `/v3/projects/8dc5332abd014a54adc53ca64239c322` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:31.543301 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26669012-99bd-4262-9538-9b5da2d2dbe8 None admin] RBAC: Authorizing `identity:get_project(project_id=8dc5332abd014a54adc53ca64239c322)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:31.545018 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26669012-99bd-4262-9538-9b5da2d2dbe8 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:31.545543 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83608852-b971-4d18-bea9-67ab0d8f7cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:31.546362 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83608852-b971-4d18-bea9-67ab0d8f7cef None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:31.546742 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 112/229] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 28 00:44:31 2022] GET /identity/v3/projects/8dc5332abd014a54adc53ca64239c322 => generated 302 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:31.547010 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83608852-b971-4d18-bea9-67ab0d8f7cef None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:31.551560 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83608852-b971-4d18-bea9-67ab0d8f7cef None admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:31.551560 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83608852-b971-4d18-bea9-67ab0d8f7cef None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:31.551560 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83608852-b971-4d18-bea9-67ab0d8f7cef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:31.551560 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83608852-b971-4d18-bea9-67ab0d8f7cef None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:31.552951 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26669012-99bd-4262-9538-9b5da2d2dbe8 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:31.559292 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 118/230] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 28 00:44:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:31.565094 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83608852-b971-4d18-bea9-67ab0d8f7cef None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:31.688860 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83608852-b971-4d18-bea9-67ab0d8f7cef None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:31.745217 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:31.757708 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26669012-99bd-4262-9538-9b5da2d2dbe8 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:31.781039 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147b01a-a3ec-4926-909d-f41f4e93a69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:31.781684 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147b01a-a3ec-4926-909d-f41f4e93a69b None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:31.781957 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147b01a-a3ec-4926-909d-f41f4e93a69b None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:31.782225 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147b01a-a3ec-4926-909d-f41f4e93a69b None admin] PATH_INFO: `/v3/users/e5a7f5ec7c1a4fcea14bc3db525ee17b` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:31.784186 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4147b01a-a3ec-4926-909d-f41f4e93a69b None admin] RBAC: Authorizing `identity:get_user(user_id=e5a7f5ec7c1a4fcea14bc3db525ee17b)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:31.785757 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4147b01a-a3ec-4926-909d-f41f4e93a69b None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:31.788778 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 119/231] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 28 00:44:31 2022] GET /identity/v3/users/e5a7f5ec7c1a4fcea14bc3db525ee17b => generated 283 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:31.794408 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb22af-10fb-4530-a4ac-fddeea5d4eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:31.795223 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb22af-10fb-4530-a4ac-fddeea5d4eed None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:31.795636 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb22af-10fb-4530-a4ac-fddeea5d4eed None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:31.795763 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147b01a-a3ec-4926-909d-f41f4e93a69b None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:31.795943 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb22af-10fb-4530-a4ac-fddeea5d4eed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:31.796838 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb22af-10fb-4530-a4ac-fddeea5d4eed None admin] RBAC: Adding query filter params (role.id=7ac2391cc85a4d138e95e27cd0d09b26, scope.project.id=8dc5332abd014a54adc53ca64239c322, user.id=b933e37e0ed9461ab0611be07d3e2c9e) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:31.797161 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb22af-10fb-4530-a4ac-fddeea5d4eed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:31.798631 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb22af-10fb-4530-a4ac-fddeea5d4eed None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:31.805848 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 113/232] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 28 00:44:31 2022] GET /identity/v3/role_assignments?user.id=b933e37e0ed9461ab0611be07d3e2c9e&scope.project.id=8dc5332abd014a54adc53ca64239c322&role.id=7ac2391cc85a4d138e95e27cd0d09b26 => generated 259 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:31.834777 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:31.933164 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147b01a-a3ec-4926-909d-f41f4e93a69b None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:31.987384 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23823314-be72-4277-bfb2-c3de8746c825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:31.988081 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23823314-be72-4277-bfb2-c3de8746c825 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:31.988358 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23823314-be72-4277-bfb2-c3de8746c825 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:31.988628 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23823314-be72-4277-bfb2-c3de8746c825 None admin] PATH_INFO: `/v3/projects/8dc5332abd014a54adc53ca64239c322` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:31.989940 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23823314-be72-4277-bfb2-c3de8746c825 None admin] RBAC: Authorizing `identity:get_project(project_id=8dc5332abd014a54adc53ca64239c322)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:31.991460 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23823314-be72-4277-bfb2-c3de8746c825 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:31.993347 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 120/233] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 28 00:44:31 2022] GET /identity/v3/projects/8dc5332abd014a54adc53ca64239c322 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:44:31.999427 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb22af-10fb-4530-a4ac-fddeea5d4eed None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:32.141807 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb22af-10fb-4530-a4ac-fddeea5d4eed None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:32.177842 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4176ed84-2372-41dd-b70b-251703fce320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:32.178885 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176ed84-2372-41dd-b70b-251703fce320 None admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:32.179380 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176ed84-2372-41dd-b70b-251703fce320 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:32.179889 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176ed84-2372-41dd-b70b-251703fce320 None admin] PATH_INFO: `/v3/projects/8dc5332abd014a54adc53ca64239c322/users/e5a7f5ec7c1a4fcea14bc3db525ee17b/roles/5bcf10de71e7404aaef4d7878053be82` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:32.182325 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4176ed84-2372-41dd-b70b-251703fce320 None admin] RBAC: Authorizing `identity:create_grant(project_id=8dc5332abd014a54adc53ca64239c322, user_id=e5a7f5ec7c1a4fcea14bc3db525ee17b, role_id=5bcf10de71e7404aaef4d7878053be82)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:32.184094 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4176ed84-2372-41dd-b70b-251703fce320 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:32.203237 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 114/234] 10.222.0.49 () {58 vars in 1439 bytes} [Sun Aug 28 00:44:31 2022] PUT /identity/v3/projects/8dc5332abd014a54adc53ca64239c322/users/e5a7f5ec7c1a4fcea14bc3db525ee17b/roles/5bcf10de71e7404aaef4d7878053be82 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:44:32.884766 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d93af-c70c-4485-ab3d-4dee4f8c2631 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:32.885293 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d93af-c70c-4485-ab3d-4dee4f8c2631 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:32.885293 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d93af-c70c-4485-ab3d-4dee4f8c2631 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:32.887048 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 121/235] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:44:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:44:32.892863 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d4befa-19a9-484a-8250-148411f1b592 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:32.893433 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d4befa-19a9-484a-8250-148411f1b592 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:32.893433 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d4befa-19a9-484a-8250-148411f1b592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:32.924755 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-15d4befa-19a9-484a-8250-148411f1b592 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:44:32.925972 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-15d4befa-19a9-484a-8250-148411f1b592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:44:32.938372 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:33.017662 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 115/236] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:44:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:44:33.188273 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec81621-562c-4769-9c64-5a0c251c9cd2 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:33.188632 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec81621-562c-4769-9c64-5a0c251c9cd2 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:33.188828 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec81621-562c-4769-9c64-5a0c251c9cd2 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:33.190493 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 122/237] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:44:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:44:33.196183 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692e38a-ef12-470c-adef-2e21684a5315 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:33.196466 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692e38a-ef12-470c-adef-2e21684a5315 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:33.196738 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692e38a-ef12-470c-adef-2e21684a5315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:33.224712 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-8692e38a-ef12-470c-adef-2e21684a5315 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:44:33.225895 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-8692e38a-ef12-470c-adef-2e21684a5315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:44:33.317740 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 116/238] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:44:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:44:33.372225 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec81621-562c-4769-9c64-5a0c251c9cd2 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:33.427031 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e076a-5056-45fe-835e-7d542c10b9d9 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:33.427354 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e076a-5056-45fe-835e-7d542c10b9d9 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:33.427588 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e076a-5056-45fe-835e-7d542c10b9d9 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:33.429007 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 117/239] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:44:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:44:33.434738 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a845f0-b5ae-402d-b32c-47842eec3c81 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:33.435023 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a845f0-b5ae-402d-b32c-47842eec3c81 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:33.435298 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a845f0-b5ae-402d-b32c-47842eec3c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:33.473324 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-54a845f0-b5ae-402d-b32c-47842eec3c81 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:44:33.474540 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-54a845f0-b5ae-402d-b32c-47842eec3c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:44:33.496300 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:33.501580 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec81621-562c-4769-9c64-5a0c251c9cd2 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:33.563899 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67589545-486c-495a-b641-0fbad18d2cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:33.564544 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67589545-486c-495a-b641-0fbad18d2cd4 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:33.564822 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67589545-486c-495a-b641-0fbad18d2cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:33.565094 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67589545-486c-495a-b641-0fbad18d2cd4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:33.587771 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67589545-486c-495a-b641-0fbad18d2cd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:44:33.592714 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-67589545-486c-495a-b641-0fbad18d2cd4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:44:33.592714 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:44:33.592714 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:44:33.592714 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:44:33.592714 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:44:33.592714 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:44:33.592714 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:44:33.592714 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:44:33.592714 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:44:33.592714 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:44:33.592714 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:44:33.592714 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:44:33.592714 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:44:33.592714 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:44:33.592714 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:44:33.592714 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:44:33.593593 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:44:33.593593 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:44:33.593593 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:44:33.593593 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:44:33.593593 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:44:33.593593 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:44:33.593593 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:44:33.593593 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:44:33.593593 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:44:33.593593 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:44:33.593593 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:44:33.593593 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:44:33.593593 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:44:33.593593 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:44:33.593593 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:44:33.593593 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:44:33.594380 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:44:33.594380 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:44:33.594380 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:44:33.594380 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:44:33.594380 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:44:33.594380 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:44:33.594380 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:44:33.594380 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:44:33.594380 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:44:33.594380 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:44:33.594380 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:44:33.594380 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:44:33.595567 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 123/240] 10.222.0.49 () {56 vars in 1096 bytes} [Sun Aug 28 00:44:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:44:33.602632 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67589545-486c-495a-b641-0fbad18d2cd4 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:33.619952 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 118/241] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:44:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 28 00:44:33.638897 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a845f0-b5ae-402d-b32c-47842eec3c81 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:33.648045 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:33.777721 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a845f0-b5ae-402d-b32c-47842eec3c81 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:33.845749 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67589545-486c-495a-b641-0fbad18d2cd4 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:33.859735 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd7ffa9-e57e-491d-9a71-e3cc43018f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:33.860399 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7ffa9-e57e-491d-9a71-e3cc43018f74 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:33.860673 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7ffa9-e57e-491d-9a71-e3cc43018f74 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:33.860937 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7ffa9-e57e-491d-9a71-e3cc43018f74 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:33.879860 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd7ffa9-e57e-491d-9a71-e3cc43018f74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:44:33.886648 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-9fd7ffa9-e57e-491d-9a71-e3cc43018f74 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 00:44:33.886648 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:44:33.886648 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:44:33.886648 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:44:33.886648 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:44:33.886648 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:44:33.886648 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:44:33.886648 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:44:33.886648 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:44:33.886648 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:44:33.886648 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:44:33.886648 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:44:33.886648 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:44:33.886648 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:44:33.886648 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:44:33.886648 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:44:33.887642 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:44:33.887642 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:44:33.887642 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:44:33.887642 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:44:33.887642 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:44:33.887642 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:44:33.887642 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:44:33.887642 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:44:33.887642 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:44:33.887642 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:44:33.887642 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:44:33.887642 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:44:33.887642 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:44:33.887642 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:44:33.887642 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:44:33.887642 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:44:33.888459 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:44:33.888459 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:44:33.888459 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:44:33.888459 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:44:33.888459 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:44:33.888459 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:44:33.888459 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:44:33.888459 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:44:33.888459 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:44:33.888459 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:44:33.888459 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 00:44:33.888459 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:44:33.889068 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 119/242] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 28 00:44:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:44:33.895236 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd7ffa9-e57e-491d-9a71-e3cc43018f74 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:33.926347 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b016b6c-47f6-4269-814a-03721247a3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:33.927602 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b016b6c-47f6-4269-814a-03721247a3c9 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:33.928235 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b016b6c-47f6-4269-814a-03721247a3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:33.928685 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b016b6c-47f6-4269-814a-03721247a3c9 None admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:33.929969 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b016b6c-47f6-4269-814a-03721247a3c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:33.930438 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b016b6c-47f6-4269-814a-03721247a3c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:33.932408 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b016b6c-47f6-4269-814a-03721247a3c9 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:33.944322 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 124/243] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 28 00:44:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:44:33.945793 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b016b6c-47f6-4269-814a-03721247a3c9 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:33.982177 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:34.005566 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:34.060522 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd7ffa9-e57e-491d-9a71-e3cc43018f74 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:34.092190 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b016b6c-47f6-4269-814a-03721247a3c9 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:34.106664 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d7399a-743a-492d-86f2-8f4247e3aea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:34.107342 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7399a-743a-492d-86f2-8f4247e3aea0 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:34.107707 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7399a-743a-492d-86f2-8f4247e3aea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:34.108059 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d7399a-743a-492d-86f2-8f4247e3aea0 None admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:34.109282 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d7399a-743a-492d-86f2-8f4247e3aea0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:34.109649 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d7399a-743a-492d-86f2-8f4247e3aea0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:34.111416 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d7399a-743a-492d-86f2-8f4247e3aea0 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:34.127335 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 120/244] 10.222.0.49 () {56 vars in 1101 bytes} [Sun Aug 28 00:44:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:34.127335 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d7399a-743a-492d-86f2-8f4247e3aea0 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:34.143312 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd468532-5dc3-42f7-aafe-f02abd5bf78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:34.144063 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd468532-5dc3-42f7-aafe-f02abd5bf78c None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:34.144342 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd468532-5dc3-42f7-aafe-f02abd5bf78c None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:34.144609 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd468532-5dc3-42f7-aafe-f02abd5bf78c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:34.145817 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd468532-5dc3-42f7-aafe-f02abd5bf78c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:34.147317 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd468532-5dc3-42f7-aafe-f02abd5bf78c None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:34.149144 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 125/245] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:44:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:34.154224 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd468532-5dc3-42f7-aafe-f02abd5bf78c None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:34.274181 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d7399a-743a-492d-86f2-8f4247e3aea0 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:34.277073 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:34.289648 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd468532-5dc3-42f7-aafe-f02abd5bf78c None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:34.319373 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:34.328002 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a672d895-6948-4493-9d2b-2a81c893adf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:34.328642 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a672d895-6948-4493-9d2b-2a81c893adf1 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:34.328935 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a672d895-6948-4493-9d2b-2a81c893adf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:34.329221 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a672d895-6948-4493-9d2b-2a81c893adf1 None admin] PATH_INFO: `/v3/users/e5a7f5ec7c1a4fcea14bc3db525ee17b` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:34.330723 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a672d895-6948-4493-9d2b-2a81c893adf1 None admin] RBAC: Authorizing `identity:get_user(user_id=e5a7f5ec7c1a4fcea14bc3db525ee17b)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:34.332280 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a672d895-6948-4493-9d2b-2a81c893adf1 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:34.334111 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 121/246] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 28 00:44:34 2022] GET /identity/v3/users/e5a7f5ec7c1a4fcea14bc3db525ee17b => generated 283 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:34.335693 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a672d895-6948-4493-9d2b-2a81c893adf1 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:34.342147 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38574927-89fa-463e-bbec-5eff3ab3f1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:34.344512 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38574927-89fa-463e-bbec-5eff3ab3f1f5 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:34.344512 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38574927-89fa-463e-bbec-5eff3ab3f1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:34.344512 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38574927-89fa-463e-bbec-5eff3ab3f1f5 None admin] PATH_INFO: `/v3/users/8a080d1aeb354e5dbbcc7a4cc43ee391` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:34.365468 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38574927-89fa-463e-bbec-5eff3ab3f1f5 None admin] RBAC: Authorizing `identity:get_user(user_id=8a080d1aeb354e5dbbcc7a4cc43ee391)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:34.366822 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38574927-89fa-463e-bbec-5eff3ab3f1f5 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:34.368587 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 126/247] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 28 00:44:34 2022] GET /identity/v3/users/8a080d1aeb354e5dbbcc7a4cc43ee391 => generated 297 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:34.374878 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83cd5b-7222-4ea9-a945-be6cf43ea5f4 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:34.375170 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83cd5b-7222-4ea9-a945-be6cf43ea5f4 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:34.375449 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83cd5b-7222-4ea9-a945-be6cf43ea5f4 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:34.376918 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 127/248] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:44:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:44:34.377636 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c83cd5b-7222-4ea9-a945-be6cf43ea5f4 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:34.468222 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a672d895-6948-4493-9d2b-2a81c893adf1 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:34.499621 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c83cd5b-7222-4ea9-a945-be6cf43ea5f4 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:34.507436 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a21dcb-dd23-4410-ac68-8d61c8543022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:34.508081 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a21dcb-dd23-4410-ac68-8d61c8543022 None admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:34.508360 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a21dcb-dd23-4410-ac68-8d61c8543022 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:34.508630 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a21dcb-dd23-4410-ac68-8d61c8543022 None admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:34.509412 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a21dcb-dd23-4410-ac68-8d61c8543022 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:34.510982 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a21dcb-dd23-4410-ac68-8d61c8543022 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:34.535326 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 122/249] 10.222.0.49 () {60 vars in 1132 bytes} [Sun Aug 28 00:44:34 2022] POST /identity/v3/users => generated 293 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:44:34.536433 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a21dcb-dd23-4410-ac68-8d61c8543022 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:34.546071 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97996f61-0dac-4eb0-9970-78588bba0629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:34.547148 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97996f61-0dac-4eb0-9970-78588bba0629 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:34.547578 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97996f61-0dac-4eb0-9970-78588bba0629 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:34.548026 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97996f61-0dac-4eb0-9970-78588bba0629 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:34.570688 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:34.627180 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:34.635396 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97996f61-0dac-4eb0-9970-78588bba0629 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:34.637061 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97996f61-0dac-4eb0-9970-78588bba0629 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:34.712097 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a21dcb-dd23-4410-ac68-8d61c8543022 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:34.765050 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 128/250] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 28 00:44:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:44:34.766343 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459ee0c-1850-4bd2-adae-fdc7cf95a679 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:34.766632 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459ee0c-1850-4bd2-adae-fdc7cf95a679 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:34.766900 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459ee0c-1850-4bd2-adae-fdc7cf95a679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:34.769013 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7da976-1bbb-47a9-b4e2-57c98f029b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:34.769846 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7da976-1bbb-47a9-b4e2-57c98f029b2a None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:34.770299 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7da976-1bbb-47a9-b4e2-57c98f029b2a None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:34.770747 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7da976-1bbb-47a9-b4e2-57c98f029b2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:34.789419 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-4459ee0c-1850-4bd2-adae-fdc7cf95a679 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:44:34.790749 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-4459ee0c-1850-4bd2-adae-fdc7cf95a679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:44:34.850239 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:34.861192 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7da976-1bbb-47a9-b4e2-57c98f029b2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:34.864465 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7da976-1bbb-47a9-b4e2-57c98f029b2a None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:34.881437 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 129/251] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:44:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:44:34.882035 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4459ee0c-1850-4bd2-adae-fdc7cf95a679 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:34.949037 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:35.012553 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 123/252] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 28 00:44:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:44:35.019082 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4459ee0c-1850-4bd2-adae-fdc7cf95a679 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:35.019630 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a784d938-6af3-4347-88e7-b6e7ae0c753a None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:35.019807 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a784d938-6af3-4347-88e7-b6e7ae0c753a None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:35.020084 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a784d938-6af3-4347-88e7-b6e7ae0c753a None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:35.021751 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 124/253] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:44:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:44:35.022531 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a784d938-6af3-4347-88e7-b6e7ae0c753a None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:35.065125 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b4ac9-6751-4a08-b4f1-7337d1226d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:35.066033 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b4ac9-6751-4a08-b4f1-7337d1226d7d None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:35.066316 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b4ac9-6751-4a08-b4f1-7337d1226d7d None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:35.067015 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b4ac9-6751-4a08-b4f1-7337d1226d7d None admin] PATH_INFO: `/v3/projects/8dc5332abd014a54adc53ca64239c322` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:35.068460 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683b4ac9-6751-4a08-b4f1-7337d1226d7d None admin] RBAC: Authorizing `identity:get_project(project_id=8dc5332abd014a54adc53ca64239c322)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:35.070612 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683b4ac9-6751-4a08-b4f1-7337d1226d7d None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:35.072827 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 130/254] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 28 00:44:34 2022] GET /identity/v3/projects/8dc5332abd014a54adc53ca64239c322 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:35.074343 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c5772-c459-4c12-bea3-92019c91c35a None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:35.074626 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c5772-c459-4c12-bea3-92019c91c35a None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:35.074898 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c5772-c459-4c12-bea3-92019c91c35a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:35.099238 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-5b1c5772-c459-4c12-bea3-92019c91c35a None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:44:35.100779 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-5b1c5772-c459-4c12-bea3-92019c91c35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:44:35.167353 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a784d938-6af3-4347-88e7-b6e7ae0c753a None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:35.172463 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:35.206611 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 131/255] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:44:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:44:35.208655 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c5772-c459-4c12-bea3-92019c91c35a None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:35.213586 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1138bf82-f519-45ea-b730-b42085525b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:35.214735 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1138bf82-f519-45ea-b730-b42085525b96 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:35.215285 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1138bf82-f519-45ea-b730-b42085525b96 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:35.215766 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1138bf82-f519-45ea-b730-b42085525b96 None admin] PATH_INFO: `/v3/projects/8dc5332abd014a54adc53ca64239c322` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:35.217068 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1138bf82-f519-45ea-b730-b42085525b96 None admin] RBAC: Authorizing `identity:get_project(project_id=8dc5332abd014a54adc53ca64239c322)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:35.218662 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1138bf82-f519-45ea-b730-b42085525b96 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:35.221440 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 125/256] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 28 00:44:35 2022] GET /identity/v3/projects/8dc5332abd014a54adc53ca64239c322 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:35.221847 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1138bf82-f519-45ea-b730-b42085525b96 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:35.250295 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:35.329663 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c5772-c459-4c12-bea3-92019c91c35a None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:35.349642 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1138bf82-f519-45ea-b730-b42085525b96 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:35.366108 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99279a33-b9b5-4934-82cd-3a816440b5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:35.367090 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99279a33-b9b5-4934-82cd-3a816440b5b7 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:35.367556 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99279a33-b9b5-4934-82cd-3a816440b5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:35.368077 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99279a33-b9b5-4934-82cd-3a816440b5b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:35.369000 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99279a33-b9b5-4934-82cd-3a816440b5b7 None admin] RBAC: Adding query filter params (role.id=2e4889bb71f9434392c0baba59f2534e, scope.project.id=8dc5332abd014a54adc53ca64239c322, user.id=e5a7f5ec7c1a4fcea14bc3db525ee17b) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:35.369499 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99279a33-b9b5-4934-82cd-3a816440b5b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:35.371180 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99279a33-b9b5-4934-82cd-3a816440b5b7 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:35.377657 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 132/257] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 28 00:44:35 2022] GET /identity/v3/role_assignments?user.id=e5a7f5ec7c1a4fcea14bc3db525ee17b&scope.project.id=8dc5332abd014a54adc53ca64239c322&role.id=2e4889bb71f9434392c0baba59f2534e => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:35.378928 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99279a33-b9b5-4934-82cd-3a816440b5b7 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:35.390265 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406e087b-1857-41fe-9cfd-687f226bed5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:35.390908 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e087b-1857-41fe-9cfd-687f226bed5d None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:35.391190 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e087b-1857-41fe-9cfd-687f226bed5d None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:35.391464 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406e087b-1857-41fe-9cfd-687f226bed5d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:35.404451 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406e087b-1857-41fe-9cfd-687f226bed5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:44:35.410568 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-406e087b-1857-41fe-9cfd-687f226bed5d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:44:35.410568 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:44:35.410568 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:44:35.410568 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:44:35.410568 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:44:35.410568 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:44:35.410568 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:44:35.410568 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:44:35.410568 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:44:35.410568 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:44:35.410568 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:44:35.410568 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:44:35.410568 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:44:35.410568 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:44:35.410568 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:44:35.410568 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:44:35.411523 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:44:35.411523 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:44:35.411523 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:44:35.411523 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:44:35.411523 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:44:35.411523 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:44:35.411523 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:44:35.411523 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:44:35.411523 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:44:35.411523 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:44:35.411523 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:44:35.411523 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:44:35.411523 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:44:35.411523 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:44:35.411523 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:44:35.411523 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:44:35.417601 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:44:35.417601 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:44:35.417601 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:44:35.417601 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:44:35.417601 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:44:35.417601 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:44:35.417601 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:44:35.417601 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:44:35.417601 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:44:35.417601 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:44:35.417601 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:44:35.417601 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:44:35.417601 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 126/258] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 28 00:44:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:44:35.421943 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406e087b-1857-41fe-9cfd-687f226bed5d None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:35.446788 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:35.512797 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99279a33-b9b5-4934-82cd-3a816440b5b7 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:35.572975 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:35.610564 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1689d70-036a-4314-8863-9aa91854e23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:35.611285 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1689d70-036a-4314-8863-9aa91854e23f None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:35.611617 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1689d70-036a-4314-8863-9aa91854e23f None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:35.611955 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1689d70-036a-4314-8863-9aa91854e23f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:35.612812 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1689d70-036a-4314-8863-9aa91854e23f None admin] RBAC: Adding query filter params (role.id=708b4012bb2645b6aa4af9606988ce56, scope.project.id=8dc5332abd014a54adc53ca64239c322, user.id=8a080d1aeb354e5dbbcc7a4cc43ee391) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:35.613217 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1689d70-036a-4314-8863-9aa91854e23f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:35.614792 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1689d70-036a-4314-8863-9aa91854e23f None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:35.631432 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406e087b-1857-41fe-9cfd-687f226bed5d None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:35.643926 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 133/259] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 28 00:44:35 2022] GET /identity/v3/role_assignments?user.id=8a080d1aeb354e5dbbcc7a4cc43ee391&scope.project.id=8dc5332abd014a54adc53ca64239c322&role.id=708b4012bb2645b6aa4af9606988ce56 => generated 259 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:35.665794 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1689d70-036a-4314-8863-9aa91854e23f None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:35.675052 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac34f05d-c3d9-4a60-92e2-a92d854be53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:35.675617 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac34f05d-c3d9-4a60-92e2-a92d854be53b None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:35.675969 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac34f05d-c3d9-4a60-92e2-a92d854be53b None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:35.676242 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac34f05d-c3d9-4a60-92e2-a92d854be53b None admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:35.676965 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac34f05d-c3d9-4a60-92e2-a92d854be53b None admin] RBAC: Adding query filter params (name=member) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:35.677271 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac34f05d-c3d9-4a60-92e2-a92d854be53b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:35.678751 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac34f05d-c3d9-4a60-92e2-a92d854be53b None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:35.688621 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 127/260] 10.222.0.49 () {56 vars in 1101 bytes} [Sun Aug 28 00:44:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:35.695389 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac34f05d-c3d9-4a60-92e2-a92d854be53b None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:35.809186 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1689d70-036a-4314-8863-9aa91854e23f None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:35.821036 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:35.859147 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af52d65-aa98-45ba-8bda-2bdf903f26ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:35.859858 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af52d65-aa98-45ba-8bda-2bdf903f26ea None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:35.860143 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af52d65-aa98-45ba-8bda-2bdf903f26ea None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:35.860419 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af52d65-aa98-45ba-8bda-2bdf903f26ea None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:35.883792 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af52d65-aa98-45ba-8bda-2bdf903f26ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:44:35.891949 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-9af52d65-aa98-45ba-8bda-2bdf903f26ea None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:44:35.891949 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:44:35.891949 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:44:35.891949 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:44:35.891949 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:44:35.891949 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:44:35.891949 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:44:35.891949 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:44:35.891949 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:44:35.891949 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:44:35.891949 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:44:35.891949 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:44:35.891949 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:44:35.891949 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:44:35.891949 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:44:35.891949 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:44:35.893000 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:44:35.893000 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:44:35.893000 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:44:35.893000 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:44:35.893000 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:44:35.893000 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:44:35.893000 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:44:35.893000 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:44:35.893000 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:44:35.893000 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:44:35.893000 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:44:35.893000 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:44:35.893000 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:44:35.893000 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:44:35.893000 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:44:35.893000 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:44:35.894196 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:44:35.894196 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:44:35.894196 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:44:35.894196 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:44:35.894196 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:44:35.894196 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:44:35.894196 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:44:35.894196 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:44:35.894196 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:44:35.894196 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:44:35.894196 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:44:35.894196 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:44:35.894196 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 134/261] 10.222.0.49 () {56 vars in 1114 bytes} [Sun Aug 28 00:44:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:44:35.900388 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af52d65-aa98-45ba-8bda-2bdf903f26ea None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:35.935175 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac34f05d-c3d9-4a60-92e2-a92d854be53b None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:35.973067 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72f0e8-8891-4eaf-bdae-9289b64beaf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:35.973730 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72f0e8-8891-4eaf-bdae-9289b64beaf6 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:35.973976 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72f0e8-8891-4eaf-bdae-9289b64beaf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:35.974247 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72f0e8-8891-4eaf-bdae-9289b64beaf6 None admin] PATH_INFO: `/v3/users/b933e37e0ed9461ab0611be07d3e2c9e` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:35.977026 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f72f0e8-8891-4eaf-bdae-9289b64beaf6 None admin] RBAC: Authorizing `identity:get_user(user_id=b933e37e0ed9461ab0611be07d3e2c9e)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:35.978521 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f72f0e8-8891-4eaf-bdae-9289b64beaf6 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:35.981314 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 128/262] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 28 00:44:35 2022] GET /identity/v3/users/b933e37e0ed9461ab0611be07d3e2c9e => generated 297 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:44:35.986736 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72f0e8-8891-4eaf-bdae-9289b64beaf6 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:36.021414 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af52d65-aa98-45ba-8bda-2bdf903f26ea None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:36.021938 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:36.058512 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e57c2c-759e-40ea-bc86-b45dd8e01149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:36.059164 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e57c2c-759e-40ea-bc86-b45dd8e01149 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:36.059445 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e57c2c-759e-40ea-bc86-b45dd8e01149 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:36.059739 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e57c2c-759e-40ea-bc86-b45dd8e01149 None admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:36.060562 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e57c2c-759e-40ea-bc86-b45dd8e01149 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:36.060867 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e57c2c-759e-40ea-bc86-b45dd8e01149 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:36.062268 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e57c2c-759e-40ea-bc86-b45dd8e01149 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:36.071206 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 135/263] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 28 00:44:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:36.076919 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e57c2c-759e-40ea-bc86-b45dd8e01149 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:36.118185 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:36.214408 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72f0e8-8891-4eaf-bdae-9289b64beaf6 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:36.256892 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04068bc-992a-4b71-baa0-abfba1406cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:36.257879 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04068bc-992a-4b71-baa0-abfba1406cb5 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:36.258163 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04068bc-992a-4b71-baa0-abfba1406cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:36.258435 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04068bc-992a-4b71-baa0-abfba1406cb5 None admin] PATH_INFO: `/v3/projects/8dc5332abd014a54adc53ca64239c322` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:36.259706 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04068bc-992a-4b71-baa0-abfba1406cb5 None admin] RBAC: Authorizing `identity:get_project(project_id=8dc5332abd014a54adc53ca64239c322)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:36.261333 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04068bc-992a-4b71-baa0-abfba1406cb5 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:36.263571 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 129/264] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 28 00:44:35 2022] GET /identity/v3/projects/8dc5332abd014a54adc53ca64239c322 => generated 302 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:36.269163 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04068bc-992a-4b71-baa0-abfba1406cb5 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:36.299544 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e57c2c-759e-40ea-bc86-b45dd8e01149 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:36.363618 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:36.388654 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04068bc-992a-4b71-baa0-abfba1406cb5 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:36.389538 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7655b0-9cfb-4f12-b5db-cb0b50daf519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:36.390377 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7655b0-9cfb-4f12-b5db-cb0b50daf519 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:36.390780 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7655b0-9cfb-4f12-b5db-cb0b50daf519 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:36.391179 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7655b0-9cfb-4f12-b5db-cb0b50daf519 None admin] PATH_INFO: `/v3/users/e5a7f5ec7c1a4fcea14bc3db525ee17b` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:36.396557 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7655b0-9cfb-4f12-b5db-cb0b50daf519 None admin] RBAC: Authorizing `identity:get_user(user_id=e5a7f5ec7c1a4fcea14bc3db525ee17b)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:36.398266 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7655b0-9cfb-4f12-b5db-cb0b50daf519 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:36.400124 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 136/265] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 28 00:44:36 2022] GET /identity/v3/users/e5a7f5ec7c1a4fcea14bc3db525ee17b => generated 283 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:44:36.412685 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7655b0-9cfb-4f12-b5db-cb0b50daf519 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:36.431971 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803f385b-4a56-4456-becd-ea3706f4caad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:36.432925 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f385b-4a56-4456-becd-ea3706f4caad None admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:36.433315 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f385b-4a56-4456-becd-ea3706f4caad None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:36.433763 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803f385b-4a56-4456-becd-ea3706f4caad None admin] PATH_INFO: `/v3/projects/8dc5332abd014a54adc53ca64239c322/users/b933e37e0ed9461ab0611be07d3e2c9e/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:36.435872 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803f385b-4a56-4456-becd-ea3706f4caad None admin] RBAC: Authorizing `identity:create_grant(project_id=8dc5332abd014a54adc53ca64239c322, user_id=b933e37e0ed9461ab0611be07d3e2c9e, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:36.437506 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803f385b-4a56-4456-becd-ea3706f4caad None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:36.457053 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 130/266] 10.222.0.49 () {58 vars in 1439 bytes} [Sun Aug 28 00:44:36 2022] PUT /identity/v3/projects/8dc5332abd014a54adc53ca64239c322/users/b933e37e0ed9461ab0611be07d3e2c9e/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:44:36.601973 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:36.609980 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7655b0-9cfb-4f12-b5db-cb0b50daf519 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:36.647478 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71110794-fad5-4597-b4cc-0a02be46cef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:36.648136 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71110794-fad5-4597-b4cc-0a02be46cef1 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:36.648417 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71110794-fad5-4597-b4cc-0a02be46cef1 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:36.648687 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71110794-fad5-4597-b4cc-0a02be46cef1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:36.722183 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71110794-fad5-4597-b4cc-0a02be46cef1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:36.724191 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71110794-fad5-4597-b4cc-0a02be46cef1 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:36.858655 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:36.868224 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 137/267] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 28 00:44:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:44:36.880799 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803f385b-4a56-4456-becd-ea3706f4caad None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:37.009862 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803f385b-4a56-4456-becd-ea3706f4caad None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:37.044741 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cddc8a9-4351-49cd-802c-38d380345535 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:37.045259 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cddc8a9-4351-49cd-802c-38d380345535 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:37.045259 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cddc8a9-4351-49cd-802c-38d380345535 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:37.046928 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 138/268] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:44:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:44:37.052322 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5343b7-0aac-4597-b7eb-7f4df0666033 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:37.052612 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5343b7-0aac-4597-b7eb-7f4df0666033 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:37.052892 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5343b7-0aac-4597-b7eb-7f4df0666033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:37.061456 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4491f99-1d43-47ed-b80c-d4646a11a099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:37.062111 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4491f99-1d43-47ed-b80c-d4646a11a099 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:37.062391 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4491f99-1d43-47ed-b80c-d4646a11a099 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:37.062662 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4491f99-1d43-47ed-b80c-d4646a11a099 None admin] PATH_INFO: `/v3/projects/8dc5332abd014a54adc53ca64239c322` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:37.064834 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4491f99-1d43-47ed-b80c-d4646a11a099 None admin] RBAC: Authorizing `identity:get_project(project_id=8dc5332abd014a54adc53ca64239c322)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:37.066104 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4491f99-1d43-47ed-b80c-d4646a11a099 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:37.073434 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 131/269] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 28 00:44:36 2022] GET /identity/v3/projects/8dc5332abd014a54adc53ca64239c322 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:37.074081 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4491f99-1d43-47ed-b80c-d4646a11a099 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:37.082940 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-8a5343b7-0aac-4597-b7eb-7f4df0666033 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:44:37.084202 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-8a5343b7-0aac-4597-b7eb-7f4df0666033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:44:37.092833 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:37.209954 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 139/270] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:44:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:44:37.219772 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4491f99-1d43-47ed-b80c-d4646a11a099 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:37.279257 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032ab9d7-92ec-465e-a901-6431604976a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:37.280169 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ab9d7-92ec-465e-a901-6431604976a8 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:37.280583 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ab9d7-92ec-465e-a901-6431604976a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:37.281013 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ab9d7-92ec-465e-a901-6431604976a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:37.281910 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032ab9d7-92ec-465e-a901-6431604976a8 None admin] RBAC: Adding query filter params (role.id=5bcf10de71e7404aaef4d7878053be82, scope.project.id=8dc5332abd014a54adc53ca64239c322, user.id=e5a7f5ec7c1a4fcea14bc3db525ee17b) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:37.282357 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032ab9d7-92ec-465e-a901-6431604976a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:37.284038 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032ab9d7-92ec-465e-a901-6431604976a8 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:37.296858 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 132/271] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 28 00:44:37 2022] GET /identity/v3/role_assignments?user.id=e5a7f5ec7c1a4fcea14bc3db525ee17b&scope.project.id=8dc5332abd014a54adc53ca64239c322&role.id=5bcf10de71e7404aaef4d7878053be82 => generated 608 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:37.502921 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce9941-8075-492b-8303-ad4e4e59b30c None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:37.503407 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce9941-8075-492b-8303-ad4e4e59b30c None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:37.503861 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce9941-8075-492b-8303-ad4e4e59b30c None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:37.505605 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 140/272] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:44:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:44:37.511725 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118f1e7-2cf8-47b4-b82f-b2e52a41bf17 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:37.512224 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118f1e7-2cf8-47b4-b82f-b2e52a41bf17 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:37.512660 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118f1e7-2cf8-47b4-b82f-b2e52a41bf17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:37.532921 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce9941-8075-492b-8303-ad4e4e59b30c None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:37.544868 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-7118f1e7-2cf8-47b4-b82f-b2e52a41bf17 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:44:37.546540 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-7118f1e7-2cf8-47b4-b82f-b2e52a41bf17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:44:37.638464 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:37.645905 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 133/273] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:44:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:44:37.685235 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce9941-8075-492b-8303-ad4e4e59b30c None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:37.711505 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:37.728705 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e2c0b-e7cb-4ac2-8eb8-5bd571352356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:37.729228 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e2c0b-e7cb-4ac2-8eb8-5bd571352356 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:37.729509 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e2c0b-e7cb-4ac2-8eb8-5bd571352356 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:37.729842 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61e2c0b-e7cb-4ac2-8eb8-5bd571352356 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:37.747683 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61e2c0b-e7cb-4ac2-8eb8-5bd571352356 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:44:37.755901 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-a61e2c0b-e7cb-4ac2-8eb8-5bd571352356 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:44:37.755901 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:44:37.755901 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:44:37.755901 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:44:37.755901 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:44:37.755901 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:44:37.755901 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:44:37.755901 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:44:37.755901 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:44:37.755901 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:44:37.755901 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:44:37.755901 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:44:37.755901 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:44:37.755901 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:44:37.755901 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:44:37.755901 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:44:37.756765 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:44:37.756765 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:44:37.756765 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:44:37.756765 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:44:37.756765 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:44:37.756765 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:44:37.756765 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:44:37.756765 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:44:37.756765 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:44:37.756765 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:44:37.756765 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:44:37.756765 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:44:37.756765 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:44:37.756765 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:44:37.756765 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:44:37.756765 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:44:37.757558 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:44:37.757558 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:44:37.757558 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:44:37.757558 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:44:37.757558 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:44:37.757558 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:44:37.757558 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:44:37.757558 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:44:37.757558 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:44:37.757558 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:44:37.757558 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:44:37.757558 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:44:37.758158 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 141/274] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 28 00:44:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:44:37.765902 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7118f1e7-2cf8-47b4-b82f-b2e52a41bf17 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:37.887182 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7118f1e7-2cf8-47b4-b82f-b2e52a41bf17 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:37.929169 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ed400-dcd9-4456-92a0-5742ced5f4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:37.929873 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ed400-dcd9-4456-92a0-5742ced5f4b6 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:37.930155 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ed400-dcd9-4456-92a0-5742ced5f4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:37.930426 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ed400-dcd9-4456-92a0-5742ced5f4b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:37.931127 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989ed400-dcd9-4456-92a0-5742ced5f4b6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:37.931430 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989ed400-dcd9-4456-92a0-5742ced5f4b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:37.932916 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989ed400-dcd9-4456-92a0-5742ced5f4b6 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:37.943520 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 134/275] 10.222.0.49 () {56 vars in 1101 bytes} [Sun Aug 28 00:44:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:37.949282 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e2c0b-e7cb-4ac2-8eb8-5bd571352356 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:37.959573 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ed400-dcd9-4456-92a0-5742ced5f4b6 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:38.038811 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:38.076469 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61e2c0b-e7cb-4ac2-8eb8-5bd571352356 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:38.080800 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ed400-dcd9-4456-92a0-5742ced5f4b6 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:38.119991 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84796b6-db09-4025-ac50-ee44fad4e6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:38.121130 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84796b6-db09-4025-ac50-ee44fad4e6ea None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:38.121579 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84796b6-db09-4025-ac50-ee44fad4e6ea None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:38.121923 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84796b6-db09-4025-ac50-ee44fad4e6ea None admin] PATH_INFO: `/v3/domains/default` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:38.122979 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84796b6-db09-4025-ac50-ee44fad4e6ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:38.124491 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84796b6-db09-4025-ac50-ee44fad4e6ea None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:38.125332 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf364d4-7a25-4baf-86dc-605f13256389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:38.125971 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf364d4-7a25-4baf-86dc-605f13256389 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:38.126250 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf364d4-7a25-4baf-86dc-605f13256389 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:38.126520 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf364d4-7a25-4baf-86dc-605f13256389 None admin] PATH_INFO: `/v3/users/2820d8c5aa944beba55ec1ca1e5536f3` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:38.130768 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 135/276] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:44:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:38.131948 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0965e00-1c16-4bd8-aa58-40ddc2366c8e None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:38.132231 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0965e00-1c16-4bd8-aa58-40ddc2366c8e None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:38.132503 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0965e00-1c16-4bd8-aa58-40ddc2366c8e None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:38.133870 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 136/277] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:44:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:44:38.134468 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0965e00-1c16-4bd8-aa58-40ddc2366c8e None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:38.144851 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf364d4-7a25-4baf-86dc-605f13256389 None admin] RBAC: Authorizing `identity:get_user(user_id=2820d8c5aa944beba55ec1ca1e5536f3)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:38.146388 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf364d4-7a25-4baf-86dc-605f13256389 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:38.147993 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 142/278] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 28 00:44:37 2022] GET /identity/v3/users/2820d8c5aa944beba55ec1ca1e5536f3 => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:38.149371 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3a8bc-2dcb-448a-b23a-11945b93528d None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:38.149656 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3a8bc-2dcb-448a-b23a-11945b93528d None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:38.149912 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3a8bc-2dcb-448a-b23a-11945b93528d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:38.168249 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-89f3a8bc-2dcb-448a-b23a-11945b93528d None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:44:38.169645 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-89f3a8bc-2dcb-448a-b23a-11945b93528d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:44:38.209581 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:38.251695 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 143/279] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:44:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:44:38.251695 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f3a8bc-2dcb-448a-b23a-11945b93528d None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:38.253703 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0965e00-1c16-4bd8-aa58-40ddc2366c8e None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:38.282286 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:38.289208 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57940009-8725-4c23-8852-b67dfa3798d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:38.290102 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57940009-8725-4c23-8852-b67dfa3798d8 None admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:38.290569 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57940009-8725-4c23-8852-b67dfa3798d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:38.291010 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57940009-8725-4c23-8852-b67dfa3798d8 None admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:38.291870 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57940009-8725-4c23-8852-b67dfa3798d8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:38.293757 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57940009-8725-4c23-8852-b67dfa3798d8 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:38.321488 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 137/280] 10.222.0.49 () {60 vars in 1132 bytes} [Sun Aug 28 00:44:38 2022] POST /identity/v3/users => generated 293 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:44:38.376891 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f3a8bc-2dcb-448a-b23a-11945b93528d None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:38.417890 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e163d-e7ac-4103-a945-c8dc07715d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:38.418544 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e163d-e7ac-4103-a945-c8dc07715d2a None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:38.418819 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e163d-e7ac-4103-a945-c8dc07715d2a None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:38.419083 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e163d-e7ac-4103-a945-c8dc07715d2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:38.419860 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02e163d-e7ac-4103-a945-c8dc07715d2a None admin] RBAC: Adding query filter params (role.id=7ac2391cc85a4d138e95e27cd0d09b26, user.id=2820d8c5aa944beba55ec1ca1e5536f3, scope.system=all) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:38.420219 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02e163d-e7ac-4103-a945-c8dc07715d2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:38.421754 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02e163d-e7ac-4103-a945-c8dc07715d2a None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:38.428262 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 144/281] 10.222.0.49 () {56 vars in 1308 bytes} [Sun Aug 28 00:44:38 2022] GET /identity/v3/role_assignments?user.id=2820d8c5aa944beba55ec1ca1e5536f3&scope.system=all&role.id=7ac2391cc85a4d138e95e27cd0d09b26 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:38.573275 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57940009-8725-4c23-8852-b67dfa3798d8 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:38.690048 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57940009-8725-4c23-8852-b67dfa3798d8 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:38.728638 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecde2a0-6b2e-4d27-a582-565c78ca130b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:38.729284 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecde2a0-6b2e-4d27-a582-565c78ca130b None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:38.729553 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecde2a0-6b2e-4d27-a582-565c78ca130b None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:38.729815 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecde2a0-6b2e-4d27-a582-565c78ca130b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:38.743512 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecde2a0-6b2e-4d27-a582-565c78ca130b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:44:38.748616 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-cecde2a0-6b2e-4d27-a582-565c78ca130b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 00:44:38.748616 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:44:38.748616 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:44:38.748616 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:44:38.748616 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:44:38.748616 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:44:38.748616 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:44:38.748616 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:44:38.748616 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:44:38.748616 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:44:38.748616 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:44:38.748616 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:44:38.748616 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:44:38.748616 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:44:38.748616 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:44:38.748616 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:44:38.749545 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:44:38.749545 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:44:38.749545 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:44:38.749545 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:44:38.749545 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:44:38.749545 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:44:38.749545 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:44:38.749545 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:44:38.749545 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:44:38.749545 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:44:38.749545 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:44:38.749545 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:44:38.749545 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:44:38.749545 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:44:38.749545 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:44:38.749545 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:44:38.750322 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:44:38.750322 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:44:38.750322 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:44:38.750322 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:44:38.750322 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:44:38.750322 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:44:38.750322 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:44:38.750322 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:44:38.750322 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:44:38.750322 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:44:38.750322 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 00:44:38.750322 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:44:38.750322 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 138/282] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 28 00:44:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:44:38.755948 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e163d-e7ac-4103-a945-c8dc07715d2a None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:38.794285 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:38.813570 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15173b06-683e-4e22-8474-f319aa77b27a None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:38.813900 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15173b06-683e-4e22-8474-f319aa77b27a None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:38.814117 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15173b06-683e-4e22-8474-f319aa77b27a None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:38.815592 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 139/283] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:44:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:44:38.822111 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea026e3f-149d-48e9-8555-6e898fbaeeae None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:38.822396 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea026e3f-149d-48e9-8555-6e898fbaeeae None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:38.822651 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea026e3f-149d-48e9-8555-6e898fbaeeae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:38.848427 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-ea026e3f-149d-48e9-8555-6e898fbaeeae None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:44:38.850049 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-ea026e3f-149d-48e9-8555-6e898fbaeeae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:44:38.895347 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e163d-e7ac-4103-a945-c8dc07715d2a None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:38.906634 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:38.938393 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 140/284] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:44:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:44:38.966830 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc77a6e-d442-4127-8afe-b0a9f7bfbb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:38.967454 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc77a6e-d442-4127-8afe-b0a9f7bfbb04 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:38.967759 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc77a6e-d442-4127-8afe-b0a9f7bfbb04 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:38.968035 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc77a6e-d442-4127-8afe-b0a9f7bfbb04 None admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:38.968725 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc77a6e-d442-4127-8afe-b0a9f7bfbb04 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:38.969029 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc77a6e-d442-4127-8afe-b0a9f7bfbb04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:38.970420 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc77a6e-d442-4127-8afe-b0a9f7bfbb04 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:38.986106 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 145/285] 10.222.0.49 () {56 vars in 1101 bytes} [Sun Aug 28 00:44:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:38.991429 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea026e3f-149d-48e9-8555-6e898fbaeeae None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:39.124628 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea026e3f-149d-48e9-8555-6e898fbaeeae None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:39.188431 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50700f89-53b7-4dd7-9fcf-524fcac84778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:39.189073 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50700f89-53b7-4dd7-9fcf-524fcac84778 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:39.189357 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50700f89-53b7-4dd7-9fcf-524fcac84778 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:39.189635 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50700f89-53b7-4dd7-9fcf-524fcac84778 None admin] PATH_INFO: `/v3/users/8a080d1aeb354e5dbbcc7a4cc43ee391` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:39.190893 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50700f89-53b7-4dd7-9fcf-524fcac84778 None admin] RBAC: Authorizing `identity:get_user(user_id=8a080d1aeb354e5dbbcc7a4cc43ee391)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:39.192412 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50700f89-53b7-4dd7-9fcf-524fcac84778 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:39.194371 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 141/286] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 28 00:44:38 2022] GET /identity/v3/users/8a080d1aeb354e5dbbcc7a4cc43ee391 => generated 297 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:39.199832 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc77a6e-d442-4127-8afe-b0a9f7bfbb04 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:39.306868 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:39.311221 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc77a6e-d442-4127-8afe-b0a9f7bfbb04 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:39.348186 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e08433-7d08-45a7-bb04-52d7ecba273e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:39.349217 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e08433-7d08-45a7-bb04-52d7ecba273e None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:39.349689 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e08433-7d08-45a7-bb04-52d7ecba273e None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:39.350202 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e08433-7d08-45a7-bb04-52d7ecba273e None admin] PATH_INFO: `/v3/projects/8dc5332abd014a54adc53ca64239c322` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:39.351732 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e08433-7d08-45a7-bb04-52d7ecba273e None admin] RBAC: Authorizing `identity:get_project(project_id=8dc5332abd014a54adc53ca64239c322)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:39.353544 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e08433-7d08-45a7-bb04-52d7ecba273e None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:39.356034 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 146/287] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 28 00:44:39 2022] GET /identity/v3/projects/8dc5332abd014a54adc53ca64239c322 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:39.361910 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50700f89-53b7-4dd7-9fcf-524fcac84778 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:39.378682 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e08433-7d08-45a7-bb04-52d7ecba273e None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:39.471919 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:39.483859 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e08433-7d08-45a7-bb04-52d7ecba273e None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:39.519297 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac9461-c0a3-4374-a13b-6b91736fec68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:39.519969 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac9461-c0a3-4374-a13b-6b91736fec68 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:39.520246 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac9461-c0a3-4374-a13b-6b91736fec68 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:39.520515 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dac9461-c0a3-4374-a13b-6b91736fec68 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:39.545904 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dac9461-c0a3-4374-a13b-6b91736fec68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:44:39.551260 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-0dac9461-c0a3-4374-a13b-6b91736fec68 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:44:39.551260 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:44:39.551260 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:44:39.551260 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:44:39.551260 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:44:39.551260 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:44:39.551260 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:44:39.551260 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:44:39.551260 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:44:39.551260 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:44:39.551260 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:44:39.551260 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:44:39.551260 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:44:39.551260 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:44:39.551260 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:44:39.551260 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:44:39.552175 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:44:39.552175 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:44:39.552175 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:44:39.552175 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:44:39.552175 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:44:39.552175 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:44:39.552175 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:44:39.552175 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:44:39.552175 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:44:39.552175 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:44:39.552175 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:44:39.552175 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:44:39.552175 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:44:39.552175 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:44:39.552175 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:44:39.552175 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:44:39.552971 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:44:39.552971 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:44:39.552971 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:44:39.552971 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:44:39.552971 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:44:39.552971 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:44:39.552971 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:44:39.552971 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:44:39.552971 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:44:39.552971 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:44:39.552971 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:44:39.552971 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:44:39.552971 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 147/288] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 28 00:44:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:44:39.558599 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac9461-c0a3-4374-a13b-6b91736fec68 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:39.576047 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50700f89-53b7-4dd7-9fcf-524fcac84778 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:39.587282 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:39.611482 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e25e1e6-e5c5-440e-87fb-c9d37b13f91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:39.612507 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25e1e6-e5c5-440e-87fb-c9d37b13f91d None admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:39.612960 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25e1e6-e5c5-440e-87fb-c9d37b13f91d None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:39.613396 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25e1e6-e5c5-440e-87fb-c9d37b13f91d None admin] PATH_INFO: `/v3/projects/8dc5332abd014a54adc53ca64239c322/users/8a080d1aeb354e5dbbcc7a4cc43ee391/roles/708b4012bb2645b6aa4af9606988ce56` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:39.615612 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e25e1e6-e5c5-440e-87fb-c9d37b13f91d None admin] RBAC: Authorizing `identity:create_grant(project_id=8dc5332abd014a54adc53ca64239c322, user_id=8a080d1aeb354e5dbbcc7a4cc43ee391, role_id=708b4012bb2645b6aa4af9606988ce56)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:39.617592 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e25e1e6-e5c5-440e-87fb-c9d37b13f91d None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:39.651001 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 142/289] 10.222.0.49 () {58 vars in 1439 bytes} [Sun Aug 28 00:44:39 2022] PUT /identity/v3/projects/8dc5332abd014a54adc53ca64239c322/users/8a080d1aeb354e5dbbcc7a4cc43ee391/roles/708b4012bb2645b6aa4af9606988ce56 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:44:39.667644 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dac9461-c0a3-4374-a13b-6b91736fec68 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:39.704989 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16348009-93d3-45fb-adce-c60cdc368789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:39.705952 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16348009-93d3-45fb-adce-c60cdc368789 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:39.706231 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16348009-93d3-45fb-adce-c60cdc368789 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:39.706497 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16348009-93d3-45fb-adce-c60cdc368789 None admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:39.707194 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16348009-93d3-45fb-adce-c60cdc368789 None admin] RBAC: Adding query filter params (name=member) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:39.707494 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16348009-93d3-45fb-adce-c60cdc368789 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:39.709005 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16348009-93d3-45fb-adce-c60cdc368789 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:39.729956 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 148/290] 10.222.0.49 () {56 vars in 1101 bytes} [Sun Aug 28 00:44:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:39.740890 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e25e1e6-e5c5-440e-87fb-c9d37b13f91d None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:39.909654 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e25e1e6-e5c5-440e-87fb-c9d37b13f91d None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:39.912892 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:39.952079 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221d2671-7bf9-4a9e-8d9f-2a43886ce8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:39.952735 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d2671-7bf9-4a9e-8d9f-2a43886ce8aa None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:39.953020 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d2671-7bf9-4a9e-8d9f-2a43886ce8aa None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:39.953287 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d2671-7bf9-4a9e-8d9f-2a43886ce8aa None admin] PATH_INFO: `/v3/users/b933e37e0ed9461ab0611be07d3e2c9e` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:39.954509 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221d2671-7bf9-4a9e-8d9f-2a43886ce8aa None admin] RBAC: Authorizing `identity:get_user(user_id=b933e37e0ed9461ab0611be07d3e2c9e)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:39.956375 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221d2671-7bf9-4a9e-8d9f-2a43886ce8aa None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:39.958032 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 143/291] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 28 00:44:39 2022] GET /identity/v3/users/b933e37e0ed9461ab0611be07d3e2c9e => generated 297 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:39.964264 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16348009-93d3-45fb-adce-c60cdc368789 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:40.084996 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:40.097023 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16348009-93d3-45fb-adce-c60cdc368789 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:40.140494 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154d70b8-4ffb-4f1c-a2ca-2abb24e9cfaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:40.141116 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d70b8-4ffb-4f1c-a2ca-2abb24e9cfaa None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:40.141393 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d70b8-4ffb-4f1c-a2ca-2abb24e9cfaa None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:40.141713 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d70b8-4ffb-4f1c-a2ca-2abb24e9cfaa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:40.215518 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154d70b8-4ffb-4f1c-a2ca-2abb24e9cfaa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:40.217762 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154d70b8-4ffb-4f1c-a2ca-2abb24e9cfaa None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:40.306350 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:40.323266 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 149/292] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 28 00:44:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:44:40.329385 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221d2671-7bf9-4a9e-8d9f-2a43886ce8aa None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:40.468302 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221d2671-7bf9-4a9e-8d9f-2a43886ce8aa None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:40.524117 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b520d2-1dbd-4663-be26-d1db89197e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:40.525194 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b520d2-1dbd-4663-be26-d1db89197e96 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:40.525670 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b520d2-1dbd-4663-be26-d1db89197e96 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:40.526145 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b520d2-1dbd-4663-be26-d1db89197e96 None admin] PATH_INFO: `/v3/projects/8dc5332abd014a54adc53ca64239c322` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:40.527684 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b520d2-1dbd-4663-be26-d1db89197e96 None admin] RBAC: Authorizing `identity:get_project(project_id=8dc5332abd014a54adc53ca64239c322)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:40.529524 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b520d2-1dbd-4663-be26-d1db89197e96 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:40.535829 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 144/293] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 28 00:44:40 2022] GET /identity/v3/projects/8dc5332abd014a54adc53ca64239c322 => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:40.538887 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154d70b8-4ffb-4f1c-a2ca-2abb24e9cfaa None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:40.644630 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac53dd7-6573-469e-b8f9-da27c9a2b80b None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:40.645271 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac53dd7-6573-469e-b8f9-da27c9a2b80b None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:40.645736 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac53dd7-6573-469e-b8f9-da27c9a2b80b None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:40.647749 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 145/294] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:44:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:44:40.653756 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044045e-742c-4148-bc04-b95191e6043d None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:40.654059 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044045e-742c-4148-bc04-b95191e6043d None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:40.654304 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044045e-742c-4148-bc04-b95191e6043d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:40.672321 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154d70b8-4ffb-4f1c-a2ca-2abb24e9cfaa None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:40.673923 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-0044045e-742c-4148-bc04-b95191e6043d None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:44:40.675247 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-0044045e-742c-4148-bc04-b95191e6043d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:44:40.745907 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cbed3c-dfdd-431e-8311-6acac8b2cc20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:40.746605 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cbed3c-dfdd-431e-8311-6acac8b2cc20 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:40.746862 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cbed3c-dfdd-431e-8311-6acac8b2cc20 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:40.747128 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cbed3c-dfdd-431e-8311-6acac8b2cc20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:40.747903 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cbed3c-dfdd-431e-8311-6acac8b2cc20 None admin] RBAC: Adding query filter params (role.id=7ac2391cc85a4d138e95e27cd0d09b26, scope.project.id=8dc5332abd014a54adc53ca64239c322, user.id=b933e37e0ed9461ab0611be07d3e2c9e) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:40.748090 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:40.748240 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cbed3c-dfdd-431e-8311-6acac8b2cc20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:40.749694 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cbed3c-dfdd-431e-8311-6acac8b2cc20 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:40.762983 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 150/295] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 28 00:44:40 2022] GET /identity/v3/role_assignments?user.id=b933e37e0ed9461ab0611be07d3e2c9e&scope.project.id=8dc5332abd014a54adc53ca64239c322&role.id=7ac2391cc85a4d138e95e27cd0d09b26 => generated 608 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:40.813606 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 146/296] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:44:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:44:41.048031 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd252a78-3886-40eb-a9f5-19e7a13c93d7 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:41.048903 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd252a78-3886-40eb-a9f5-19e7a13c93d7 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:41.049609 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd252a78-3886-40eb-a9f5-19e7a13c93d7 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:41.054851 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 151/297] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:44:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:44:41.059018 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b8640-fa15-44f7-907f-845bcda3afa0 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:41.059837 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b8640-fa15-44f7-907f-845bcda3afa0 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:41.060438 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b8640-fa15-44f7-907f-845bcda3afa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:41.092009 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-4d1b8640-fa15-44f7-907f-845bcda3afa0 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:44:41.093613 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-4d1b8640-fa15-44f7-907f-845bcda3afa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:44:41.126941 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412e4ad-47b9-40f6-8851-0820d1eed95e None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:41.126941 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412e4ad-47b9-40f6-8851-0820d1eed95e None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:41.126941 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412e4ad-47b9-40f6-8851-0820d1eed95e None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:41.127740 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 152/298] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:44:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:44:41.133440 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a8fcc-11b9-450a-a427-b8da7c59bfb2 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:41.133746 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a8fcc-11b9-450a-a427-b8da7c59bfb2 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:41.134001 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a8fcc-11b9-450a-a427-b8da7c59bfb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:41.165696 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-d25a8fcc-11b9-450a-a427-b8da7c59bfb2 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:44:41.166929 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-d25a8fcc-11b9-450a-a427-b8da7c59bfb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:44:41.211809 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 147/299] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:44:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:44:41.221719 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1b8640-fa15-44f7-907f-845bcda3afa0 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:41.235973 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:41.269243 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 153/300] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:44:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:44:41.347752 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:41.352398 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1b8640-fa15-44f7-907f-845bcda3afa0 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:41.394845 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf13902-8158-4364-9818-4b1197c740af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:41.395485 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf13902-8158-4364-9818-4b1197c740af None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:41.395789 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf13902-8158-4364-9818-4b1197c740af None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:41.396062 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf13902-8158-4364-9818-4b1197c740af None admin] PATH_INFO: `/v3/roles/member` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:41.407206 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf13902-8158-4364-9818-4b1197c740af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:44:41.412150 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-6bf13902-8158-4364-9818-4b1197c740af None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:44:41.412150 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:44:41.412150 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:44:41.412150 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:44:41.412150 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:44:41.412150 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:44:41.412150 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:44:41.412150 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:44:41.412150 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:44:41.412150 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:44:41.412150 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:44:41.412150 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:44:41.412150 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:44:41.412150 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:44:41.412150 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:44:41.412150 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:44:41.413035 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:44:41.413035 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:44:41.413035 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:44:41.413035 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:44:41.413035 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:44:41.413035 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:44:41.413035 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:44:41.413035 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:44:41.413035 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:44:41.413035 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:44:41.413035 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:44:41.413035 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:44:41.413035 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:44:41.413035 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:44:41.413035 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:44:41.413035 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:44:41.413829 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:44:41.413829 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:44:41.413829 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:44:41.413829 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:44:41.413829 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:44:41.413829 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:44:41.413829 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:44:41.413829 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:44:41.413829 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:44:41.413829 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:44:41.413829 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:44:41.413829 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:44:41.413829 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 148/301] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 28 00:44:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:44:41.419302 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25a8fcc-11b9-450a-a427-b8da7c59bfb2 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:41.495056 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf13902-8158-4364-9818-4b1197c740af None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:41.529681 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25a8fcc-11b9-450a-a427-b8da7c59bfb2 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:41.573122 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be6b2b8-1547-443c-a8c0-c58e339b627e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:41.573748 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6b2b8-1547-443c-a8c0-c58e339b627e None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:41.574026 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6b2b8-1547-443c-a8c0-c58e339b627e None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:41.574460 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6b2b8-1547-443c-a8c0-c58e339b627e None admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:41.575138 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be6b2b8-1547-443c-a8c0-c58e339b627e None admin] RBAC: Adding query filter params (name=member) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:41.575549 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be6b2b8-1547-443c-a8c0-c58e339b627e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:41.577071 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be6b2b8-1547-443c-a8c0-c58e339b627e None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:41.592215 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 154/302] 10.222.0.49 () {56 vars in 1101 bytes} [Sun Aug 28 00:44:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:41.592215 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be6b2b8-1547-443c-a8c0-c58e339b627e None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:41.619754 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf13902-8158-4364-9818-4b1197c740af None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:41.652945 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:41.659973 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f66be6-1e37-4c64-bbb4-7dfdda6cb48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:41.660672 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f66be6-1e37-4c64-bbb4-7dfdda6cb48f None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:41.661088 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f66be6-1e37-4c64-bbb4-7dfdda6cb48f None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:41.661358 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f66be6-1e37-4c64-bbb4-7dfdda6cb48f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:41.662514 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f66be6-1e37-4c64-bbb4-7dfdda6cb48f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:41.664182 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f66be6-1e37-4c64-bbb4-7dfdda6cb48f None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:41.670543 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 149/303] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:44:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:44:41.671456 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f66be6-1e37-4c64-bbb4-7dfdda6cb48f None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:41.713153 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:41.715835 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be6b2b8-1547-443c-a8c0-c58e339b627e None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:41.764378 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a270044f-8e4b-4012-9392-8ea7dcc9b2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:41.765318 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270044f-8e4b-4012-9392-8ea7dcc9b2ff None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:41.765799 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270044f-8e4b-4012-9392-8ea7dcc9b2ff None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:41.766262 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270044f-8e4b-4012-9392-8ea7dcc9b2ff None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:41.785867 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a270044f-8e4b-4012-9392-8ea7dcc9b2ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:44:41.791357 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-a270044f-8e4b-4012-9392-8ea7dcc9b2ff None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 00:44:41.791357 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:44:41.791357 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:44:41.791357 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:44:41.791357 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:44:41.791357 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:44:41.791357 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:44:41.791357 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:44:41.791357 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:44:41.791357 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:44:41.791357 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:44:41.791357 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:44:41.791357 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:44:41.791357 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:44:41.791357 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:44:41.791357 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:44:41.792329 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:44:41.792329 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:44:41.792329 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:44:41.792329 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:44:41.792329 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:44:41.792329 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:44:41.792329 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:44:41.792329 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:44:41.792329 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:44:41.792329 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:44:41.792329 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:44:41.792329 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:44:41.792329 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:44:41.792329 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:44:41.792329 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:44:41.792329 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:44:41.793222 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:44:41.793222 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:44:41.793222 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:44:41.793222 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:44:41.793222 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:44:41.793222 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:44:41.793222 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:44:41.793222 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:44:41.793222 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:44:41.793222 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:44:41.793222 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 00:44:41.793222 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:44:41.793222 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 155/304] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 28 00:44:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:44:41.793954 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a270044f-8e4b-4012-9392-8ea7dcc9b2ff None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:41.817423 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f66be6-1e37-4c64-bbb4-7dfdda6cb48f None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:41.855084 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e6eff-be22-4417-90a0-844b55be6f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:41.855855 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e6eff-be22-4417-90a0-844b55be6f9d None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:41.856134 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e6eff-be22-4417-90a0-844b55be6f9d None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:41.856405 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e6eff-be22-4417-90a0-844b55be6f9d None admin] PATH_INFO: `/v3/users/2820d8c5aa944beba55ec1ca1e5536f3` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:41.857560 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00e6eff-be22-4417-90a0-844b55be6f9d None admin] RBAC: Authorizing `identity:get_user(user_id=2820d8c5aa944beba55ec1ca1e5536f3)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:41.859015 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00e6eff-be22-4417-90a0-844b55be6f9d None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:41.865492 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 150/305] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 28 00:44:41 2022] GET /identity/v3/users/2820d8c5aa944beba55ec1ca1e5536f3 => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:41.866383 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e6eff-be22-4417-90a0-844b55be6f9d None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:41.903432 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a270044f-8e4b-4012-9392-8ea7dcc9b2ff None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:41.906571 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:41.941935 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722344c2-1f8e-48a8-baa1-76e5e4576bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:41.942547 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722344c2-1f8e-48a8-baa1-76e5e4576bbb None admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:41.942819 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722344c2-1f8e-48a8-baa1-76e5e4576bbb None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:41.943083 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722344c2-1f8e-48a8-baa1-76e5e4576bbb None admin] PATH_INFO: `/v3/groups` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:41.943809 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722344c2-1f8e-48a8-baa1-76e5e4576bbb None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:41.945245 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722344c2-1f8e-48a8-baa1-76e5e4576bbb None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:41.962809 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 156/306] 10.222.0.49 () {60 vars in 1134 bytes} [Sun Aug 28 00:44:41 2022] POST /identity/v3/groups => generated 229 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:44:41.963645 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722344c2-1f8e-48a8-baa1-76e5e4576bbb None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:41.975172 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:41.985540 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e6eff-be22-4417-90a0-844b55be6f9d None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:42.039052 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07385c7-f410-4e15-b1da-a3d804e8ea95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:42.039964 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07385c7-f410-4e15-b1da-a3d804e8ea95 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:42.040389 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07385c7-f410-4e15-b1da-a3d804e8ea95 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:42.040803 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07385c7-f410-4e15-b1da-a3d804e8ea95 None admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:42.041984 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07385c7-f410-4e15-b1da-a3d804e8ea95 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:42.043230 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07385c7-f410-4e15-b1da-a3d804e8ea95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:42.045235 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07385c7-f410-4e15-b1da-a3d804e8ea95 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:42.068632 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 151/307] 10.222.0.49 () {56 vars in 1101 bytes} [Sun Aug 28 00:44:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:42.070180 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07385c7-f410-4e15-b1da-a3d804e8ea95 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:42.094215 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722344c2-1f8e-48a8-baa1-76e5e4576bbb None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:42.139218 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f1346b-718b-4428-bc41-4b87a3a45db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:42.139942 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1346b-718b-4428-bc41-4b87a3a45db9 None admin] REQUEST_METHOD: `PUT` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:42.140225 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1346b-718b-4428-bc41-4b87a3a45db9 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:42.140493 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f1346b-718b-4428-bc41-4b87a3a45db9 None admin] PATH_INFO: `/v3/system/users/2820d8c5aa944beba55ec1ca1e5536f3/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:42.141943 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f1346b-718b-4428-bc41-4b87a3a45db9 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2820d8c5aa944beba55ec1ca1e5536f3, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:42.143335 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f1346b-718b-4428-bc41-4b87a3a45db9 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:42.156474 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 157/308] 10.222.0.49 () {58 vars in 1334 bytes} [Sun Aug 28 00:44:41 2022] PUT /identity/v3/system/users/2820d8c5aa944beba55ec1ca1e5536f3/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:44:42.179339 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf4543-0507-4008-ae78-8e1a409f1d2d None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:42.179712 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf4543-0507-4008-ae78-8e1a409f1d2d None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:42.179936 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf4543-0507-4008-ae78-8e1a409f1d2d None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:42.182110 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 158/309] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:44:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:44:42.189240 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8bedb8-109d-4363-8f58-3e6bc653fe5f None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:42.189561 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8bedb8-109d-4363-8f58-3e6bc653fe5f None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:42.189779 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8bedb8-109d-4363-8f58-3e6bc653fe5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:42.215207 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-5c8bedb8-109d-4363-8f58-3e6bc653fe5f None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:44:42.217372 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-5c8bedb8-109d-4363-8f58-3e6bc653fe5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:44:42.225178 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07385c7-f410-4e15-b1da-a3d804e8ea95 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:42.251883 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:42.272295 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4f3dfa-bb0b-4780-b1e1-47cd5d183606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:42.273311 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f3dfa-bb0b-4780-b1e1-47cd5d183606 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:42.273734 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f3dfa-bb0b-4780-b1e1-47cd5d183606 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:42.274151 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f3dfa-bb0b-4780-b1e1-47cd5d183606 None admin] PATH_INFO: `/v3/users/cdabc99440654d34a3f5280e610296cb` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:42.293112 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4f3dfa-bb0b-4780-b1e1-47cd5d183606 None admin] RBAC: Authorizing `identity:get_user(user_id=cdabc99440654d34a3f5280e610296cb)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:42.294620 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4f3dfa-bb0b-4780-b1e1-47cd5d183606 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:42.297656 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 152/310] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 28 00:44:42 2022] GET /identity/v3/users/cdabc99440654d34a3f5280e610296cb => generated 293 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:42.304028 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4f3dfa-bb0b-4780-b1e1-47cd5d183606 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:42.316035 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 159/311] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:44:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:44:42.326402 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:42.424510 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4f3dfa-bb0b-4780-b1e1-47cd5d183606 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:42.467511 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39cdf5a-1be9-41bc-8c3b-df6d1d002177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:42.468425 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39cdf5a-1be9-41bc-8c3b-df6d1d002177 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:42.468838 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39cdf5a-1be9-41bc-8c3b-df6d1d002177 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:42.469239 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39cdf5a-1be9-41bc-8c3b-df6d1d002177 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:42.470106 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39cdf5a-1be9-41bc-8c3b-df6d1d002177 None admin] RBAC: Adding query filter params (role.id=708b4012bb2645b6aa4af9606988ce56, user.id=cdabc99440654d34a3f5280e610296cb, scope.system=all) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:42.470561 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39cdf5a-1be9-41bc-8c3b-df6d1d002177 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:42.472218 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39cdf5a-1be9-41bc-8c3b-df6d1d002177 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:42.478324 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 153/312] 10.222.0.49 () {56 vars in 1308 bytes} [Sun Aug 28 00:44:42 2022] GET /identity/v3/role_assignments?user.id=cdabc99440654d34a3f5280e610296cb&scope.system=all&role.id=708b4012bb2645b6aa4af9606988ce56 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:44:42.581663 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8bedb8-109d-4363-8f58-3e6bc653fe5f None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:42.691872 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8bedb8-109d-4363-8f58-3e6bc653fe5f None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:42.726510 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1cb8af-1da7-4e87-954b-3e349a5e5ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:42.726762 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1cb8af-1da7-4e87-954b-3e349a5e5ce2 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:42.727035 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1cb8af-1da7-4e87-954b-3e349a5e5ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:42.727296 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1cb8af-1da7-4e87-954b-3e349a5e5ce2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:42.738099 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1cb8af-1da7-4e87-954b-3e349a5e5ce2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:44:42.743204 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-3f1cb8af-1da7-4e87-954b-3e349a5e5ce2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 00:44:42.743204 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:44:42.743204 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:44:42.743204 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:44:42.743204 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:44:42.743204 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:44:42.743204 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:44:42.743204 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:44:42.743204 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:44:42.743204 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:44:42.743204 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:44:42.743204 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:44:42.743204 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:44:42.743204 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:44:42.743204 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:44:42.743204 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:44:42.744298 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:44:42.744298 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:44:42.744298 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:44:42.744298 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:44:42.744298 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:44:42.744298 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:44:42.744298 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:44:42.744298 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:44:42.744298 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:44:42.744298 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:44:42.744298 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:44:42.744298 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:44:42.744298 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:44:42.744298 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:44:42.744298 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:44:42.744298 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:44:42.745203 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:44:42.745203 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:44:42.745203 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:44:42.745203 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:44:42.745203 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:44:42.745203 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:44:42.745203 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:44:42.745203 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:44:42.745203 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:44:42.745203 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:44:42.745203 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 00:44:42.745203 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:44:42.745203 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 160/313] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 28 00:44:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:44:42.750424 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39cdf5a-1be9-41bc-8c3b-df6d1d002177 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:42.835449 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:42.855954 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39cdf5a-1be9-41bc-8c3b-df6d1d002177 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:42.892281 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ee6e77-c571-4655-9f88-fd0ef3c43f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:42.893236 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee6e77-c571-4655-9f88-fd0ef3c43f06 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:42.893510 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee6e77-c571-4655-9f88-fd0ef3c43f06 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:42.893776 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee6e77-c571-4655-9f88-fd0ef3c43f06 None admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:42.894445 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ee6e77-c571-4655-9f88-fd0ef3c43f06 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:42.894740 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ee6e77-c571-4655-9f88-fd0ef3c43f06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:42.896155 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ee6e77-c571-4655-9f88-fd0ef3c43f06 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:42.905302 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 154/314] 10.222.0.49 () {56 vars in 1101 bytes} [Sun Aug 28 00:44:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:42.910787 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1cb8af-1da7-4e87-954b-3e349a5e5ce2 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:42.934589 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:43.017495 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1cb8af-1da7-4e87-954b-3e349a5e5ce2 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:43.052463 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00091310-59e7-44fc-8f27-0ac797c920d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:43.053109 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00091310-59e7-44fc-8f27-0ac797c920d3 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:43.053387 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00091310-59e7-44fc-8f27-0ac797c920d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:43.053658 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00091310-59e7-44fc-8f27-0ac797c920d3 None admin] PATH_INFO: `/v3/users/8a080d1aeb354e5dbbcc7a4cc43ee391` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:43.054811 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00091310-59e7-44fc-8f27-0ac797c920d3 None admin] RBAC: Authorizing `identity:get_user(user_id=8a080d1aeb354e5dbbcc7a4cc43ee391)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:43.056302 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00091310-59e7-44fc-8f27-0ac797c920d3 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:43.058297 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 161/315] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 28 00:44:42 2022] GET /identity/v3/users/8a080d1aeb354e5dbbcc7a4cc43ee391 => generated 297 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:43.063870 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ee6e77-c571-4655-9f88-fd0ef3c43f06 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:43.174854 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ee6e77-c571-4655-9f88-fd0ef3c43f06 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:43.209413 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85f5f00-85e6-4843-9b30-d85fa12e5e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:43.210016 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f5f00-85e6-4843-9b30-d85fa12e5e75 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:43.210294 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f5f00-85e6-4843-9b30-d85fa12e5e75 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:43.210561 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f5f00-85e6-4843-9b30-d85fa12e5e75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:43.223005 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:43.282374 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85f5f00-85e6-4843-9b30-d85fa12e5e75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:43.283832 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85f5f00-85e6-4843-9b30-d85fa12e5e75 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:43.386425 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 155/316] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 28 00:44:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:44:43.392219 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00091310-59e7-44fc-8f27-0ac797c920d3 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:43.480238 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:43.494816 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00091310-59e7-44fc-8f27-0ac797c920d3 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:43.529995 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc299d-7d53-4b8e-a52c-a4ee68de0d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:43.530682 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc299d-7d53-4b8e-a52c-a4ee68de0d0f None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:43.530968 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc299d-7d53-4b8e-a52c-a4ee68de0d0f None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:43.531241 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc299d-7d53-4b8e-a52c-a4ee68de0d0f None admin] PATH_INFO: `/v3/projects/8dc5332abd014a54adc53ca64239c322` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:43.532460 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bc299d-7d53-4b8e-a52c-a4ee68de0d0f None admin] RBAC: Authorizing `identity:get_project(project_id=8dc5332abd014a54adc53ca64239c322)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:43.533860 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bc299d-7d53-4b8e-a52c-a4ee68de0d0f None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:43.535841 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 162/317] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 28 00:44:43 2022] GET /identity/v3/projects/8dc5332abd014a54adc53ca64239c322 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:43.541360 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85f5f00-85e6-4843-9b30-d85fa12e5e75 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:43.586578 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:43.645145 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85f5f00-85e6-4843-9b30-d85fa12e5e75 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:43.680259 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2e26c8-8217-4f3c-a110-1f18896bcc42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:43.680863 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2e26c8-8217-4f3c-a110-1f18896bcc42 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:43.681135 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2e26c8-8217-4f3c-a110-1f18896bcc42 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:43.681401 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2e26c8-8217-4f3c-a110-1f18896bcc42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:43.682123 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2e26c8-8217-4f3c-a110-1f18896bcc42 None admin] RBAC: Adding query filter params (role.id=708b4012bb2645b6aa4af9606988ce56, scope.project.id=8dc5332abd014a54adc53ca64239c322, user.id=8a080d1aeb354e5dbbcc7a4cc43ee391) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:43.682424 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2e26c8-8217-4f3c-a110-1f18896bcc42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:43.683950 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2e26c8-8217-4f3c-a110-1f18896bcc42 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:43.690299 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 156/318] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 28 00:44:43 2022] GET /identity/v3/role_assignments?user.id=8a080d1aeb354e5dbbcc7a4cc43ee391&scope.project.id=8dc5332abd014a54adc53ca64239c322&role.id=708b4012bb2645b6aa4af9606988ce56 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:43.956649 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d0cba-9d86-44d8-9084-25c43d8fbf14 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:43.956851 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d0cba-9d86-44d8-9084-25c43d8fbf14 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:43.957115 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d0cba-9d86-44d8-9084-25c43d8fbf14 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:43.958569 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 163/319] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:44:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:44:43.963714 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1fcbbb-c23e-4fc6-897f-d3e24f934ec4 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:43.963999 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1fcbbb-c23e-4fc6-897f-d3e24f934ec4 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:43.964258 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1fcbbb-c23e-4fc6-897f-d3e24f934ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:43.982487 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-7d1fcbbb-c23e-4fc6-897f-d3e24f934ec4 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:44:43.983648 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-7d1fcbbb-c23e-4fc6-897f-d3e24f934ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:44:44.052314 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 157/320] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:44:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:44:44.255748 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037c9c2-ee1f-40dd-8946-f8dbda2695fd None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:44.256007 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037c9c2-ee1f-40dd-8946-f8dbda2695fd None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:44.256461 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8037c9c2-ee1f-40dd-8946-f8dbda2695fd None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:44.257905 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 164/321] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:44:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:44:44.263310 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e676eee9-758b-4a39-83c8-a7dcc3304fdb None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:44.263557 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e676eee9-758b-4a39-83c8-a7dcc3304fdb None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:44.263897 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e676eee9-758b-4a39-83c8-a7dcc3304fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:44.283104 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-e676eee9-758b-4a39-83c8-a7dcc3304fdb None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:44:44.284306 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-e676eee9-758b-4a39-83c8-a7dcc3304fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:44:44.315421 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:44.356083 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8037c9c2-ee1f-40dd-8946-f8dbda2695fd None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:44.358067 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 158/322] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:44:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:44:44.426862 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0231d-f1a6-411f-a2bc-9bb7759c6431 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:44.427171 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0231d-f1a6-411f-a2bc-9bb7759c6431 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:44.427419 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0231d-f1a6-411f-a2bc-9bb7759c6431 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:44.428852 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 159/323] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:44:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:44:44.434164 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58281e02-aa03-48fb-87f0-f8b22072585e None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:44.434465 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58281e02-aa03-48fb-87f0-f8b22072585e None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:44.434712 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58281e02-aa03-48fb-87f0-f8b22072585e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:44.453665 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-58281e02-aa03-48fb-87f0-f8b22072585e None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:44:44.454945 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-58281e02-aa03-48fb-87f0-f8b22072585e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:44:44.473779 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8037c9c2-ee1f-40dd-8946-f8dbda2695fd None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:44.513123 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b034426-63d5-4c13-a45a-9bf38a57dcc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:44.513670 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b034426-63d5-4c13-a45a-9bf38a57dcc7 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:44.513945 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b034426-63d5-4c13-a45a-9bf38a57dcc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:44.514212 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b034426-63d5-4c13-a45a-9bf38a57dcc7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:44.515548 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b034426-63d5-4c13-a45a-9bf38a57dcc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:44.517030 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b034426-63d5-4c13-a45a-9bf38a57dcc7 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:44.518644 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 165/324] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:44:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:44:44.525544 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b034426-63d5-4c13-a45a-9bf38a57dcc7 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:44.536208 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 160/325] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:44:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:44:44.552676 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:44.628433 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58281e02-aa03-48fb-87f0-f8b22072585e None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:44.636163 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b034426-63d5-4c13-a45a-9bf38a57dcc7 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:44.676313 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19124d29-e085-446f-967e-d4690a710d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:44.677236 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19124d29-e085-446f-967e-d4690a710d03 None admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:44.677509 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19124d29-e085-446f-967e-d4690a710d03 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:44.677777 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19124d29-e085-446f-967e-d4690a710d03 None admin] PATH_INFO: `/v3/groups` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:44.678432 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19124d29-e085-446f-967e-d4690a710d03 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:44.679934 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19124d29-e085-446f-967e-d4690a710d03 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:44.699578 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 166/326] 10.222.0.49 () {60 vars in 1134 bytes} [Sun Aug 28 00:44:44 2022] POST /identity/v3/groups => generated 226 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:44:44.754216 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:44.761756 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58281e02-aa03-48fb-87f0-f8b22072585e None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:44.806952 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d843ef83-b0e1-4683-a0cb-e94d52965762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:44.807523 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843ef83-b0e1-4683-a0cb-e94d52965762 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:44.807834 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843ef83-b0e1-4683-a0cb-e94d52965762 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:44.808104 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843ef83-b0e1-4683-a0cb-e94d52965762 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:44.810730 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19124d29-e085-446f-967e-d4690a710d03 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:44.823838 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d843ef83-b0e1-4683-a0cb-e94d52965762 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:44:44.829110 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-d843ef83-b0e1-4683-a0cb-e94d52965762 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:44:44.829110 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:44:44.829110 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:44:44.829110 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:44:44.829110 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:44:44.829110 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:44:44.829110 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:44:44.829110 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:44:44.829110 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:44:44.829110 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:44:44.829110 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:44:44.829110 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:44:44.829110 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:44:44.829110 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:44:44.829110 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:44:44.829110 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:44:44.830098 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:44:44.830098 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:44:44.830098 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:44:44.830098 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:44:44.830098 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:44:44.830098 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:44:44.830098 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:44:44.830098 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:44:44.830098 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:44:44.830098 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:44:44.830098 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:44:44.830098 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:44:44.830098 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:44:44.830098 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:44:44.830098 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:44:44.830098 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:44:44.831195 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:44:44.831195 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:44:44.831195 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:44:44.831195 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:44:44.831195 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:44:44.831195 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:44:44.831195 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:44:44.831195 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:44:44.831195 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:44:44.831195 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:44:44.831195 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:44:44.831195 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:44:44.831195 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 161/327] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 28 00:44:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:44:44.838467 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d843ef83-b0e1-4683-a0cb-e94d52965762 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:44.925778 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:44.960615 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19124d29-e085-446f-967e-d4690a710d03 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:44.969628 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d843ef83-b0e1-4683-a0cb-e94d52965762 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:45.012080 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27dd7e7-0896-4518-b940-d67e820dbc4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:45.018878 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27dd7e7-0896-4518-b940-d67e820dbc4f None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:45.019226 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27dd7e7-0896-4518-b940-d67e820dbc4f None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:45.019492 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27dd7e7-0896-4518-b940-d67e820dbc4f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:45.022165 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad041f9-aa93-467d-8977-856671ce716e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:45.022967 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad041f9-aa93-467d-8977-856671ce716e None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:45.023247 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad041f9-aa93-467d-8977-856671ce716e None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:45.023568 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad041f9-aa93-467d-8977-856671ce716e None admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:45.024303 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad041f9-aa93-467d-8977-856671ce716e None admin] RBAC: Adding query filter params (name=member) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:45.024608 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad041f9-aa93-467d-8977-856671ce716e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:45.026045 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad041f9-aa93-467d-8977-856671ce716e None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:45.035793 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27dd7e7-0896-4518-b940-d67e820dbc4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:44:45.036988 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 162/328] 10.222.0.49 () {56 vars in 1101 bytes} [Sun Aug 28 00:44:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:45.041321 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-e27dd7e7-0896-4518-b940-d67e820dbc4f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 00:44:45.041321 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:44:45.041321 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:44:45.041321 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:44:45.041321 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:44:45.041321 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:44:45.041321 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:44:45.041321 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:44:45.041321 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:44:45.041321 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:44:45.041321 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:44:45.041321 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:44:45.041321 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:44:45.041321 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:44:45.041321 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:44:45.041321 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:44:45.042570 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:44:45.042570 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:44:45.042570 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:44:45.042570 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:44:45.042570 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:44:45.042570 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:44:45.042570 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:44:45.042570 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:44:45.042570 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:44:45.042570 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:44:45.042570 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:44:45.042570 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:44:45.042570 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:44:45.042570 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:44:45.042570 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:44:45.042570 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:44:45.043992 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:44:45.043992 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:44:45.043992 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:44:45.043992 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:44:45.043992 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:44:45.043992 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:44:45.043992 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:44:45.043992 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:44:45.043992 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:44:45.043992 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:44:45.043992 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 00:44:45.043992 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:44:45.043992 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 167/329] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 28 00:44:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:44:45.044665 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad041f9-aa93-467d-8977-856671ce716e None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:45.052754 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27dd7e7-0896-4518-b940-d67e820dbc4f None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:45.077159 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:45.191855 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad041f9-aa93-467d-8977-856671ce716e None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:45.192432 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27dd7e7-0896-4518-b940-d67e820dbc4f None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:45.236789 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa12e15-5670-4599-a6d5-92579908f797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:45.236789 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa12e15-5670-4599-a6d5-92579908f797 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:45.237092 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa12e15-5670-4599-a6d5-92579908f797 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:45.237326 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa12e15-5670-4599-a6d5-92579908f797 None admin] PATH_INFO: `/v3/users/2820d8c5aa944beba55ec1ca1e5536f3` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:45.238495 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa12e15-5670-4599-a6d5-92579908f797 None admin] RBAC: Authorizing `identity:get_user(user_id=2820d8c5aa944beba55ec1ca1e5536f3)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:45.240225 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa12e15-5670-4599-a6d5-92579908f797 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:45.240849 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d7608-6059-4f1c-997d-39fc439f31b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:45.241692 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d7608-6059-4f1c-997d-39fc439f31b9 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:45.242164 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 163/330] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 28 00:44:45 2022] GET /identity/v3/users/2820d8c5aa944beba55ec1ca1e5536f3 => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:45.242266 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d7608-6059-4f1c-997d-39fc439f31b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:45.242719 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d7608-6059-4f1c-997d-39fc439f31b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:45.243652 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00d7608-6059-4f1c-997d-39fc439f31b9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:45.244114 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00d7608-6059-4f1c-997d-39fc439f31b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:45.245677 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00d7608-6059-4f1c-997d-39fc439f31b9 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:45.248276 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa12e15-5670-4599-a6d5-92579908f797 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:45.256574 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 168/331] 10.222.0.49 () {56 vars in 1101 bytes} [Sun Aug 28 00:44:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:44:45.263205 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d7608-6059-4f1c-997d-39fc439f31b9 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:45.268471 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:45.374343 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:45.398067 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa12e15-5670-4599-a6d5-92579908f797 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:45.411439 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d7608-6059-4f1c-997d-39fc439f31b9 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:45.445140 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff38a50-b270-4ff8-a50b-af49170f3970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:45.446154 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff38a50-b270-4ff8-a50b-af49170f3970 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:45.446709 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff38a50-b270-4ff8-a50b-af49170f3970 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:45.447002 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff38a50-b270-4ff8-a50b-af49170f3970 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:45.447770 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff38a50-b270-4ff8-a50b-af49170f3970 None admin] RBAC: Adding query filter params (role.id=7ac2391cc85a4d138e95e27cd0d09b26, user.id=2820d8c5aa944beba55ec1ca1e5536f3, scope.system=all) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:45.448076 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff38a50-b270-4ff8-a50b-af49170f3970 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:45.449555 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff38a50-b270-4ff8-a50b-af49170f3970 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:45.454324 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a83c23-a456-48e4-b99c-f00595b702f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:45.455270 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a83c23-a456-48e4-b99c-f00595b702f8 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:45.456162 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a83c23-a456-48e4-b99c-f00595b702f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:45.456629 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a83c23-a456-48e4-b99c-f00595b702f8 None admin] PATH_INFO: `/v3/users/cdabc99440654d34a3f5280e610296cb` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:45.459080 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a83c23-a456-48e4-b99c-f00595b702f8 None admin] RBAC: Authorizing `identity:get_user(user_id=cdabc99440654d34a3f5280e610296cb)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:45.460776 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a83c23-a456-48e4-b99c-f00595b702f8 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:45.462749 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 164/333] 10.222.0.49 () {56 vars in 1308 bytes} [Sun Aug 28 00:44:45 2022] GET /identity/v3/role_assignments?user.id=2820d8c5aa944beba55ec1ca1e5536f3&scope.system=all&role.id=7ac2391cc85a4d138e95e27cd0d09b26 => generated 510 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:44:45.463065 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 169/333] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 28 00:44:45 2022] GET /identity/v3/users/cdabc99440654d34a3f5280e610296cb => generated 293 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:45.468473 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff38a50-b270-4ff8-a50b-af49170f3970 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:45.588361 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff38a50-b270-4ff8-a50b-af49170f3970 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:45.633023 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985874b1-2edd-4508-9ee0-4635bbeb597b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:45.633709 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985874b1-2edd-4508-9ee0-4635bbeb597b None admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:45.633957 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985874b1-2edd-4508-9ee0-4635bbeb597b None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:45.634230 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985874b1-2edd-4508-9ee0-4635bbeb597b None admin] PATH_INFO: `/v3/system/users/cdabc99440654d34a3f5280e610296cb/roles/708b4012bb2645b6aa4af9606988ce56` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:45.635770 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985874b1-2edd-4508-9ee0-4635bbeb597b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=cdabc99440654d34a3f5280e610296cb, role_id=708b4012bb2645b6aa4af9606988ce56)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:45.637240 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985874b1-2edd-4508-9ee0-4635bbeb597b None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:45.648753 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 165/334] 10.222.0.49 () {58 vars in 1334 bytes} [Sun Aug 28 00:44:45 2022] PUT /identity/v3/system/users/cdabc99440654d34a3f5280e610296cb/roles/708b4012bb2645b6aa4af9606988ce56 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:44:47.004508 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ec35a-3d20-4f1c-aa90-50cf9f030cd8 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:47.005526 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ec35a-3d20-4f1c-aa90-50cf9f030cd8 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:47.006021 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25ec35a-3d20-4f1c-aa90-50cf9f030cd8 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:47.007838 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 170/335] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:44:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:44:47.013500 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87324f2-11cc-4133-b08e-4f4b777a98d2 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:47.013922 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87324f2-11cc-4133-b08e-4f4b777a98d2 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:47.014090 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87324f2-11cc-4133-b08e-4f4b777a98d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:47.044890 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-c87324f2-11cc-4133-b08e-4f4b777a98d2 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:44:47.046228 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-c87324f2-11cc-4133-b08e-4f4b777a98d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:44:47.048373 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:47.126540 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 166/336] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:44:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:44:47.283955 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c5774-1b5c-4eaa-ba9c-4df9c1dbef36 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:47.284581 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c5774-1b5c-4eaa-ba9c-4df9c1dbef36 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:47.285050 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c5774-1b5c-4eaa-ba9c-4df9c1dbef36 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:47.286826 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 171/337] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:44:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:44:47.293037 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025d62c-578d-4ce6-aab4-efd8cf9e2669 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:47.293571 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025d62c-578d-4ce6-aab4-efd8cf9e2669 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:47.294044 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025d62c-578d-4ce6-aab4-efd8cf9e2669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:47.313825 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-4025d62c-578d-4ce6-aab4-efd8cf9e2669 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:44:47.315349 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-4025d62c-578d-4ce6-aab4-efd8cf9e2669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:44:47.390064 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 167/338] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:44:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:44:47.666435 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8c5774-1b5c-4eaa-ba9c-4df9c1dbef36 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:47.678675 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025d62c-578d-4ce6-aab4-efd8cf9e2669 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:47.818978 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:47.837785 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:47.881400 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025d62c-578d-4ce6-aab4-efd8cf9e2669 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:47.913503 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8c5774-1b5c-4eaa-ba9c-4df9c1dbef36 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:47.944367 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693fe9db-66e7-4fb7-aefb-1672f85f1e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:47.945399 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fe9db-66e7-4fb7-aefb-1672f85f1e79 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:47.945879 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fe9db-66e7-4fb7-aefb-1672f85f1e79 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:47.946370 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fe9db-66e7-4fb7-aefb-1672f85f1e79 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:47.972309 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693fe9db-66e7-4fb7-aefb-1672f85f1e79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:44:47.977418 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-693fe9db-66e7-4fb7-aefb-1672f85f1e79 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:44:47.977418 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:44:47.977418 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:44:47.977418 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:44:47.977418 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:44:47.977418 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:44:47.977418 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:44:47.977418 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:44:47.977418 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:44:47.977418 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:44:47.977418 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:44:47.977418 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:44:47.977418 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:44:47.977418 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:44:47.977418 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:44:47.977418 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:44:47.978360 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:44:47.978360 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:44:47.978360 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:44:47.978360 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:44:47.978360 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:44:47.978360 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:44:47.978360 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:44:47.978360 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:44:47.978360 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:44:47.978360 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:44:47.978360 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:44:47.978360 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:44:47.978360 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:44:47.978360 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:44:47.978360 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:44:47.978360 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:44:47.979147 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:44:47.979147 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:44:47.979147 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:44:47.979147 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:44:47.979147 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:44:47.979147 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:44:47.979147 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:44:47.979147 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:44:47.979147 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:44:47.979147 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:44:47.979147 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:44:47.979147 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:44:47.979147 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 168/339] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 28 00:44:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:44:47.982769 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565bfa92-1c94-4f48-b8e1-44b4fa0ca64a None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:47.985350 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565bfa92-1c94-4f48-b8e1-44b4fa0ca64a None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:47.986395 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565bfa92-1c94-4f48-b8e1-44b4fa0ca64a None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:47.992172 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b969ac-1d1d-4954-9385-2e7594f54a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:47.992828 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b969ac-1d1d-4954-9385-2e7594f54a59 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:47.993105 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b969ac-1d1d-4954-9385-2e7594f54a59 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:47.993376 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b969ac-1d1d-4954-9385-2e7594f54a59 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:47.993900 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 169/340] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:44:47 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:44:47.994800 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565bfa92-1c94-4f48-b8e1-44b4fa0ca64a None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:48.015782 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b969ac-1d1d-4954-9385-2e7594f54a59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:44:48.023245 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-43b969ac-1d1d-4954-9385-2e7594f54a59 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:44:48.023245 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:44:48.023245 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:44:48.023245 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:44:48.023245 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:44:48.023245 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:44:48.023245 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:44:48.023245 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:44:48.023245 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:44:48.023245 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:44:48.023245 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:44:48.023245 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:44:48.023245 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:44:48.023245 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:44:48.023245 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:44:48.023245 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:44:48.024200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:44:48.024200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:44:48.024200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:44:48.024200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:44:48.024200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:44:48.024200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:44:48.024200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:44:48.024200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:44:48.024200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:44:48.024200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:44:48.024200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:44:48.024200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:44:48.024200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:44:48.024200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:44:48.024200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:44:48.024200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:44:48.024981 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:44:48.024981 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:44:48.024981 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:44:48.024981 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:44:48.024981 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:44:48.024981 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:44:48.024981 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:44:48.024981 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:44:48.024981 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:44:48.024981 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:44:48.024981 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:44:48.024981 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:44:48.026684 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 172/341] 10.222.0.49 () {56 vars in 1114 bytes} [Sun Aug 28 00:44:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:44:48.029109 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317de0dd-800e-4e48-bcd3-a28b7b543f0d None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:48.029391 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317de0dd-800e-4e48-bcd3-a28b7b543f0d None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:48.029665 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317de0dd-800e-4e48-bcd3-a28b7b543f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:48.055611 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-317de0dd-800e-4e48-bcd3-a28b7b543f0d None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:44:48.056974 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-317de0dd-800e-4e48-bcd3-a28b7b543f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:44:48.149570 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565bfa92-1c94-4f48-b8e1-44b4fa0ca64a None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:48.171129 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 173/342] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:44:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:44:48.173824 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb4d46-ad61-4fe3-9b60-51d7c04a56e9 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:48.174166 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb4d46-ad61-4fe3-9b60-51d7c04a56e9 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:48.174391 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb4d46-ad61-4fe3-9b60-51d7c04a56e9 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:48.176061 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 174/343] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:44:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:44:48.176839 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb4d46-ad61-4fe3-9b60-51d7c04a56e9 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:48.195644 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d293fc-7ade-4d22-8ba1-1c482699e8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:48.196485 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d293fc-7ade-4d22-8ba1-1c482699e8b3 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:48.196864 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d293fc-7ade-4d22-8ba1-1c482699e8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:48.197271 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d293fc-7ade-4d22-8ba1-1c482699e8b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:48.198467 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d293fc-7ade-4d22-8ba1-1c482699e8b3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:48.199192 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d293fc-7ade-4d22-8ba1-1c482699e8b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:48.201518 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d293fc-7ade-4d22-8ba1-1c482699e8b3 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:48.216089 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:48.222315 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 170/344] 10.222.0.49 () {56 vars in 1101 bytes} [Sun Aug 28 00:44:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:48.224721 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb4eaac-cbe6-470f-8927-db8a8c121d11 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:48.225016 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb4eaac-cbe6-470f-8927-db8a8c121d11 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:48.225299 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb4eaac-cbe6-470f-8927-db8a8c121d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:48.255049 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-0eb4eaac-cbe6-470f-8927-db8a8c121d11 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:44:48.256874 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-0eb4eaac-cbe6-470f-8927-db8a8c121d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:44:48.262329 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:48.316149 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb4d46-ad61-4fe3-9b60-51d7c04a56e9 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:48.377659 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 171/345] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:44:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:44:48.379161 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb4eaac-cbe6-470f-8927-db8a8c121d11 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:48.388981 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78a2638-edeb-4ff7-af16-474ef26d27ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:48.389611 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a2638-edeb-4ff7-af16-474ef26d27ab None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:48.389945 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a2638-edeb-4ff7-af16-474ef26d27ab None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:48.390463 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78a2638-edeb-4ff7-af16-474ef26d27ab None admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:48.391469 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78a2638-edeb-4ff7-af16-474ef26d27ab None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:48.392011 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78a2638-edeb-4ff7-af16-474ef26d27ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:48.400053 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78a2638-edeb-4ff7-af16-474ef26d27ab None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:48.423732 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 175/346] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 28 00:44:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:48.430478 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78a2638-edeb-4ff7-af16-474ef26d27ab None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:48.722622 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb4eaac-cbe6-470f-8927-db8a8c121d11 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:48.780011 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78a2638-edeb-4ff7-af16-474ef26d27ab None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:48.800236 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:48.831706 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2f0384-2964-4eae-9f5a-f323a39a1acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:48.832352 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f0384-2964-4eae-9f5a-f323a39a1acc None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:48.832632 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f0384-2964-4eae-9f5a-f323a39a1acc None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:48.832901 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f0384-2964-4eae-9f5a-f323a39a1acc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:48.850279 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:48.885024 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0fc2f7-19e2-4fe1-bd07-debdd141708f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:48.886072 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0fc2f7-19e2-4fe1-bd07-debdd141708f None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:48.886646 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0fc2f7-19e2-4fe1-bd07-debdd141708f None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:48.887134 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0fc2f7-19e2-4fe1-bd07-debdd141708f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:48.917160 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2f0384-2964-4eae-9f5a-f323a39a1acc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:48.918759 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2f0384-2964-4eae-9f5a-f323a39a1acc None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:49.023439 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0fc2f7-19e2-4fe1-bd07-debdd141708f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:49.025831 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0fc2f7-19e2-4fe1-bd07-debdd141708f None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:49.030981 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 172/347] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 28 00:44:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 653 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:44:49.031879 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2f0384-2964-4eae-9f5a-f323a39a1acc None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:49.056938 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:49.157877 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2f0384-2964-4eae-9f5a-f323a39a1acc None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:49.205673 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d05b8-a6f8-4942-8129-8a8b8820337c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:49.206351 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d05b8-a6f8-4942-8129-8a8b8820337c None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:49.207134 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d05b8-a6f8-4942-8129-8a8b8820337c None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:49.207410 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d05b8-a6f8-4942-8129-8a8b8820337c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:49.213972 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 176/348] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 28 00:44:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 785 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:44:49.215719 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0fc2f7-19e2-4fe1-bd07-debdd141708f None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:49.235156 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83d05b8-a6f8-4942-8129-8a8b8820337c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:44:49.240298 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-d83d05b8-a6f8-4942-8129-8a8b8820337c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 00:44:49.240298 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:44:49.240298 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:44:49.240298 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:44:49.240298 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:44:49.240298 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:44:49.240298 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:44:49.240298 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:44:49.240298 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:44:49.240298 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:44:49.240298 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:44:49.240298 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:44:49.240298 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:44:49.240298 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:44:49.240298 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:44:49.240298 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:44:49.241309 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:44:49.241309 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:44:49.241309 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:44:49.241309 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:44:49.241309 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:44:49.241309 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:44:49.241309 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:44:49.241309 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:44:49.241309 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:44:49.241309 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:44:49.241309 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:44:49.241309 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:44:49.241309 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:44:49.241309 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:44:49.241309 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:44:49.241309 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:44:49.242117 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:44:49.242117 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:44:49.242117 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:44:49.242117 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:44:49.242117 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:44:49.242117 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:44:49.242117 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:44:49.242117 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:44:49.242117 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:44:49.242117 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:44:49.242117 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 28 00:44:49.242117 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:44:49.242117 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 173/349] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 28 00:44:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:44:49.242793 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d05b8-a6f8-4942-8129-8a8b8820337c None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:49.248639 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:49.340484 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0fc2f7-19e2-4fe1-bd07-debdd141708f None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:49.366909 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:49.397185 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0460aff-3ec6-4066-a537-38040e788fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:49.397584 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d05b8-a6f8-4942-8129-8a8b8820337c None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:49.398393 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0460aff-3ec6-4066-a537-38040e788fc4 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:49.398862 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0460aff-3ec6-4066-a537-38040e788fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:49.400781 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0460aff-3ec6-4066-a537-38040e788fc4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:49.414903 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0460aff-3ec6-4066-a537-38040e788fc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:44:49.420401 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-d0460aff-3ec6-4066-a537-38040e788fc4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:44:49.420401 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:44:49.420401 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:44:49.420401 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:44:49.420401 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:44:49.420401 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:44:49.420401 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:44:49.420401 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:44:49.420401 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:44:49.420401 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:44:49.420401 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:44:49.420401 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:44:49.420401 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:44:49.420401 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:44:49.420401 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:44:49.420401 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:44:49.421379 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:44:49.421379 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:44:49.421379 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:44:49.421379 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:44:49.421379 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:44:49.421379 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:44:49.421379 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:44:49.421379 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:44:49.421379 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:44:49.421379 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:44:49.421379 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:44:49.421379 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:44:49.421379 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:44:49.421379 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:44:49.421379 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:44:49.421379 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:44:49.422379 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:44:49.422379 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:44:49.422379 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:44:49.422379 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:44:49.422379 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:44:49.422379 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:44:49.422379 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:44:49.422379 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:44:49.422379 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:44:49.422379 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:44:49.422379 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:44:49.422379 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:44:49.426809 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 177/350] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 28 00:44:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:44:49.429630 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f096897-c497-40b4-8b1c-bcd53ca581c5 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:49.429630 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f096897-c497-40b4-8b1c-bcd53ca581c5 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:49.430236 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f096897-c497-40b4-8b1c-bcd53ca581c5 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:49.436039 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 178/351] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:44:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:44:49.436667 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f096897-c497-40b4-8b1c-bcd53ca581c5 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:49.450277 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102ef8c7-9996-4256-80e5-c509b6936717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:49.451342 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ef8c7-9996-4256-80e5-c509b6936717 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:49.451856 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ef8c7-9996-4256-80e5-c509b6936717 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:49.452412 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ef8c7-9996-4256-80e5-c509b6936717 None admin] PATH_INFO: `/v3/projects/a8086350f8e74846828edcab8c1d0577` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:49.453870 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102ef8c7-9996-4256-80e5-c509b6936717 None admin] RBAC: Authorizing `identity:get_project(project_id=a8086350f8e74846828edcab8c1d0577)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:49.456201 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102ef8c7-9996-4256-80e5-c509b6936717 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:49.458485 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 174/352] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 28 00:44:49 2022] GET /identity/v3/projects/a8086350f8e74846828edcab8c1d0577 => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:49.459772 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102ef8c7-9996-4256-80e5-c509b6936717 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:49.579147 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:49.604354 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102ef8c7-9996-4256-80e5-c509b6936717 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:49.610884 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f096897-c497-40b4-8b1c-bcd53ca581c5 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:49.664549 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9aeeb1-49de-467d-a082-deb0ef9d28fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:49.665191 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9aeeb1-49de-467d-a082-deb0ef9d28fb None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:49.665469 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9aeeb1-49de-467d-a082-deb0ef9d28fb None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:49.665738 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9aeeb1-49de-467d-a082-deb0ef9d28fb None admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:49.666426 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9aeeb1-49de-467d-a082-deb0ef9d28fb None admin] RBAC: Adding query filter params (name=reader) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:49.666723 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9aeeb1-49de-467d-a082-deb0ef9d28fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:49.668327 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9aeeb1-49de-467d-a082-deb0ef9d28fb None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:49.674106 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4b9b15-1e91-4a9d-9b5d-899a2aec5c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:49.674761 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b9b15-1e91-4a9d-9b5d-899a2aec5c09 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:49.675035 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b9b15-1e91-4a9d-9b5d-899a2aec5c09 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:49.675300 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b9b15-1e91-4a9d-9b5d-899a2aec5c09 None admin] PATH_INFO: `/v3/projects/a8086350f8e74846828edcab8c1d0577` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:49.676500 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4b9b15-1e91-4a9d-9b5d-899a2aec5c09 None admin] RBAC: Authorizing `identity:get_project(project_id=a8086350f8e74846828edcab8c1d0577)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:49.677962 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4b9b15-1e91-4a9d-9b5d-899a2aec5c09 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:49.679968 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 179/353] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 28 00:44:49 2022] GET /identity/v3/projects/a8086350f8e74846828edcab8c1d0577 => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:49.681168 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d72f8f-1a6b-4e9a-b673-bcce5e718dd7 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:49.681440 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d72f8f-1a6b-4e9a-b673-bcce5e718dd7 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:49.681698 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d72f8f-1a6b-4e9a-b673-bcce5e718dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:49.682803 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 175/354] 10.222.0.49 () {56 vars in 1101 bytes} [Sun Aug 28 00:44:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:49.684757 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9aeeb1-49de-467d-a082-deb0ef9d28fb None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:49.699526 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:49.701795 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-61d72f8f-1a6b-4e9a-b673-bcce5e718dd7 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:44:49.703001 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-61d72f8f-1a6b-4e9a-b673-bcce5e718dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:44:49.800913 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 180/355] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:44:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:44:49.801999 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d72f8f-1a6b-4e9a-b673-bcce5e718dd7 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:49.850111 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9aeeb1-49de-467d-a082-deb0ef9d28fb None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:49.905553 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750aca9f-83a8-47a4-be17-6d9fd6923ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:49.906564 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750aca9f-83a8-47a4-be17-6d9fd6923ce7 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:49.906866 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750aca9f-83a8-47a4-be17-6d9fd6923ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:49.907290 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750aca9f-83a8-47a4-be17-6d9fd6923ce7 None admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:49.908709 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750aca9f-83a8-47a4-be17-6d9fd6923ce7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:49.908898 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750aca9f-83a8-47a4-be17-6d9fd6923ce7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:49.910652 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750aca9f-83a8-47a4-be17-6d9fd6923ce7 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:49.922751 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 176/356] 10.222.0.49 () {56 vars in 1101 bytes} [Sun Aug 28 00:44:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:49.924241 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:49.925272 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3f81e-1712-498e-a059-fb0d4f85cea2 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:49.926201 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3f81e-1712-498e-a059-fb0d4f85cea2 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:49.926506 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3f81e-1712-498e-a059-fb0d4f85cea2 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:49.930899 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 177/357] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:44:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:44:49.932305 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb3f81e-1712-498e-a059-fb0d4f85cea2 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:49.947179 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d72f8f-1a6b-4e9a-b673-bcce5e718dd7 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:49.994073 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba39e1e-1fdf-4c01-9969-c561a2692a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:49.994719 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba39e1e-1fdf-4c01-9969-c561a2692a36 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:49.994994 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba39e1e-1fdf-4c01-9969-c561a2692a36 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:49.995264 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba39e1e-1fdf-4c01-9969-c561a2692a36 None admin] PATH_INFO: `/v3/groups/c1d3893922a1415bb305c9b107765fd8` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:50.009727 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba39e1e-1fdf-4c01-9969-c561a2692a36 None admin] RBAC: Authorizing `identity:get_group(group_id=c1d3893922a1415bb305c9b107765fd8)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:50.012597 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba39e1e-1fdf-4c01-9969-c561a2692a36 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:50.015846 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 181/358] 10.222.0.49 () {56 vars in 1180 bytes} [Sun Aug 28 00:44:49 2022] GET /identity/v3/groups/c1d3893922a1415bb305c9b107765fd8 => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:50.017288 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba39e1e-1fdf-4c01-9969-c561a2692a36 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:50.047964 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:50.097748 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb3f81e-1712-498e-a059-fb0d4f85cea2 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:50.158448 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c534da-5570-4251-ad7a-f6f0f2de115b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:50.159704 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c534da-5570-4251-ad7a-f6f0f2de115b None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:50.159970 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c534da-5570-4251-ad7a-f6f0f2de115b None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:50.160378 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c534da-5570-4251-ad7a-f6f0f2de115b None admin] PATH_INFO: `/v3/groups/c1d3893922a1415bb305c9b107765fd8` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:50.162382 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c534da-5570-4251-ad7a-f6f0f2de115b None admin] RBAC: Authorizing `identity:get_group(group_id=c1d3893922a1415bb305c9b107765fd8)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:50.165288 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c534da-5570-4251-ad7a-f6f0f2de115b None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:50.168414 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 178/359] 10.222.0.49 () {56 vars in 1180 bytes} [Sun Aug 28 00:44:49 2022] GET /identity/v3/groups/c1d3893922a1415bb305c9b107765fd8 => generated 226 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:50.170500 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa029e-7608-493d-ab76-d4db17466e2b None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:50.170994 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa029e-7608-493d-ab76-d4db17466e2b None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:50.171445 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa029e-7608-493d-ab76-d4db17466e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:50.172945 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba39e1e-1fdf-4c01-9969-c561a2692a36 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:50.202757 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-9daa029e-7608-493d-ab76-d4db17466e2b None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:44:50.204084 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-9daa029e-7608-493d-ab76-d4db17466e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:44:50.238377 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd3cde5-6cb4-4bc7-bfaf-fe98e90d170b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:50.239378 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd3cde5-6cb4-4bc7-bfaf-fe98e90d170b None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:50.239868 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd3cde5-6cb4-4bc7-bfaf-fe98e90d170b None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:50.240292 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd3cde5-6cb4-4bc7-bfaf-fe98e90d170b None admin] PATH_INFO: `/v3/users/cdabc99440654d34a3f5280e610296cb` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:50.243195 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd3cde5-6cb4-4bc7-bfaf-fe98e90d170b None admin] RBAC: Authorizing `identity:get_user(user_id=cdabc99440654d34a3f5280e610296cb)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:50.245453 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd3cde5-6cb4-4bc7-bfaf-fe98e90d170b None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:50.248420 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 182/360] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 28 00:44:50 2022] GET /identity/v3/users/cdabc99440654d34a3f5280e610296cb => generated 293 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:50.249923 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd3cde5-6cb4-4bc7-bfaf-fe98e90d170b None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:50.278015 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:50.328636 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 179/361] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:44:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:44:50.329767 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa029e-7608-493d-ab76-d4db17466e2b None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:50.402866 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd3cde5-6cb4-4bc7-bfaf-fe98e90d170b None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:50.464045 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:50.471440 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a139f-5d9d-4e24-aee3-d3d6bb1d941d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:50.472306 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a139f-5d9d-4e24-aee3-d3d6bb1d941d None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:50.472581 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a139f-5d9d-4e24-aee3-d3d6bb1d941d None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:50.472850 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a139f-5d9d-4e24-aee3-d3d6bb1d941d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:50.520854 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa029e-7608-493d-ab76-d4db17466e2b None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:50.548753 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0a139f-5d9d-4e24-aee3-d3d6bb1d941d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:50.550487 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0a139f-5d9d-4e24-aee3-d3d6bb1d941d None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:50.569985 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7903d18f-a656-44fe-b8b2-a97c6dae98b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:50.571170 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7903d18f-a656-44fe-b8b2-a97c6dae98b5 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:50.571170 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7903d18f-a656-44fe-b8b2-a97c6dae98b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:50.571691 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7903d18f-a656-44fe-b8b2-a97c6dae98b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:50.572304 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:50.572662 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7903d18f-a656-44fe-b8b2-a97c6dae98b5 None admin] RBAC: Adding query filter params (group.id=c1d3893922a1415bb305c9b107765fd8, role.id=7ac2391cc85a4d138e95e27cd0d09b26, scope.project.id=a8086350f8e74846828edcab8c1d0577) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:50.572986 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7903d18f-a656-44fe-b8b2-a97c6dae98b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:50.574576 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7903d18f-a656-44fe-b8b2-a97c6dae98b5 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:50.589041 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 180/362] 10.222.0.49 () {56 vars in 1376 bytes} [Sun Aug 28 00:44:50 2022] GET /identity/v3/role_assignments?group.id=c1d3893922a1415bb305c9b107765fd8&scope.project.id=a8086350f8e74846828edcab8c1d0577&role.id=7ac2391cc85a4d138e95e27cd0d09b26 => generated 260 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:50.590706 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7903d18f-a656-44fe-b8b2-a97c6dae98b5 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:50.697701 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 183/363] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 28 00:44:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:44:50.698752 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a139f-5d9d-4e24-aee3-d3d6bb1d941d None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:50.805547 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7903d18f-a656-44fe-b8b2-a97c6dae98b5 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:50.853060 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d8de7-9c9f-4152-a9c5-cd4df7f7a410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:50.853823 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d8de7-9c9f-4152-a9c5-cd4df7f7a410 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:50.854108 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d8de7-9c9f-4152-a9c5-cd4df7f7a410 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:50.854381 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d8de7-9c9f-4152-a9c5-cd4df7f7a410 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:50.857363 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:50.874301 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896d8de7-9c9f-4152-a9c5-cd4df7f7a410 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:44:50.885249 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-896d8de7-9c9f-4152-a9c5-cd4df7f7a410 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:44:50.885249 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:44:50.885249 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:44:50.885249 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:44:50.885249 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:44:50.885249 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:44:50.885249 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:44:50.885249 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:44:50.885249 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:44:50.885249 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:44:50.885249 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:44:50.885249 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:44:50.885249 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:44:50.885249 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:44:50.885249 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:44:50.885249 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:44:50.886232 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:44:50.886232 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:44:50.886232 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:44:50.886232 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:44:50.886232 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:44:50.886232 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:44:50.886232 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:44:50.886232 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:44:50.886232 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:44:50.886232 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:44:50.886232 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:44:50.886232 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:44:50.886232 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:44:50.886232 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:44:50.886232 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:44:50.886232 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:44:50.887063 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:44:50.887063 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:44:50.887063 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:44:50.887063 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:44:50.887063 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:44:50.887063 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:44:50.887063 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:44:50.887063 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:44:50.887063 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:44:50.887063 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:44:50.887063 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:44:50.887063 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:44:50.887063 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 181/364] 10.222.0.49 () {56 vars in 1114 bytes} [Sun Aug 28 00:44:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:44:50.888156 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d8de7-9c9f-4152-a9c5-cd4df7f7a410 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:50.894726 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a139f-5d9d-4e24-aee3-d3d6bb1d941d None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:50.925234 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:50.964378 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b69740-a01c-44e4-b1a5-90e7b0aea6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:50.965443 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b69740-a01c-44e4-b1a5-90e7b0aea6a5 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:50.965907 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b69740-a01c-44e4-b1a5-90e7b0aea6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:50.966343 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b69740-a01c-44e4-b1a5-90e7b0aea6a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:50.967584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b69740-a01c-44e4-b1a5-90e7b0aea6a5 None admin] RBAC: Adding query filter params (group.id=c1d3893922a1415bb305c9b107765fd8, role.id=5bcf10de71e7404aaef4d7878053be82, scope.project.id=a8086350f8e74846828edcab8c1d0577) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:50.968117 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b69740-a01c-44e4-b1a5-90e7b0aea6a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:50.970646 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b69740-a01c-44e4-b1a5-90e7b0aea6a5 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:50.982335 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 184/365] 10.222.0.49 () {56 vars in 1376 bytes} [Sun Aug 28 00:44:50 2022] GET /identity/v3/role_assignments?group.id=c1d3893922a1415bb305c9b107765fd8&scope.project.id=a8086350f8e74846828edcab8c1d0577&role.id=5bcf10de71e7404aaef4d7878053be82 => generated 260 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:50.983872 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b69740-a01c-44e4-b1a5-90e7b0aea6a5 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:51.105084 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d8de7-9c9f-4152-a9c5-cd4df7f7a410 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:51.188149 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7687b92-6c26-4c40-a136-f2d0910b508d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:51.189264 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7687b92-6c26-4c40-a136-f2d0910b508d None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:51.189773 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7687b92-6c26-4c40-a136-f2d0910b508d None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:51.190218 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7687b92-6c26-4c40-a136-f2d0910b508d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:51.191425 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7687b92-6c26-4c40-a136-f2d0910b508d None admin] RBAC: Adding query filter params (role.id=708b4012bb2645b6aa4af9606988ce56, user.id=cdabc99440654d34a3f5280e610296cb, scope.system=all) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:51.193273 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7687b92-6c26-4c40-a136-f2d0910b508d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:51.196570 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7687b92-6c26-4c40-a136-f2d0910b508d None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:51.220891 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b69740-a01c-44e4-b1a5-90e7b0aea6a5 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:51.229074 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 182/366] 10.222.0.49 () {56 vars in 1308 bytes} [Sun Aug 28 00:44:50 2022] GET /identity/v3/role_assignments?user.id=cdabc99440654d34a3f5280e610296cb&scope.system=all&role.id=708b4012bb2645b6aa4af9606988ce56 => generated 510 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:51.229074 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7687b92-6c26-4c40-a136-f2d0910b508d None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:51.321033 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317c852b-b4bc-4829-99d4-125093bef8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:51.322141 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c852b-b4bc-4829-99d4-125093bef8b3 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:51.322964 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c852b-b4bc-4829-99d4-125093bef8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:51.324070 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c852b-b4bc-4829-99d4-125093bef8b3 None admin] PATH_INFO: `/v3/projects/8dc5332abd014a54adc53ca64239c322` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:51.326546 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317c852b-b4bc-4829-99d4-125093bef8b3 None admin] RBAC: Authorizing `identity:get_project(project_id=8dc5332abd014a54adc53ca64239c322)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:51.329217 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:51.333471 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317c852b-b4bc-4829-99d4-125093bef8b3 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:51.338788 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 185/367] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 28 00:44:50 2022] GET /identity/v3/projects/8dc5332abd014a54adc53ca64239c322 => generated 302 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:51.340844 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317c852b-b4bc-4829-99d4-125093bef8b3 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:51.429103 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7687b92-6c26-4c40-a136-f2d0910b508d None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:51.441957 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:51.559126 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60119e80-f12a-48fe-8ec4-4555c8f46687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:51.560184 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60119e80-f12a-48fe-8ec4-4555c8f46687 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:51.560765 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60119e80-f12a-48fe-8ec4-4555c8f46687 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:51.561116 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60119e80-f12a-48fe-8ec4-4555c8f46687 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:51.585995 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317c852b-b4bc-4829-99d4-125093bef8b3 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:51.594184 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60119e80-f12a-48fe-8ec4-4555c8f46687 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:44:51.605989 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-60119e80-f12a-48fe-8ec4-4555c8f46687 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:44:51.605989 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:44:51.605989 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:44:51.605989 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:44:51.605989 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:44:51.605989 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:44:51.605989 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:44:51.605989 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:44:51.605989 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:44:51.605989 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:44:51.605989 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:44:51.605989 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:44:51.605989 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:44:51.605989 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:44:51.605989 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:44:51.605989 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:44:51.608316 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:44:51.608316 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:44:51.608316 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:44:51.608316 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:44:51.608316 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:44:51.608316 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:44:51.608316 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:44:51.608316 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:44:51.608316 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:44:51.608316 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:44:51.608316 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:44:51.608316 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:44:51.608316 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:44:51.608316 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:44:51.608316 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:44:51.608316 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:44:51.610295 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:44:51.610295 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:44:51.610295 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:44:51.610295 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:44:51.610295 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:44:51.610295 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:44:51.610295 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:44:51.610295 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:44:51.610295 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:44:51.610295 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:44:51.610295 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:44:51.610295 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:44:51.610295 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 183/368] 10.222.0.49 () {56 vars in 1096 bytes} [Sun Aug 28 00:44:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:44:51.610295 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60119e80-f12a-48fe-8ec4-4555c8f46687 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:51.661702 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa44a3ff-ecc7-4ee4-97f7-24a2d615f0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:51.662980 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44a3ff-ecc7-4ee4-97f7-24a2d615f0b8 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:51.663269 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44a3ff-ecc7-4ee4-97f7-24a2d615f0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:51.663588 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44a3ff-ecc7-4ee4-97f7-24a2d615f0b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:51.664334 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa44a3ff-ecc7-4ee4-97f7-24a2d615f0b8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:51.664964 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa44a3ff-ecc7-4ee4-97f7-24a2d615f0b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:51.666381 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa44a3ff-ecc7-4ee4-97f7-24a2d615f0b8 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:51.680830 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 186/369] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 28 00:44:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:51.682039 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa44a3ff-ecc7-4ee4-97f7-24a2d615f0b8 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:51.829603 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa44a3ff-ecc7-4ee4-97f7-24a2d615f0b8 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:51.848222 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:51.850993 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60119e80-f12a-48fe-8ec4-4555c8f46687 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:51.878126 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:51.902458 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c567d536-668e-4f80-91ba-ca64e62d9ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:51.903456 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567d536-668e-4f80-91ba-ca64e62d9ac7 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:51.904007 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567d536-668e-4f80-91ba-ca64e62d9ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:51.904513 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c567d536-668e-4f80-91ba-ca64e62d9ac7 None admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:51.905737 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c567d536-668e-4f80-91ba-ca64e62d9ac7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:51.906487 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c567d536-668e-4f80-91ba-ca64e62d9ac7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:51.909428 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c567d536-668e-4f80-91ba-ca64e62d9ac7 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:51.920068 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e870b1b-fd0f-4156-a13a-55e3ffddbe8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:51.921204 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e870b1b-fd0f-4156-a13a-55e3ffddbe8d None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:51.921863 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e870b1b-fd0f-4156-a13a-55e3ffddbe8d None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:51.922275 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e870b1b-fd0f-4156-a13a-55e3ffddbe8d None admin] PATH_INFO: `/v3/groups/c1d3893922a1415bb305c9b107765fd8` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:51.924488 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e870b1b-fd0f-4156-a13a-55e3ffddbe8d None admin] RBAC: Authorizing `identity:get_group(group_id=c1d3893922a1415bb305c9b107765fd8)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:51.927308 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e870b1b-fd0f-4156-a13a-55e3ffddbe8d None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:51.929289 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 187/370] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 28 00:44:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:51.930902 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c567d536-668e-4f80-91ba-ca64e62d9ac7 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:51.939270 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 184/371] 10.222.0.49 () {56 vars in 1180 bytes} [Sun Aug 28 00:44:51 2022] GET /identity/v3/groups/c1d3893922a1415bb305c9b107765fd8 => generated 226 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:51.940782 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e870b1b-fd0f-4156-a13a-55e3ffddbe8d None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:52.182089 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c567d536-668e-4f80-91ba-ca64e62d9ac7 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:52.184276 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e870b1b-fd0f-4156-a13a-55e3ffddbe8d None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:52.253944 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d2346-0c62-4c85-8a90-d787fb9f12c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:52.254998 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d2346-0c62-4c85-8a90-d787fb9f12c9 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:52.255463 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d2346-0c62-4c85-8a90-d787fb9f12c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:52.255971 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d2346-0c62-4c85-8a90-d787fb9f12c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:52.256147 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e94b38-5a44-4be7-a6de-014b3954d390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:52.259395 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e94b38-5a44-4be7-a6de-014b3954d390 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:52.259866 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e94b38-5a44-4be7-a6de-014b3954d390 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:52.260425 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e94b38-5a44-4be7-a6de-014b3954d390 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:52.330133 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:52.358223 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:52.397199 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08d2346-0c62-4c85-8a90-d787fb9f12c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:52.400316 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08d2346-0c62-4c85-8a90-d787fb9f12c9 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:52.402285 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e94b38-5a44-4be7-a6de-014b3954d390 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:52.404190 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e94b38-5a44-4be7-a6de-014b3954d390 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:52.600001 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 185/372] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 28 00:44:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 660 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:44:52.608452 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e94b38-5a44-4be7-a6de-014b3954d390 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:52.610897 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 188/373] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 28 00:44:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 681 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:44:52.617032 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d2346-0c62-4c85-8a90-d787fb9f12c9 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:52.702001 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:52.751192 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d2346-0c62-4c85-8a90-d787fb9f12c9 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:52.772069 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:52.810872 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e94b38-5a44-4be7-a6de-014b3954d390 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:52.814559 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eb9bd0-19d7-4f9d-93e4-f6338459cb19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:52.815203 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb9bd0-19d7-4f9d-93e4-f6338459cb19 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:52.815576 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb9bd0-19d7-4f9d-93e4-f6338459cb19 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:52.815885 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb9bd0-19d7-4f9d-93e4-f6338459cb19 None admin] PATH_INFO: `/v3/projects/8dc5332abd014a54adc53ca64239c322` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:52.817285 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eb9bd0-19d7-4f9d-93e4-f6338459cb19 None admin] RBAC: Authorizing `identity:get_project(project_id=8dc5332abd014a54adc53ca64239c322)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:52.819028 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eb9bd0-19d7-4f9d-93e4-f6338459cb19 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:52.821228 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 189/374] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 28 00:44:52 2022] GET /identity/v3/projects/8dc5332abd014a54adc53ca64239c322 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:44:52.822045 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eb9bd0-19d7-4f9d-93e4-f6338459cb19 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:52.878479 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd31b75-94f5-4794-a61c-f7dd6121d10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:52.879774 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd31b75-94f5-4794-a61c-f7dd6121d10c None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:52.880864 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd31b75-94f5-4794-a61c-f7dd6121d10c None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:52.881703 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd31b75-94f5-4794-a61c-f7dd6121d10c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:52.883312 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd31b75-94f5-4794-a61c-f7dd6121d10c None admin] RBAC: Adding query filter params (group.id=c1d3893922a1415bb305c9b107765fd8, role.id=7ac2391cc85a4d138e95e27cd0d09b26, scope.project.id=8dc5332abd014a54adc53ca64239c322) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:52.884315 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd31b75-94f5-4794-a61c-f7dd6121d10c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:52.887116 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd31b75-94f5-4794-a61c-f7dd6121d10c None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:52.903762 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 186/375] 10.222.0.49 () {56 vars in 1376 bytes} [Sun Aug 28 00:44:52 2022] GET /identity/v3/role_assignments?group.id=c1d3893922a1415bb305c9b107765fd8&scope.project.id=8dc5332abd014a54adc53ca64239c322&role.id=7ac2391cc85a4d138e95e27cd0d09b26 => generated 260 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:52.905189 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd31b75-94f5-4794-a61c-f7dd6121d10c None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:52.973799 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eb9bd0-19d7-4f9d-93e4-f6338459cb19 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:53.025817 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d62712-99f0-416e-bef5-ba678dd771c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:53.026730 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d62712-99f0-416e-bef5-ba678dd771c1 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:53.027237 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d62712-99f0-416e-bef5-ba678dd771c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:53.027698 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d62712-99f0-416e-bef5-ba678dd771c1 None admin] PATH_INFO: `/v3/projects/8f4ff55387564b158cecc09304291ac9` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:53.029226 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d62712-99f0-416e-bef5-ba678dd771c1 None admin] RBAC: Authorizing `identity:get_project(project_id=8f4ff55387564b158cecc09304291ac9)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:53.032455 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d62712-99f0-416e-bef5-ba678dd771c1 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:53.034818 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 190/376] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 28 00:44:52 2022] GET /identity/v3/projects/8f4ff55387564b158cecc09304291ac9 => generated 344 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:53.041647 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d62712-99f0-416e-bef5-ba678dd771c1 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:53.065989 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:53.178221 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd31b75-94f5-4794-a61c-f7dd6121d10c None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:53.260331 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccdf45e-01bc-4666-9b2a-50982c94da22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:53.261005 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d62712-99f0-416e-bef5-ba678dd771c1 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:53.261400 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccdf45e-01bc-4666-9b2a-50982c94da22 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:53.261400 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccdf45e-01bc-4666-9b2a-50982c94da22 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:53.261728 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccdf45e-01bc-4666-9b2a-50982c94da22 None admin] PATH_INFO: `/v3/groups/c1d3893922a1415bb305c9b107765fd8` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:53.262910 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccdf45e-01bc-4666-9b2a-50982c94da22 None admin] RBAC: Authorizing `identity:get_group(group_id=c1d3893922a1415bb305c9b107765fd8)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:53.264862 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccdf45e-01bc-4666-9b2a-50982c94da22 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:53.266886 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 187/377] 10.222.0.49 () {56 vars in 1180 bytes} [Sun Aug 28 00:44:52 2022] GET /identity/v3/groups/c1d3893922a1415bb305c9b107765fd8 => generated 226 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:53.273565 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccdf45e-01bc-4666-9b2a-50982c94da22 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:53.304132 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:53.310670 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cad7394-3395-4557-9dfc-083ec9839e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:53.312196 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad7394-3395-4557-9dfc-083ec9839e18 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:53.312486 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad7394-3395-4557-9dfc-083ec9839e18 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:53.312766 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad7394-3395-4557-9dfc-083ec9839e18 None admin] PATH_INFO: `/v3/groups/33d06b62de714b54b030d5438e3b3b5b` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:53.325919 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cad7394-3395-4557-9dfc-083ec9839e18 None admin] RBAC: Authorizing `identity:get_group(group_id=33d06b62de714b54b030d5438e3b3b5b)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:53.327415 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cad7394-3395-4557-9dfc-083ec9839e18 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:53.331643 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 191/378] 10.222.0.49 () {56 vars in 1180 bytes} [Sun Aug 28 00:44:53 2022] GET /identity/v3/groups/33d06b62de714b54b030d5438e3b3b5b => generated 229 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:53.336341 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cad7394-3395-4557-9dfc-083ec9839e18 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:53.507644 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:53.509595 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccdf45e-01bc-4666-9b2a-50982c94da22 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:53.562241 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cad7394-3395-4557-9dfc-083ec9839e18 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:53.583362 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ac7c3-d43a-472b-9274-bf4a10d45341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:53.584142 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ac7c3-d43a-472b-9274-bf4a10d45341 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:53.584427 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ac7c3-d43a-472b-9274-bf4a10d45341 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:53.584821 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ac7c3-d43a-472b-9274-bf4a10d45341 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:53.586021 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406ac7c3-d43a-472b-9274-bf4a10d45341 None admin] RBAC: Adding query filter params (group.id=c1d3893922a1415bb305c9b107765fd8, role.id=5bcf10de71e7404aaef4d7878053be82, scope.project.id=8dc5332abd014a54adc53ca64239c322) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:53.586468 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406ac7c3-d43a-472b-9274-bf4a10d45341 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:53.588930 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406ac7c3-d43a-472b-9274-bf4a10d45341 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:53.597077 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 188/379] 10.222.0.49 () {56 vars in 1376 bytes} [Sun Aug 28 00:44:53 2022] GET /identity/v3/role_assignments?group.id=c1d3893922a1415bb305c9b107765fd8&scope.project.id=8dc5332abd014a54adc53ca64239c322&role.id=5bcf10de71e7404aaef4d7878053be82 => generated 260 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:44:53.603591 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0bc89-e88a-4fe7-a152-4a4629d4a1b8 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:53.605498 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0bc89-e88a-4fe7-a152-4a4629d4a1b8 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:53.606637 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0bc89-e88a-4fe7-a152-4a4629d4a1b8 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:53.610685 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 189/380] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:44:53 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:44:53.613459 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d21a2-31bb-4228-b838-5c1f5a2ac7e9 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:53.614136 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d21a2-31bb-4228-b838-5c1f5a2ac7e9 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:53.614580 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d21a2-31bb-4228-b838-5c1f5a2ac7e9 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:53.615131 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4e7738-cd2b-41b0-89cd-55ffc996f0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:53.615889 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e7738-cd2b-41b0-89cd-55ffc996f0a2 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:53.616216 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e7738-cd2b-41b0-89cd-55ffc996f0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:53.616563 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e7738-cd2b-41b0-89cd-55ffc996f0a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:53.617300 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 190/381] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:44:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:44:53.618745 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d2095-368e-4d2e-b70c-c7863d3d5e48 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:53.619249 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d2095-368e-4d2e-b70c-c7863d3d5e48 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:53.619911 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d2095-368e-4d2e-b70c-c7863d3d5e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:53.622176 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4e7738-cd2b-41b0-89cd-55ffc996f0a2 None admin] RBAC: Adding query filter params (group.id=33d06b62de714b54b030d5438e3b3b5b, role.id=2e4889bb71f9434392c0baba59f2534e, scope.project.id=8f4ff55387564b158cecc09304291ac9) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:53.622603 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4e7738-cd2b-41b0-89cd-55ffc996f0a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:53.624317 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4e7738-cd2b-41b0-89cd-55ffc996f0a2 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:53.632003 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 192/382] 10.222.0.49 () {56 vars in 1376 bytes} [Sun Aug 28 00:44:53 2022] GET /identity/v3/role_assignments?group.id=33d06b62de714b54b030d5438e3b3b5b&scope.project.id=8f4ff55387564b158cecc09304291ac9&role.id=2e4889bb71f9434392c0baba59f2534e => generated 260 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:53.633660 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa6397-36a5-416e-bf41-87e4eebf43ac None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:53.634012 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa6397-36a5-416e-bf41-87e4eebf43ac None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:53.634378 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa6397-36a5-416e-bf41-87e4eebf43ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:53.657129 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-f24d2095-368e-4d2e-b70c-c7863d3d5e48 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:44:53.658011 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-01aa6397-36a5-416e-bf41-87e4eebf43ac None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:44:53.659328 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-01aa6397-36a5-416e-bf41-87e4eebf43ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:44:53.659745 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-f24d2095-368e-4d2e-b70c-c7863d3d5e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:44:53.759396 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 193/383] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:44:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:44:53.787127 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 191/384] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:44:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:44:54.140903 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aa6397-36a5-416e-bf41-87e4eebf43ac None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:54.218824 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:54.264906 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aa6397-36a5-416e-bf41-87e4eebf43ac None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:54.312258 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d2095-368e-4d2e-b70c-c7863d3d5e48 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:54.315249 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba3ef8-0461-4fde-b5ec-1c00c2d91668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:54.315941 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba3ef8-0461-4fde-b5ec-1c00c2d91668 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:54.316221 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba3ef8-0461-4fde-b5ec-1c00c2d91668 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:54.316651 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ba3ef8-0461-4fde-b5ec-1c00c2d91668 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:54.329245 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ba3ef8-0461-4fde-b5ec-1c00c2d91668 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:44:54.334835 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-c4ba3ef8-0461-4fde-b5ec-1c00c2d91668 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:44:54.334835 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:44:54.334835 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:44:54.334835 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:44:54.334835 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:44:54.334835 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:44:54.334835 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:44:54.334835 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:44:54.334835 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:44:54.334835 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:44:54.334835 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:44:54.334835 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:44:54.334835 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:44:54.334835 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:44:54.334835 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:44:54.334835 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:44:54.335876 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:44:54.335876 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:44:54.335876 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:44:54.335876 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:44:54.335876 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:44:54.335876 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:44:54.335876 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:44:54.335876 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:44:54.335876 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:44:54.335876 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:44:54.335876 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:44:54.335876 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:44:54.335876 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:44:54.335876 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:44:54.335876 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:44:54.335876 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:44:54.336904 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:44:54.336904 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:44:54.336904 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:44:54.336904 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:44:54.336904 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:44:54.336904 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:44:54.336904 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:44:54.336904 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:44:54.336904 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:44:54.336904 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:44:54.336904 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:44:54.336904 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:44:54.336904 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 194/385] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 28 00:44:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:44:54.343216 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba3ef8-0461-4fde-b5ec-1c00c2d91668 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:54.344152 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:54.469776 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ba3ef8-0461-4fde-b5ec-1c00c2d91668 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:54.489076 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d2095-368e-4d2e-b70c-c7863d3d5e48 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:54.533010 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:54.558239 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af73dc43-d337-4860-a2c6-625b9ea5353a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:54.558881 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73dc43-d337-4860-a2c6-625b9ea5353a None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:54.559158 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73dc43-d337-4860-a2c6-625b9ea5353a None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:54.559427 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73dc43-d337-4860-a2c6-625b9ea5353a None admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:54.560273 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af73dc43-d337-4860-a2c6-625b9ea5353a None admin] RBAC: Adding query filter params (name=member) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:54.560577 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af73dc43-d337-4860-a2c6-625b9ea5353a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:54.561966 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af73dc43-d337-4860-a2c6-625b9ea5353a None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:54.564032 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1b7d16-cb12-4a73-a1de-dd7ceab4814a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:54.564792 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b7d16-cb12-4a73-a1de-dd7ceab4814a None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:54.565065 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b7d16-cb12-4a73-a1de-dd7ceab4814a None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:54.565325 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b7d16-cb12-4a73-a1de-dd7ceab4814a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:54.583193 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 195/386] 10.222.0.49 () {56 vars in 1101 bytes} [Sun Aug 28 00:44:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:44:54.586208 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1b7d16-cb12-4a73-a1de-dd7ceab4814a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:44:54.591567 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-8a1b7d16-cb12-4a73-a1de-dd7ceab4814a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:44:54.591567 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:44:54.591567 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:44:54.591567 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:44:54.591567 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:44:54.591567 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:44:54.591567 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:44:54.591567 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:44:54.591567 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:44:54.591567 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:44:54.591567 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:44:54.591567 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:44:54.591567 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:44:54.591567 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:44:54.591567 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:44:54.591567 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:44:54.592544 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:44:54.592544 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:44:54.592544 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:44:54.592544 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:44:54.592544 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:44:54.592544 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:44:54.592544 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:44:54.592544 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:44:54.592544 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:44:54.592544 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:44:54.592544 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:44:54.592544 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:44:54.592544 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:44:54.592544 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:44:54.592544 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:44:54.592544 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:44:54.593463 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:44:54.593463 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:44:54.593463 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:44:54.593463 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:44:54.593463 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:44:54.593463 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:44:54.593463 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:44:54.593463 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:44:54.593463 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:44:54.593463 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:44:54.593463 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:44:54.593463 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:44:54.594183 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af73dc43-d337-4860-a2c6-625b9ea5353a None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:54.597634 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 192/387] 10.222.0.49 () {56 vars in 1114 bytes} [Sun Aug 28 00:44:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:44:54.606626 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1b7d16-cb12-4a73-a1de-dd7ceab4814a None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:54.721133 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af73dc43-d337-4860-a2c6-625b9ea5353a None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:54.748681 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:54.765271 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e22b0e-0cf5-413e-9eab-72a93ef3b9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:54.765914 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e22b0e-0cf5-413e-9eab-72a93ef3b9f1 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:54.766190 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e22b0e-0cf5-413e-9eab-72a93ef3b9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:54.766457 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e22b0e-0cf5-413e-9eab-72a93ef3b9f1 None admin] PATH_INFO: `/v3/groups/c1d3893922a1415bb305c9b107765fd8` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:54.767678 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e22b0e-0cf5-413e-9eab-72a93ef3b9f1 None admin] RBAC: Authorizing `identity:get_group(group_id=c1d3893922a1415bb305c9b107765fd8)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:54.770088 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e22b0e-0cf5-413e-9eab-72a93ef3b9f1 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:54.772327 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 196/388] 10.222.0.49 () {56 vars in 1180 bytes} [Sun Aug 28 00:44:54 2022] GET /identity/v3/groups/c1d3893922a1415bb305c9b107765fd8 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:54.778577 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e22b0e-0cf5-413e-9eab-72a93ef3b9f1 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:54.792223 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1b7d16-cb12-4a73-a1de-dd7ceab4814a None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:54.832972 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af2116-cfcd-4de3-b8c0-a1b032dfffc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:54.834047 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af2116-cfcd-4de3-b8c0-a1b032dfffc0 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:54.834587 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af2116-cfcd-4de3-b8c0-a1b032dfffc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:54.835108 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af2116-cfcd-4de3-b8c0-a1b032dfffc0 None admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:54.836090 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0af2116-cfcd-4de3-b8c0-a1b032dfffc0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:54.836679 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0af2116-cfcd-4de3-b8c0-a1b032dfffc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:54.838620 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0af2116-cfcd-4de3-b8c0-a1b032dfffc0 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:54.846350 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:54.851052 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 193/389] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 28 00:44:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:44:54.860794 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af2116-cfcd-4de3-b8c0-a1b032dfffc0 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:54.905510 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e22b0e-0cf5-413e-9eab-72a93ef3b9f1 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:54.952120 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a38d58-9035-491c-8426-cb22d7884aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:54.952899 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a38d58-9035-491c-8426-cb22d7884aab None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:54.953171 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a38d58-9035-491c-8426-cb22d7884aab None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:54.953439 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a38d58-9035-491c-8426-cb22d7884aab None admin] PATH_INFO: `/v3/projects/a8086350f8e74846828edcab8c1d0577` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:54.954766 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a38d58-9035-491c-8426-cb22d7884aab None admin] RBAC: Authorizing `identity:get_project(project_id=a8086350f8e74846828edcab8c1d0577)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:54.956916 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a38d58-9035-491c-8426-cb22d7884aab None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:54.960309 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 197/390] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 28 00:44:54 2022] GET /identity/v3/projects/a8086350f8e74846828edcab8c1d0577 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:54.966313 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a38d58-9035-491c-8426-cb22d7884aab None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:55.088393 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af2116-cfcd-4de3-b8c0-a1b032dfffc0 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:55.184097 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:55.217311 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef88c4-b4c8-45d9-8341-3e5e59fe0bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:55.218872 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef88c4-b4c8-45d9-8341-3e5e59fe0bd4 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:55.219638 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef88c4-b4c8-45d9-8341-3e5e59fe0bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:55.220382 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef88c4-b4c8-45d9-8341-3e5e59fe0bd4 None admin] PATH_INFO: `/v3/groups/c1d3893922a1415bb305c9b107765fd8` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:55.222686 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cef88c4-b4c8-45d9-8341-3e5e59fe0bd4 None admin] RBAC: Authorizing `identity:get_group(group_id=c1d3893922a1415bb305c9b107765fd8)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:55.230367 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cef88c4-b4c8-45d9-8341-3e5e59fe0bd4 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:55.233486 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 194/391] 10.222.0.49 () {56 vars in 1180 bytes} [Sun Aug 28 00:44:54 2022] GET /identity/v3/groups/c1d3893922a1415bb305c9b107765fd8 => generated 226 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:55.242204 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef88c4-b4c8-45d9-8341-3e5e59fe0bd4 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:55.255381 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a38d58-9035-491c-8426-cb22d7884aab None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:55.299349 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:55.314321 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7502395-261e-45de-8c3e-286d7c7a8763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:55.315587 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7502395-261e-45de-8c3e-286d7c7a8763 None admin] REQUEST_METHOD: `PUT` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:55.316278 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7502395-261e-45de-8c3e-286d7c7a8763 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:55.316906 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7502395-261e-45de-8c3e-286d7c7a8763 None admin] PATH_INFO: `/v3/projects/a8086350f8e74846828edcab8c1d0577/groups/c1d3893922a1415bb305c9b107765fd8/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:55.319172 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7502395-261e-45de-8c3e-286d7c7a8763 None admin] RBAC: Authorizing `identity:create_grant(project_id=a8086350f8e74846828edcab8c1d0577, group_id=c1d3893922a1415bb305c9b107765fd8, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:55.320898 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7502395-261e-45de-8c3e-286d7c7a8763 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:55.339726 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 198/392] 10.222.0.49 () {58 vars in 1442 bytes} [Sun Aug 28 00:44:54 2022] PUT /identity/v3/projects/a8086350f8e74846828edcab8c1d0577/groups/c1d3893922a1415bb305c9b107765fd8/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:44:55.447080 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef88c4-b4c8-45d9-8341-3e5e59fe0bd4 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:55.495654 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9046ce-a342-4dd4-b917-d7ade0465c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:55.496909 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9046ce-a342-4dd4-b917-d7ade0465c5f None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:55.497417 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9046ce-a342-4dd4-b917-d7ade0465c5f None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:55.497966 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9046ce-a342-4dd4-b917-d7ade0465c5f None admin] PATH_INFO: `/v3/projects/a8086350f8e74846828edcab8c1d0577` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:55.500617 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9046ce-a342-4dd4-b917-d7ade0465c5f None admin] RBAC: Authorizing `identity:get_project(project_id=a8086350f8e74846828edcab8c1d0577)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:55.502163 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9046ce-a342-4dd4-b917-d7ade0465c5f None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:55.504571 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 195/393] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 28 00:44:55 2022] GET /identity/v3/projects/a8086350f8e74846828edcab8c1d0577 => generated 298 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:55.510887 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7502395-261e-45de-8c3e-286d7c7a8763 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:55.687587 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7502395-261e-45de-8c3e-286d7c7a8763 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:55.753748 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9387d3-3760-4f3a-98bb-79154863ad0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:55.755104 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9387d3-3760-4f3a-98bb-79154863ad0e None admin] REQUEST_METHOD: `PUT` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:55.755574 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9387d3-3760-4f3a-98bb-79154863ad0e None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:55.756162 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9387d3-3760-4f3a-98bb-79154863ad0e None admin] PATH_INFO: `/v3/projects/a8086350f8e74846828edcab8c1d0577/groups/c1d3893922a1415bb305c9b107765fd8/roles/5bcf10de71e7404aaef4d7878053be82` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:55.759305 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9387d3-3760-4f3a-98bb-79154863ad0e None admin] RBAC: Authorizing `identity:create_grant(project_id=a8086350f8e74846828edcab8c1d0577, group_id=c1d3893922a1415bb305c9b107765fd8, role_id=5bcf10de71e7404aaef4d7878053be82)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:55.761402 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9387d3-3760-4f3a-98bb-79154863ad0e None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:55.783281 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 199/394] 10.222.0.49 () {58 vars in 1442 bytes} [Sun Aug 28 00:44:55 2022] PUT /identity/v3/projects/a8086350f8e74846828edcab8c1d0577/groups/c1d3893922a1415bb305c9b107765fd8/roles/5bcf10de71e7404aaef4d7878053be82 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:44:56.108896 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5383d-dc2b-46d3-a9d2-b1665b6282e0 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:56.109884 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5383d-dc2b-46d3-a9d2-b1665b6282e0 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:56.110645 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d5383d-dc2b-46d3-a9d2-b1665b6282e0 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:56.113961 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 196/395] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:44:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:44:56.120051 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e1b07-55fa-4331-9713-8349d7bb763f None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:56.120438 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e1b07-55fa-4331-9713-8349d7bb763f None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:56.120639 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e1b07-55fa-4331-9713-8349d7bb763f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:56.139927 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57724e5c-5c42-4cf9-bad7-f65b066a9ffe None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:56.140209 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57724e5c-5c42-4cf9-bad7-f65b066a9ffe None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:56.140562 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57724e5c-5c42-4cf9-bad7-f65b066a9ffe None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:56.142208 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 197/396] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:44:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:44:56.144889 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-820e1b07-55fa-4331-9713-8349d7bb763f None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:44:56.146165 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-820e1b07-55fa-4331-9713-8349d7bb763f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:44:56.148781 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33ef40-0a9d-47cb-8f8a-3b008dc0c237 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:56.149020 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33ef40-0a9d-47cb-8f8a-3b008dc0c237 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:56.149161 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33ef40-0a9d-47cb-8f8a-3b008dc0c237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:56.169364 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-3a33ef40-0a9d-47cb-8f8a-3b008dc0c237 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:44:56.170578 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-3a33ef40-0a9d-47cb-8f8a-3b008dc0c237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:44:56.222024 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:56.282432 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:56.290493 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 200/397] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:44:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:44:56.308778 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 198/398] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:44:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:44:56.629717 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab75649-dc56-4d1b-9461-d20b2df19e13 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:56.630282 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab75649-dc56-4d1b-9461-d20b2df19e13 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:56.630675 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab75649-dc56-4d1b-9461-d20b2df19e13 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:56.633178 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 201/399] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:44:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:44:56.642347 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1569d789-c1b3-4f1f-9fce-1232d0e50729 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:56.642871 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1569d789-c1b3-4f1f-9fce-1232d0e50729 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:56.643238 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1569d789-c1b3-4f1f-9fce-1232d0e50729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:56.676477 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab75649-dc56-4d1b-9461-d20b2df19e13 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:56.678885 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-1569d789-c1b3-4f1f-9fce-1232d0e50729 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:44:56.680228 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-1569d789-c1b3-4f1f-9fce-1232d0e50729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:44:56.808963 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 199/400] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:44:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:44:56.811112 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1569d789-c1b3-4f1f-9fce-1232d0e50729 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:56.834413 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab75649-dc56-4d1b-9461-d20b2df19e13 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:56.960639 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1255176-e73b-4a03-8a26-fffc13fce5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:56.960639 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1255176-e73b-4a03-8a26-fffc13fce5a1 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:56.960639 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1255176-e73b-4a03-8a26-fffc13fce5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:56.960639 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1255176-e73b-4a03-8a26-fffc13fce5a1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:56.980724 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1255176-e73b-4a03-8a26-fffc13fce5a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:44:56.985793 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-b1255176-e73b-4a03-8a26-fffc13fce5a1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:44:56.985793 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:44:56.985793 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:44:56.985793 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:44:56.985793 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:44:56.985793 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:44:56.985793 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:44:56.985793 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:44:56.985793 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:44:56.985793 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:44:56.985793 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:44:56.985793 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:44:56.985793 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:44:56.985793 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:44:56.985793 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:44:56.985793 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:44:56.987773 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:44:56.987773 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:44:56.987773 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:44:56.987773 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:44:56.987773 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:44:56.987773 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:44:56.987773 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:44:56.987773 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:44:56.987773 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:44:56.987773 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:44:56.987773 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:44:56.987773 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:44:56.987773 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:44:56.987773 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:44:56.987773 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:44:56.987773 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:44:56.989593 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:44:56.989593 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:44:56.989593 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:44:56.989593 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:44:56.989593 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:44:56.989593 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:44:56.989593 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:44:56.989593 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:44:56.989593 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:44:56.989593 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:44:56.989593 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:44:56.989593 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:44:56.989593 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 202/401] 10.222.0.49 () {56 vars in 1114 bytes} [Sun Aug 28 00:44:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:44:57.004754 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1255176-e73b-4a03-8a26-fffc13fce5a1 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:57.088448 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:57.134499 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1569d789-c1b3-4f1f-9fce-1232d0e50729 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:57.192605 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:57.226746 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1255176-e73b-4a03-8a26-fffc13fce5a1 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:57.230703 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed69c4a-b6ba-437c-84f0-a17626de9eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:57.231837 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed69c4a-b6ba-437c-84f0-a17626de9eea None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:57.232266 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed69c4a-b6ba-437c-84f0-a17626de9eea None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:57.232713 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed69c4a-b6ba-437c-84f0-a17626de9eea None admin] PATH_INFO: `/v3/roles/member` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:57.253286 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed69c4a-b6ba-437c-84f0-a17626de9eea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:44:57.263217 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-fed69c4a-b6ba-437c-84f0-a17626de9eea None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:44:57.263217 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:44:57.263217 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:44:57.263217 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:44:57.263217 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:44:57.263217 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:44:57.263217 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:44:57.263217 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:44:57.263217 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:44:57.263217 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:44:57.263217 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:44:57.263217 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:44:57.263217 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:44:57.263217 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:44:57.263217 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:44:57.263217 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:44:57.264252 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:44:57.264252 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:44:57.264252 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:44:57.264252 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:44:57.264252 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:44:57.264252 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:44:57.264252 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:44:57.264252 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:44:57.264252 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:44:57.264252 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:44:57.264252 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:44:57.264252 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:44:57.264252 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:44:57.264252 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:44:57.264252 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:44:57.264252 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:44:57.265042 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:44:57.265042 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:44:57.265042 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:44:57.265042 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:44:57.265042 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:44:57.265042 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:44:57.265042 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:44:57.265042 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:44:57.265042 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:44:57.265042 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:44:57.265042 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:44:57.265042 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:44:57.265698 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 200/402] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 28 00:44:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 455 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:44:57.266794 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed69c4a-b6ba-437c-84f0-a17626de9eea None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:57.284228 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04347426-457a-4fd6-980d-47b47c931f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:57.285228 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04347426-457a-4fd6-980d-47b47c931f73 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:57.285823 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04347426-457a-4fd6-980d-47b47c931f73 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:57.286332 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04347426-457a-4fd6-980d-47b47c931f73 None admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:57.287359 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04347426-457a-4fd6-980d-47b47c931f73 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:57.287904 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04347426-457a-4fd6-980d-47b47c931f73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:57.289531 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04347426-457a-4fd6-980d-47b47c931f73 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:57.304823 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 203/403] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 28 00:44:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:57.306168 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04347426-457a-4fd6-980d-47b47c931f73 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:57.414930 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:57.422479 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04347426-457a-4fd6-980d-47b47c931f73 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:57.447371 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed69c4a-b6ba-437c-84f0-a17626de9eea None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:57.464996 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd7fb8a-25a8-4071-a18b-49671793893c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:57.466215 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd7fb8a-25a8-4071-a18b-49671793893c None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:57.466922 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd7fb8a-25a8-4071-a18b-49671793893c None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:57.467416 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd7fb8a-25a8-4071-a18b-49671793893c None admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:57.468378 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd7fb8a-25a8-4071-a18b-49671793893c None admin] RBAC: Adding query filter params (name=member) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:57.468911 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd7fb8a-25a8-4071-a18b-49671793893c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:57.470688 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd7fb8a-25a8-4071-a18b-49671793893c None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:57.480669 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 204/404] 10.222.0.49 () {56 vars in 1101 bytes} [Sun Aug 28 00:44:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:57.481926 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd7fb8a-25a8-4071-a18b-49671793893c None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:57.517871 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c54673f-5a80-4d4f-b97e-1013ad0b5fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:57.518894 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54673f-5a80-4d4f-b97e-1013ad0b5fb9 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:57.519560 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54673f-5a80-4d4f-b97e-1013ad0b5fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:57.520212 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54673f-5a80-4d4f-b97e-1013ad0b5fb9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:57.544988 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c54673f-5a80-4d4f-b97e-1013ad0b5fb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:44:57.556943 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-4c54673f-5a80-4d4f-b97e-1013ad0b5fb9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:44:57.556943 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:44:57.556943 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:44:57.556943 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:44:57.556943 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:44:57.556943 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:44:57.556943 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:44:57.556943 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:44:57.556943 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:44:57.556943 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:44:57.556943 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:44:57.556943 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:44:57.556943 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:44:57.556943 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:44:57.556943 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:44:57.556943 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:44:57.558017 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:44:57.558017 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:44:57.558017 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:44:57.558017 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:44:57.558017 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:44:57.558017 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:44:57.558017 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:44:57.558017 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:44:57.558017 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:44:57.558017 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:44:57.558017 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:44:57.558017 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:44:57.558017 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:44:57.558017 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:44:57.558017 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:44:57.558017 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:44:57.558905 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:44:57.558905 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:44:57.558905 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:44:57.558905 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:44:57.558905 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:44:57.558905 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:44:57.558905 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:44:57.558905 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:44:57.558905 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:44:57.558905 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:44:57.558905 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:44:57.558905 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:44:57.564250 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 201/405] 10.222.0.49 () {56 vars in 1096 bytes} [Sun Aug 28 00:44:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:44:57.565471 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c54673f-5a80-4d4f-b97e-1013ad0b5fb9 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:57.624218 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:57.653679 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd7fb8a-25a8-4071-a18b-49671793893c None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:57.690018 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c54673f-5a80-4d4f-b97e-1013ad0b5fb9 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:57.713417 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67993fd-5fa4-42e6-80da-8d33c27157ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:57.714545 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67993fd-5fa4-42e6-80da-8d33c27157ec None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:57.715031 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67993fd-5fa4-42e6-80da-8d33c27157ec None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:57.715612 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67993fd-5fa4-42e6-80da-8d33c27157ec None admin] PATH_INFO: `/v3/groups/c1d3893922a1415bb305c9b107765fd8` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:57.717076 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67993fd-5fa4-42e6-80da-8d33c27157ec None admin] RBAC: Authorizing `identity:get_group(group_id=c1d3893922a1415bb305c9b107765fd8)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:57.718837 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67993fd-5fa4-42e6-80da-8d33c27157ec None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:57.720920 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 205/406] 10.222.0.49 () {56 vars in 1180 bytes} [Sun Aug 28 00:44:57 2022] GET /identity/v3/groups/c1d3893922a1415bb305c9b107765fd8 => generated 226 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:57.722072 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67993fd-5fa4-42e6-80da-8d33c27157ec None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:57.758669 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:57.775147 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bec39c2-684c-4aa6-997d-9cfd248bf218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:57.775951 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bec39c2-684c-4aa6-997d-9cfd248bf218 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:57.776352 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bec39c2-684c-4aa6-997d-9cfd248bf218 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:57.776788 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bec39c2-684c-4aa6-997d-9cfd248bf218 None admin] PATH_INFO: `/v3/groups/c1d3893922a1415bb305c9b107765fd8` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:57.778313 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bec39c2-684c-4aa6-997d-9cfd248bf218 None admin] RBAC: Authorizing `identity:get_group(group_id=c1d3893922a1415bb305c9b107765fd8)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:57.782395 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bec39c2-684c-4aa6-997d-9cfd248bf218 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:57.784900 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 202/407] 10.222.0.49 () {56 vars in 1180 bytes} [Sun Aug 28 00:44:57 2022] GET /identity/v3/groups/c1d3893922a1415bb305c9b107765fd8 => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:57.786792 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bec39c2-684c-4aa6-997d-9cfd248bf218 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:57.881799 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67993fd-5fa4-42e6-80da-8d33c27157ec None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:57.932326 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5305a7-5a77-403c-a5ce-995ef5d47e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:57.933230 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5305a7-5a77-403c-a5ce-995ef5d47e12 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:57.933733 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5305a7-5a77-403c-a5ce-995ef5d47e12 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:57.934237 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5305a7-5a77-403c-a5ce-995ef5d47e12 None admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:57.935215 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5305a7-5a77-403c-a5ce-995ef5d47e12 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:57.935451 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bec39c2-684c-4aa6-997d-9cfd248bf218 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:57.935613 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5305a7-5a77-403c-a5ce-995ef5d47e12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:57.937129 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5305a7-5a77-403c-a5ce-995ef5d47e12 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:57.953510 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 206/408] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 28 00:44:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:57.955816 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5305a7-5a77-403c-a5ce-995ef5d47e12 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:57.961571 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:57.995340 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19210a2e-2cae-4853-bf05-9e375c7640ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:57.996361 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19210a2e-2cae-4853-bf05-9e375c7640ab None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:57.996815 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19210a2e-2cae-4853-bf05-9e375c7640ab None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:57.997273 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19210a2e-2cae-4853-bf05-9e375c7640ab None admin] PATH_INFO: `/v3/projects/8dc5332abd014a54adc53ca64239c322` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:57.998857 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19210a2e-2cae-4853-bf05-9e375c7640ab None admin] RBAC: Authorizing `identity:get_project(project_id=8dc5332abd014a54adc53ca64239c322)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:58.000903 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19210a2e-2cae-4853-bf05-9e375c7640ab None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:58.011082 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 203/409] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 28 00:44:57 2022] GET /identity/v3/projects/8dc5332abd014a54adc53ca64239c322 => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:58.011082 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0018e53-ba19-42a6-9e78-5cbb5028e4ec None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:58.011082 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0018e53-ba19-42a6-9e78-5cbb5028e4ec None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:58.011082 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0018e53-ba19-42a6-9e78-5cbb5028e4ec None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:58.011082 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 204/410] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:44:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:44:58.011082 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0018e53-ba19-42a6-9e78-5cbb5028e4ec None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:58.119537 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:58.142640 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5305a7-5a77-403c-a5ce-995ef5d47e12 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:58.158657 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0018e53-ba19-42a6-9e78-5cbb5028e4ec None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:58.184772 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a494c548-bb7d-45b4-9b4f-1f82b60db3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:58.185336 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494c548-bb7d-45b4-9b4f-1f82b60db3aa None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:58.185609 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494c548-bb7d-45b4-9b4f-1f82b60db3aa None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:58.185877 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494c548-bb7d-45b4-9b4f-1f82b60db3aa None admin] PATH_INFO: `/v3/projects/8dc5332abd014a54adc53ca64239c322` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:58.187046 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a494c548-bb7d-45b4-9b4f-1f82b60db3aa None admin] RBAC: Authorizing `identity:get_project(project_id=8dc5332abd014a54adc53ca64239c322)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:58.188514 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a494c548-bb7d-45b4-9b4f-1f82b60db3aa None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:58.195953 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 207/411] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 28 00:44:57 2022] GET /identity/v3/projects/8dc5332abd014a54adc53ca64239c322 => generated 302 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:58.195953 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a494c548-bb7d-45b4-9b4f-1f82b60db3aa None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:58.218452 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65daceb2-ec94-451c-9127-247d2c2f0441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:58.219106 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65daceb2-ec94-451c-9127-247d2c2f0441 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:58.219516 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65daceb2-ec94-451c-9127-247d2c2f0441 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:58.219948 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65daceb2-ec94-451c-9127-247d2c2f0441 None admin] PATH_INFO: `/v3/groups/33d06b62de714b54b030d5438e3b3b5b` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:58.221276 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65daceb2-ec94-451c-9127-247d2c2f0441 None admin] RBAC: Authorizing `identity:get_group(group_id=33d06b62de714b54b030d5438e3b3b5b)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:58.222967 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65daceb2-ec94-451c-9127-247d2c2f0441 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:58.225525 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 205/412] 10.222.0.49 () {56 vars in 1180 bytes} [Sun Aug 28 00:44:58 2022] GET /identity/v3/groups/33d06b62de714b54b030d5438e3b3b5b => generated 229 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:58.226686 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c51b59-b006-4f5c-9800-967ecc69afa1 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:58.227013 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c51b59-b006-4f5c-9800-967ecc69afa1 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:58.227369 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c51b59-b006-4f5c-9800-967ecc69afa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:58.248144 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-c4c51b59-b006-4f5c-9800-967ecc69afa1 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:44:58.249334 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-c4c51b59-b006-4f5c-9800-967ecc69afa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:44:58.311333 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:58.347696 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 206/413] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:44:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:44:58.347696 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c51b59-b006-4f5c-9800-967ecc69afa1 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:58.347994 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a494c548-bb7d-45b4-9b4f-1f82b60db3aa None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:58.399172 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b5f601-e14f-4cdb-96ea-fd660be73771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:58.400130 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b5f601-e14f-4cdb-96ea-fd660be73771 None admin] REQUEST_METHOD: `PUT` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:58.400547 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b5f601-e14f-4cdb-96ea-fd660be73771 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:58.400936 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b5f601-e14f-4cdb-96ea-fd660be73771 None admin] PATH_INFO: `/v3/projects/8dc5332abd014a54adc53ca64239c322/groups/c1d3893922a1415bb305c9b107765fd8/roles/5bcf10de71e7404aaef4d7878053be82` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:58.404235 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b5f601-e14f-4cdb-96ea-fd660be73771 None admin] RBAC: Authorizing `identity:create_grant(project_id=8dc5332abd014a54adc53ca64239c322, group_id=c1d3893922a1415bb305c9b107765fd8, role_id=5bcf10de71e7404aaef4d7878053be82)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:58.406373 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b5f601-e14f-4cdb-96ea-fd660be73771 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:58.435704 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 208/414] 10.222.0.49 () {58 vars in 1442 bytes} [Sun Aug 28 00:44:58 2022] PUT /identity/v3/projects/8dc5332abd014a54adc53ca64239c322/groups/c1d3893922a1415bb305c9b107765fd8/roles/5bcf10de71e7404aaef4d7878053be82 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:44:58.435704 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b5f601-e14f-4cdb-96ea-fd660be73771 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:58.477844 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:58.604396 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c51b59-b006-4f5c-9800-967ecc69afa1 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:58.647332 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b5f601-e14f-4cdb-96ea-fd660be73771 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:58.664533 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c7d46-c6a7-4298-8d2d-a1b7a17e9d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:58.665676 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c7d46-c6a7-4298-8d2d-a1b7a17e9d2d None admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:58.666118 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c7d46-c6a7-4298-8d2d-a1b7a17e9d2d None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:58.666545 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c7d46-c6a7-4298-8d2d-a1b7a17e9d2d None admin] PATH_INFO: `/v3/projects/8dc5332abd014a54adc53ca64239c322/groups/c1d3893922a1415bb305c9b107765fd8/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:58.669809 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69c7d46-c6a7-4298-8d2d-a1b7a17e9d2d None admin] RBAC: Authorizing `identity:create_grant(project_id=8dc5332abd014a54adc53ca64239c322, group_id=c1d3893922a1415bb305c9b107765fd8, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:58.672264 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69c7d46-c6a7-4298-8d2d-a1b7a17e9d2d None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:58.694896 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 207/415] 10.222.0.49 () {58 vars in 1442 bytes} [Sun Aug 28 00:44:58 2022] PUT /identity/v3/projects/8dc5332abd014a54adc53ca64239c322/groups/c1d3893922a1415bb305c9b107765fd8/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:44:58.694896 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add7bb5-f4df-4af2-b11d-9fc1dbd01e67 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:58.694896 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add7bb5-f4df-4af2-b11d-9fc1dbd01e67 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:58.694896 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3add7bb5-f4df-4af2-b11d-9fc1dbd01e67 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:58.694896 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 208/416] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:44:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:44:58.694896 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3add7bb5-f4df-4af2-b11d-9fc1dbd01e67 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:58.707757 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f9a23-a794-435c-8c8b-69da35fce03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:58.708789 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f9a23-a794-435c-8c8b-69da35fce03d None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:58.709238 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f9a23-a794-435c-8c8b-69da35fce03d None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:58.709684 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f9a23-a794-435c-8c8b-69da35fce03d None admin] PATH_INFO: `/v3/projects/8f4ff55387564b158cecc09304291ac9` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:58.711948 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5f9a23-a794-435c-8c8b-69da35fce03d None admin] RBAC: Authorizing `identity:get_project(project_id=8f4ff55387564b158cecc09304291ac9)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:58.715497 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5f9a23-a794-435c-8c8b-69da35fce03d None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:58.723072 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 209/417] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 28 00:44:58 2022] GET /identity/v3/projects/8f4ff55387564b158cecc09304291ac9 => generated 344 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:44:58.729342 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ec8df-7a06-4793-905c-250e5cd0ebe4 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:58.729854 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ec8df-7a06-4793-905c-250e5cd0ebe4 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:58.730350 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ec8df-7a06-4793-905c-250e5cd0ebe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:58.758607 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-6d5ec8df-7a06-4793-905c-250e5cd0ebe4 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:44:58.759945 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-6d5ec8df-7a06-4793-905c-250e5cd0ebe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:44:58.772367 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:58.882793 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3add7bb5-f4df-4af2-b11d-9fc1dbd01e67 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:58.887856 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 210/418] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:44:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:44:58.889444 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ec8df-7a06-4793-905c-250e5cd0ebe4 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:58.909356 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:58.931339 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e902b1-8140-4ba9-8397-278ba560e9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:58.932636 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e902b1-8140-4ba9-8397-278ba560e9ac None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:58.933209 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e902b1-8140-4ba9-8397-278ba560e9ac None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:58.933701 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e902b1-8140-4ba9-8397-278ba560e9ac None admin] PATH_INFO: `/v3/roles/member` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:58.948003 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e902b1-8140-4ba9-8397-278ba560e9ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:44:58.955064 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-82e902b1-8140-4ba9-8397-278ba560e9ac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:44:58.955064 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:44:58.955064 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:44:58.955064 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:44:58.955064 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:44:58.955064 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:44:58.955064 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:44:58.955064 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:44:58.955064 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:44:58.955064 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:44:58.955064 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:44:58.955064 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:44:58.955064 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:44:58.955064 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:44:58.955064 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:44:58.955064 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:44:58.956692 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:44:58.956692 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:44:58.956692 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:44:58.956692 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:44:58.956692 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:44:58.956692 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:44:58.956692 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:44:58.956692 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:44:58.956692 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:44:58.956692 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:44:58.956692 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:44:58.956692 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:44:58.956692 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:44:58.956692 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:44:58.956692 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:44:58.956692 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:44:58.957534 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:44:58.957534 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:44:58.957534 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:44:58.957534 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:44:58.957534 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:44:58.957534 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:44:58.957534 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:44:58.957534 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:44:58.957534 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:44:58.957534 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:44:58.957534 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:44:58.957534 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:44:58.960120 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 209/419] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 28 00:44:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:44:58.968101 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e902b1-8140-4ba9-8397-278ba560e9ac None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:59.042457 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ec8df-7a06-4793-905c-250e5cd0ebe4 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:59.110286 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb49c1f8-9fb2-4453-a33a-24c654cc42ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:59.110975 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49c1f8-9fb2-4453-a33a-24c654cc42ac None admin] REQUEST_METHOD: `PUT` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:59.111254 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49c1f8-9fb2-4453-a33a-24c654cc42ac None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:59.111528 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49c1f8-9fb2-4453-a33a-24c654cc42ac None admin] PATH_INFO: `/v3/projects/8f4ff55387564b158cecc09304291ac9/groups/33d06b62de714b54b030d5438e3b3b5b/roles/2e4889bb71f9434392c0baba59f2534e` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:59.115647 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb49c1f8-9fb2-4453-a33a-24c654cc42ac None admin] RBAC: Authorizing `identity:create_grant(project_id=8f4ff55387564b158cecc09304291ac9, group_id=33d06b62de714b54b030d5438e3b3b5b, role_id=2e4889bb71f9434392c0baba59f2534e)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:59.117166 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb49c1f8-9fb2-4453-a33a-24c654cc42ac None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:59.141210 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 211/420] 10.222.0.49 () {58 vars in 1442 bytes} [Sun Aug 28 00:44:58 2022] PUT /identity/v3/projects/8f4ff55387564b158cecc09304291ac9/groups/33d06b62de714b54b030d5438e3b3b5b/roles/2e4889bb71f9434392c0baba59f2534e => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:44:59.204188 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:59.208958 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e902b1-8140-4ba9-8397-278ba560e9ac None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:59.284010 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f9aeac-3748-42ee-a432-fb853726516f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:59.285199 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9aeac-3748-42ee-a432-fb853726516f None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:59.285686 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9aeac-3748-42ee-a432-fb853726516f None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:59.286317 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f9aeac-3748-42ee-a432-fb853726516f None admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:59.287720 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f9aeac-3748-42ee-a432-fb853726516f None admin] RBAC: Adding query filter params (name=member) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:59.288273 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f9aeac-3748-42ee-a432-fb853726516f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:59.291301 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f9aeac-3748-42ee-a432-fb853726516f None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:59.294740 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb49c1f8-9fb2-4453-a33a-24c654cc42ac None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:59.309929 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 210/421] 10.222.0.49 () {56 vars in 1101 bytes} [Sun Aug 28 00:44:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:44:59.317440 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f9aeac-3748-42ee-a432-fb853726516f None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:59.408533 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:59.454753 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb49c1f8-9fb2-4453-a33a-24c654cc42ac None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:59.458898 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f9aeac-3748-42ee-a432-fb853726516f None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:59.510356 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7415a94-33a3-495e-a2b5-94086a219c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:59.511249 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7415a94-33a3-495e-a2b5-94086a219c09 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:59.511594 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7415a94-33a3-495e-a2b5-94086a219c09 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:59.511973 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7415a94-33a3-495e-a2b5-94086a219c09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:59.526514 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35401258-a2b1-461d-9cd2-d07a41ac62d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:59.527656 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35401258-a2b1-461d-9cd2-d07a41ac62d5 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:59.528272 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35401258-a2b1-461d-9cd2-d07a41ac62d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:59.528744 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35401258-a2b1-461d-9cd2-d07a41ac62d5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:59.567572 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35401258-a2b1-461d-9cd2-d07a41ac62d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:44:59.584752 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-35401258-a2b1-461d-9cd2-d07a41ac62d5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:44:59.584752 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:44:59.584752 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:44:59.584752 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:44:59.584752 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:44:59.584752 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:44:59.584752 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:44:59.584752 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:44:59.584752 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:44:59.584752 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:44:59.584752 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:44:59.584752 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:44:59.584752 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:44:59.584752 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:44:59.584752 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:44:59.584752 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:44:59.586881 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:44:59.586881 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:44:59.586881 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:44:59.586881 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:44:59.586881 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:44:59.586881 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:44:59.586881 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:44:59.586881 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:44:59.586881 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:44:59.586881 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:44:59.586881 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:44:59.586881 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:44:59.586881 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:44:59.586881 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:44:59.586881 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:44:59.586881 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:44:59.588948 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:44:59.588948 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:44:59.588948 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:44:59.588948 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:44:59.588948 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:44:59.588948 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:44:59.588948 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:44:59.588948 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:44:59.588948 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:44:59.588948 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:44:59.588948 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:44:59.588948 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:44:59.588948 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 212/422] 10.222.0.49 () {56 vars in 1114 bytes} [Sun Aug 28 00:44:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:44:59.595543 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35401258-a2b1-461d-9cd2-d07a41ac62d5 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:59.618269 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:59.711231 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7415a94-33a3-495e-a2b5-94086a219c09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:59.713173 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7415a94-33a3-495e-a2b5-94086a219c09 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:59.803318 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35401258-a2b1-461d-9cd2-d07a41ac62d5 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:44:59.864038 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:44:59.873808 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197800d9-78e0-4b16-8505-e0252dc6172f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:44:59.875348 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197800d9-78e0-4b16-8505-e0252dc6172f None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:44:59.875348 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197800d9-78e0-4b16-8505-e0252dc6172f None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:44:59.875348 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197800d9-78e0-4b16-8505-e0252dc6172f None admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:44:59.875738 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197800d9-78e0-4b16-8505-e0252dc6172f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:44:59.876350 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197800d9-78e0-4b16-8505-e0252dc6172f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:44:59.878718 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197800d9-78e0-4b16-8505-e0252dc6172f None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:44:59.895090 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 213/423] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 28 00:44:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:44:59.901833 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197800d9-78e0-4b16-8505-e0252dc6172f None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:59.923385 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 211/424] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 28 00:44:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 607 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:44:59.930235 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7415a94-33a3-495e-a2b5-94086a219c09 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:44:59.999844 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:00.048468 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7415a94-33a3-495e-a2b5-94086a219c09 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:00.093977 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc21570d-eddd-4d8e-89b2-05ef289847a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:00.097718 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21570d-eddd-4d8e-89b2-05ef289847a8 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:00.099278 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21570d-eddd-4d8e-89b2-05ef289847a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:00.102591 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21570d-eddd-4d8e-89b2-05ef289847a8 None admin] PATH_INFO: `/v3/projects/a8086350f8e74846828edcab8c1d0577` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:00.105090 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc21570d-eddd-4d8e-89b2-05ef289847a8 None admin] RBAC: Authorizing `identity:get_project(project_id=a8086350f8e74846828edcab8c1d0577)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:00.108143 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc21570d-eddd-4d8e-89b2-05ef289847a8 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:00.111445 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 212/425] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 28 00:44:59 2022] GET /identity/v3/projects/a8086350f8e74846828edcab8c1d0577 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:45:00.123157 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc21570d-eddd-4d8e-89b2-05ef289847a8 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:00.137947 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197800d9-78e0-4b16-8505-e0252dc6172f None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:00.228536 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed642601-c875-4868-899f-c52219bc50ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:00.229168 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed642601-c875-4868-899f-c52219bc50ef None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:00.229467 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed642601-c875-4868-899f-c52219bc50ef None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:00.229742 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed642601-c875-4868-899f-c52219bc50ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:00.287493 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc21570d-eddd-4d8e-89b2-05ef289847a8 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:00.324279 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:00.338552 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8384669b-c4a5-4515-a680-dabd02e64d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:00.340501 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8384669b-c4a5-4515-a680-dabd02e64d5c None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:00.341553 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8384669b-c4a5-4515-a680-dabd02e64d5c None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:00.342542 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8384669b-c4a5-4515-a680-dabd02e64d5c None admin] PATH_INFO: `/v3/groups/c1d3893922a1415bb305c9b107765fd8` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:00.345333 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8384669b-c4a5-4515-a680-dabd02e64d5c None admin] RBAC: Authorizing `identity:get_group(group_id=c1d3893922a1415bb305c9b107765fd8)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:00.348952 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8384669b-c4a5-4515-a680-dabd02e64d5c None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:00.353237 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 213/426] 10.222.0.49 () {56 vars in 1180 bytes} [Sun Aug 28 00:45:00 2022] GET /identity/v3/groups/c1d3893922a1415bb305c9b107765fd8 => generated 226 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:00.369187 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8384669b-c4a5-4515-a680-dabd02e64d5c None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:00.371981 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:00.394964 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed642601-c875-4868-899f-c52219bc50ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:00.396474 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed642601-c875-4868-899f-c52219bc50ef None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:00.587076 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8384669b-c4a5-4515-a680-dabd02e64d5c None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:00.627843 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 214/427] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 28 00:44:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 726 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:45:00.639657 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed642601-c875-4868-899f-c52219bc50ef None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:00.674732 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d56b21-66eb-401c-b61a-b3d89758ad93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:00.675951 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d56b21-66eb-401c-b61a-b3d89758ad93 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:00.676608 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d56b21-66eb-401c-b61a-b3d89758ad93 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:00.678053 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d56b21-66eb-401c-b61a-b3d89758ad93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:00.679253 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d56b21-66eb-401c-b61a-b3d89758ad93 None admin] RBAC: Adding query filter params (group.id=c1d3893922a1415bb305c9b107765fd8, role.id=7ac2391cc85a4d138e95e27cd0d09b26, scope.project.id=a8086350f8e74846828edcab8c1d0577) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:00.680814 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d56b21-66eb-401c-b61a-b3d89758ad93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:00.684629 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d56b21-66eb-401c-b61a-b3d89758ad93 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:00.698117 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 214/428] 10.222.0.49 () {56 vars in 1376 bytes} [Sun Aug 28 00:45:00 2022] GET /identity/v3/role_assignments?group.id=c1d3893922a1415bb305c9b107765fd8&scope.project.id=a8086350f8e74846828edcab8c1d0577&role.id=7ac2391cc85a4d138e95e27cd0d09b26 => generated 611 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:00.836221 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:00.850550 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed642601-c875-4868-899f-c52219bc50ef None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:00.890568 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79215f97-f765-4550-8a0b-2b77b385e7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:00.891501 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79215f97-f765-4550-8a0b-2b77b385e7eb None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:00.891947 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79215f97-f765-4550-8a0b-2b77b385e7eb None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:00.892351 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79215f97-f765-4550-8a0b-2b77b385e7eb None admin] PATH_INFO: `/v3/projects/a8086350f8e74846828edcab8c1d0577` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:00.894101 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79215f97-f765-4550-8a0b-2b77b385e7eb None admin] RBAC: Authorizing `identity:get_project(project_id=a8086350f8e74846828edcab8c1d0577)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:00.896455 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79215f97-f765-4550-8a0b-2b77b385e7eb None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:00.899584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 215/429] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 28 00:45:00 2022] GET /identity/v3/projects/a8086350f8e74846828edcab8c1d0577 => generated 298 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:00.905668 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d56b21-66eb-401c-b61a-b3d89758ad93 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:01.032258 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:01.096097 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d56b21-66eb-401c-b61a-b3d89758ad93 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:01.144452 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f9266-de6e-4b1c-b91b-fe1ed6724123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:01.145608 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f9266-de6e-4b1c-b91b-fe1ed6724123 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:01.146180 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f9266-de6e-4b1c-b91b-fe1ed6724123 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:01.146755 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f9266-de6e-4b1c-b91b-fe1ed6724123 None admin] PATH_INFO: `/v3/groups/c1d3893922a1415bb305c9b107765fd8` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:01.149032 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7f9266-de6e-4b1c-b91b-fe1ed6724123 None admin] RBAC: Authorizing `identity:get_group(group_id=c1d3893922a1415bb305c9b107765fd8)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:01.150787 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7f9266-de6e-4b1c-b91b-fe1ed6724123 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:01.153579 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 215/430] 10.222.0.49 () {56 vars in 1180 bytes} [Sun Aug 28 00:45:00 2022] GET /identity/v3/groups/c1d3893922a1415bb305c9b107765fd8 => generated 226 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:01.162323 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79215f97-f765-4550-8a0b-2b77b385e7eb None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:01.167466 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36592bb2-d33e-4279-85ce-643ef71eff26 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:01.168423 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36592bb2-d33e-4279-85ce-643ef71eff26 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:01.168833 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36592bb2-d33e-4279-85ce-643ef71eff26 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:01.172523 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 216/431] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:45:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:01.184033 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134288a-9747-4ef6-99af-7e2c2f39fcaa None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:01.186438 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134288a-9747-4ef6-99af-7e2c2f39fcaa None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:01.186846 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134288a-9747-4ef6-99af-7e2c2f39fcaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:01.220398 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-8134288a-9747-4ef6-99af-7e2c2f39fcaa None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:01.221882 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-8134288a-9747-4ef6-99af-7e2c2f39fcaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:01.345904 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79215f97-f765-4550-8a0b-2b77b385e7eb None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:01.351324 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 217/432] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:45:01.352914 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab56cf-5b49-49ab-8175-f34350562ecf None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:01.353204 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab56cf-5b49-49ab-8175-f34350562ecf None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:01.353520 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab56cf-5b49-49ab-8175-f34350562ecf None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:01.355434 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 218/433] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:45:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:01.363009 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8ca7a-cc4d-43e9-b2cb-39f75fc26443 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:01.363229 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8ca7a-cc4d-43e9-b2cb-39f75fc26443 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:01.367129 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8ca7a-cc4d-43e9-b2cb-39f75fc26443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:01.401693 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37321df-7f18-4d8a-b895-b9326fd519c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:01.402628 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37321df-7f18-4d8a-b895-b9326fd519c5 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:01.403057 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37321df-7f18-4d8a-b895-b9326fd519c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:01.403543 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37321df-7f18-4d8a-b895-b9326fd519c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:01.404579 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37321df-7f18-4d8a-b895-b9326fd519c5 None admin] RBAC: Adding query filter params (group.id=c1d3893922a1415bb305c9b107765fd8, role.id=5bcf10de71e7404aaef4d7878053be82, scope.project.id=a8086350f8e74846828edcab8c1d0577) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:01.405093 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37321df-7f18-4d8a-b895-b9326fd519c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:01.406201 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-caf8ca7a-cc4d-43e9-b2cb-39f75fc26443 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:01.407001 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37321df-7f18-4d8a-b895-b9326fd519c5 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:01.410505 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-caf8ca7a-cc4d-43e9-b2cb-39f75fc26443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:01.418098 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 216/434] 10.222.0.49 () {56 vars in 1376 bytes} [Sun Aug 28 00:45:01 2022] GET /identity/v3/role_assignments?group.id=c1d3893922a1415bb305c9b107765fd8&scope.project.id=a8086350f8e74846828edcab8c1d0577&role.id=5bcf10de71e7404aaef4d7878053be82 => generated 611 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:01.524433 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:01.555013 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 219/435] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:45:01.714183 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37321df-7f18-4d8a-b895-b9326fd519c5 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:01.758558 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:01.778669 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf152ca-0d3a-479f-91da-fce84e14b357 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:01.779985 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf152ca-0d3a-479f-91da-fce84e14b357 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:01.780799 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf152ca-0d3a-479f-91da-fce84e14b357 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:01.785380 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 220/436] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:45:01 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:01.793218 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3ae96-731c-4e4a-8601-67f88d448cb9 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:01.793858 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3ae96-731c-4e4a-8601-67f88d448cb9 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:01.794466 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3ae96-731c-4e4a-8601-67f88d448cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:01.820226 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-fcb3ae96-731c-4e4a-8601-67f88d448cb9 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:01.821602 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-fcb3ae96-731c-4e4a-8601-67f88d448cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:01.870398 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37321df-7f18-4d8a-b895-b9326fd519c5 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:01.906954 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046163c4-6676-4ec7-93a0-861d1a765c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:01.907632 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046163c4-6676-4ec7-93a0-861d1a765c26 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:01.907979 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046163c4-6676-4ec7-93a0-861d1a765c26 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:01.908176 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046163c4-6676-4ec7-93a0-861d1a765c26 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:01.918633 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046163c4-6676-4ec7-93a0-861d1a765c26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:45:01.919760 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 221/437] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:45:01.920647 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb3ae96-731c-4e4a-8601-67f88d448cb9 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:01.923963 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-046163c4-6676-4ec7-93a0-861d1a765c26 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:45:01.923963 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:01.923963 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:01.923963 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:01.923963 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:01.923963 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:01.923963 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:01.923963 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:01.923963 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:01.923963 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:01.923963 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:01.923963 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:01.923963 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:45:01.923963 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:45:01.923963 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:45:01.923963 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:45:01.924865 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:45:01.924865 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:45:01.924865 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:45:01.924865 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:45:01.924865 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:01.924865 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:01.924865 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:01.924865 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:01.924865 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:01.924865 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:01.924865 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:01.924865 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:01.924865 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:01.924865 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:01.924865 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:01.924865 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:01.925649 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:01.925649 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:01.925649 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:01.925649 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:01.925649 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:45:01.925649 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:45:01.925649 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:45:01.925649 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:45:01.925649 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:45:01.925649 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:45:01.925649 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 28 00:45:01.925649 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:01.925649 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 217/438] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 28 00:45:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:01.930995 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046163c4-6676-4ec7-93a0-861d1a765c26 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:02.036465 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb3ae96-731c-4e4a-8601-67f88d448cb9 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:02.038432 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:02.055299 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046163c4-6676-4ec7-93a0-861d1a765c26 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:02.057159 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:02.077755 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf77adcd-b89e-4373-83de-df008f5f47a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:02.078401 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77adcd-b89e-4373-83de-df008f5f47a2 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:02.078678 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77adcd-b89e-4373-83de-df008f5f47a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:02.078944 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf77adcd-b89e-4373-83de-df008f5f47a2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:02.090500 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf77adcd-b89e-4373-83de-df008f5f47a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:45:02.095423 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-cf77adcd-b89e-4373-83de-df008f5f47a2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:45:02.095423 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:02.095423 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:02.095423 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:02.095423 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:02.095423 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:02.095423 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:02.095423 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:02.095423 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:02.095423 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:02.095423 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:02.095423 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:02.095423 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:45:02.095423 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:45:02.095423 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:45:02.095423 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:45:02.096562 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:45:02.096562 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:45:02.096562 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:45:02.096562 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:45:02.096562 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:02.096562 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:02.096562 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:02.096562 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:02.096562 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:02.096562 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:02.096562 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:02.096562 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:02.096562 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:02.096562 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:02.096562 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:02.096562 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:02.097366 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:02.097366 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:02.097366 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:02.097366 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:02.097366 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:45:02.097366 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:45:02.097366 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:45:02.097366 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:45:02.097366 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:45:02.097366 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:45:02.097366 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:45:02.097366 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:02.097366 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 222/439] 10.222.0.49 () {56 vars in 1114 bytes} [Sun Aug 28 00:45:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:02.102086 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a17da9-00e1-4634-8b9b-b61fad513c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:02.102338 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf77adcd-b89e-4373-83de-df008f5f47a2 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:02.102819 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a17da9-00e1-4634-8b9b-b61fad513c9a None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:02.103101 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a17da9-00e1-4634-8b9b-b61fad513c9a None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:02.103405 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a17da9-00e1-4634-8b9b-b61fad513c9a None admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:02.104300 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a17da9-00e1-4634-8b9b-b61fad513c9a None admin] RBAC: Adding query filter params (name=member) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:02.104696 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a17da9-00e1-4634-8b9b-b61fad513c9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:02.106243 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a17da9-00e1-4634-8b9b-b61fad513c9a None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:02.122446 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 218/440] 10.222.0.49 () {56 vars in 1101 bytes} [Sun Aug 28 00:45:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:45:02.123892 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a17da9-00e1-4634-8b9b-b61fad513c9a None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:02.231192 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf77adcd-b89e-4373-83de-df008f5f47a2 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:02.247391 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a17da9-00e1-4634-8b9b-b61fad513c9a None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:02.273944 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c93dc-bc27-4101-b9b8-b9009d6403a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:02.274943 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c93dc-bc27-4101-b9b8-b9009d6403a8 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:02.275401 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c93dc-bc27-4101-b9b8-b9009d6403a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:02.275898 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c93dc-bc27-4101-b9b8-b9009d6403a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:02.277097 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59c93dc-bc27-4101-b9b8-b9009d6403a8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:02.277613 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59c93dc-bc27-4101-b9b8-b9009d6403a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:02.279811 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59c93dc-bc27-4101-b9b8-b9009d6403a8 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:02.284094 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d17c3-a3fc-4232-8b76-0b62304d6d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:02.284720 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d17c3-a3fc-4232-8b76-0b62304d6d3b None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:02.285001 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d17c3-a3fc-4232-8b76-0b62304d6d3b None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:02.285339 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d17c3-a3fc-4232-8b76-0b62304d6d3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:02.290828 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 223/441] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 28 00:45:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:02.291646 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c93dc-bc27-4101-b9b8-b9009d6403a8 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:02.306537 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:02.358206 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:02.375081 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1d17c3-a3fc-4232-8b76-0b62304d6d3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:02.377165 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1d17c3-a3fc-4232-8b76-0b62304d6d3b None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:02.444707 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c93dc-bc27-4101-b9b8-b9009d6403a8 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:02.484375 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9075a600-a09d-4ab1-9816-adc61898cf6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:02.485024 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9075a600-a09d-4ab1-9816-adc61898cf6f None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:02.485307 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9075a600-a09d-4ab1-9816-adc61898cf6f None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:02.485581 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9075a600-a09d-4ab1-9816-adc61898cf6f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:02.497956 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9075a600-a09d-4ab1-9816-adc61898cf6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:45:02.503461 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-9075a600-a09d-4ab1-9816-adc61898cf6f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:45:02.503461 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:02.503461 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:02.503461 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:02.503461 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:02.503461 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:02.503461 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:02.503461 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:02.503461 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:02.503461 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:02.503461 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:02.503461 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:02.503461 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:45:02.503461 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:45:02.503461 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:45:02.503461 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:45:02.504484 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:45:02.504484 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:45:02.504484 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:45:02.504484 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:45:02.504484 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:02.504484 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:02.504484 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:02.504484 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:02.504484 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:02.504484 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:02.504484 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:02.504484 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:02.504484 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:02.504484 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:02.504484 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:02.504484 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:02.505298 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:02.505298 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:02.505298 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:02.505298 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:02.505298 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:45:02.505298 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:45:02.505298 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:45:02.505298 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:45:02.505298 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:45:02.505298 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:45:02.505298 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:45:02.505298 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:02.505298 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 224/442] 10.222.0.49 () {56 vars in 1096 bytes} [Sun Aug 28 00:45:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:02.505954 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9075a600-a09d-4ab1-9816-adc61898cf6f None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:02.507726 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 219/443] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 28 00:45:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 28 00:45:02.511831 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d17c3-a3fc-4232-8b76-0b62304d6d3b None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:02.574874 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:02.637769 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:02.641064 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d17c3-a3fc-4232-8b76-0b62304d6d3b None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:02.641281 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9075a600-a09d-4ab1-9816-adc61898cf6f None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:02.683168 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa958ca8-876f-4d4e-aa46-be4d7721f9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:02.683850 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa958ca8-876f-4d4e-aa46-be4d7721f9b1 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:02.684154 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa958ca8-876f-4d4e-aa46-be4d7721f9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:02.684425 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa958ca8-876f-4d4e-aa46-be4d7721f9b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:02.695488 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3582eb4c-4bec-4f57-888f-6621169956cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:02.696282 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582eb4c-4bec-4f57-888f-6621169956cc None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:02.696564 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582eb4c-4bec-4f57-888f-6621169956cc None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:02.696839 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582eb4c-4bec-4f57-888f-6621169956cc None admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:02.697572 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3582eb4c-4bec-4f57-888f-6621169956cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:02.698001 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3582eb4c-4bec-4f57-888f-6621169956cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:02.699974 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3582eb4c-4bec-4f57-888f-6621169956cc None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:02.717095 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 220/444] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 28 00:45:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:45:02.717805 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3582eb4c-4bec-4f57-888f-6621169956cc None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:02.786435 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa958ca8-876f-4d4e-aa46-be4d7721f9b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:02.788375 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa958ca8-876f-4d4e-aa46-be4d7721f9b1 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:02.847949 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3582eb4c-4bec-4f57-888f-6621169956cc None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:02.859573 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:02.887816 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168aa0e-9b18-4e54-b8d1-cb12578664e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:02.890501 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168aa0e-9b18-4e54-b8d1-cb12578664e0 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:02.890501 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168aa0e-9b18-4e54-b8d1-cb12578664e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:02.890501 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168aa0e-9b18-4e54-b8d1-cb12578664e0 None admin] PATH_INFO: `/v3/projects/8dc5332abd014a54adc53ca64239c322` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:02.890501 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d168aa0e-9b18-4e54-b8d1-cb12578664e0 None admin] RBAC: Authorizing `identity:get_project(project_id=8dc5332abd014a54adc53ca64239c322)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:02.892765 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d168aa0e-9b18-4e54-b8d1-cb12578664e0 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:02.894140 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 221/445] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 28 00:45:02 2022] GET /identity/v3/projects/8dc5332abd014a54adc53ca64239c322 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:02.895154 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168aa0e-9b18-4e54-b8d1-cb12578664e0 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:02.918927 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:02.924657 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 225/446] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 28 00:45:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:45:02.926034 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa958ca8-876f-4d4e-aa46-be4d7721f9b1 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:03.012646 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168aa0e-9b18-4e54-b8d1-cb12578664e0 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:03.049674 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571e5575-c3e0-4fbd-937f-d92953d571b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:03.050282 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e5575-c3e0-4fbd-937f-d92953d571b2 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:03.050556 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e5575-c3e0-4fbd-937f-d92953d571b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:03.050834 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571e5575-c3e0-4fbd-937f-d92953d571b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:03.062548 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa958ca8-876f-4d4e-aa46-be4d7721f9b1 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:03.105602 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:03.121657 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e32390-e7e3-4288-95a9-7cf08cb1ca97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:03.122678 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e32390-e7e3-4288-95a9-7cf08cb1ca97 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:03.123159 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e32390-e7e3-4288-95a9-7cf08cb1ca97 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:03.123570 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e32390-e7e3-4288-95a9-7cf08cb1ca97 None admin] PATH_INFO: `/v3/groups/c1d3893922a1415bb305c9b107765fd8` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:03.125555 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e32390-e7e3-4288-95a9-7cf08cb1ca97 None admin] RBAC: Authorizing `identity:get_group(group_id=c1d3893922a1415bb305c9b107765fd8)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:03.127564 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e32390-e7e3-4288-95a9-7cf08cb1ca97 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:03.130164 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 226/447] 10.222.0.49 () {56 vars in 1180 bytes} [Sun Aug 28 00:45:02 2022] GET /identity/v3/groups/c1d3893922a1415bb305c9b107765fd8 => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:03.130637 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571e5575-c3e0-4fbd-937f-d92953d571b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:03.130963 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e32390-e7e3-4288-95a9-7cf08cb1ca97 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:03.132141 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571e5575-c3e0-4fbd-937f-d92953d571b2 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:03.216050 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:03.270821 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 222/448] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 28 00:45:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:45:03.271376 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e32390-e7e3-4288-95a9-7cf08cb1ca97 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:03.271728 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571e5575-c3e0-4fbd-937f-d92953d571b2 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:03.321479 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9829b6c7-0ab7-42d9-a8f0-49aee58f3478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:03.322559 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829b6c7-0ab7-42d9-a8f0-49aee58f3478 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:03.323053 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829b6c7-0ab7-42d9-a8f0-49aee58f3478 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:03.323511 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829b6c7-0ab7-42d9-a8f0-49aee58f3478 None admin] PATH_INFO: `/v3/projects/8dc5332abd014a54adc53ca64239c322` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:03.325676 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9829b6c7-0ab7-42d9-a8f0-49aee58f3478 None admin] RBAC: Authorizing `identity:get_project(project_id=8dc5332abd014a54adc53ca64239c322)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:03.328365 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9829b6c7-0ab7-42d9-a8f0-49aee58f3478 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:03.331586 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 227/449] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 28 00:45:03 2022] GET /identity/v3/projects/8dc5332abd014a54adc53ca64239c322 => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:03.332635 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9829b6c7-0ab7-42d9-a8f0-49aee58f3478 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:03.372854 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:03.400884 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571e5575-c3e0-4fbd-937f-d92953d571b2 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:03.439305 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badf6917-1621-4d0c-adee-90f6df57a503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:03.440008 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf6917-1621-4d0c-adee-90f6df57a503 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:03.440289 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf6917-1621-4d0c-adee-90f6df57a503 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:03.440556 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf6917-1621-4d0c-adee-90f6df57a503 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:03.441440 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badf6917-1621-4d0c-adee-90f6df57a503 None admin] RBAC: Adding query filter params (group.id=c1d3893922a1415bb305c9b107765fd8, role.id=7ac2391cc85a4d138e95e27cd0d09b26, scope.project.id=8dc5332abd014a54adc53ca64239c322) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:03.441744 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badf6917-1621-4d0c-adee-90f6df57a503 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:03.443268 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badf6917-1621-4d0c-adee-90f6df57a503 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:03.450372 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 223/450] 10.222.0.49 () {56 vars in 1376 bytes} [Sun Aug 28 00:45:03 2022] GET /identity/v3/role_assignments?group.id=c1d3893922a1415bb305c9b107765fd8&scope.project.id=8dc5332abd014a54adc53ca64239c322&role.id=7ac2391cc85a4d138e95e27cd0d09b26 => generated 611 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:03.451997 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badf6917-1621-4d0c-adee-90f6df57a503 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:03.474309 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9829b6c7-0ab7-42d9-a8f0-49aee58f3478 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:03.525529 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5ecd45-e981-4d45-9b37-66736819a752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:03.526263 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ecd45-e981-4d45-9b37-66736819a752 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:03.526543 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ecd45-e981-4d45-9b37-66736819a752 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:03.526923 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ecd45-e981-4d45-9b37-66736819a752 None admin] PATH_INFO: `/v3/projects/8f4ff55387564b158cecc09304291ac9` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:03.528410 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5ecd45-e981-4d45-9b37-66736819a752 None admin] RBAC: Authorizing `identity:get_project(project_id=8f4ff55387564b158cecc09304291ac9)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:03.530164 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5ecd45-e981-4d45-9b37-66736819a752 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:03.532129 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 228/451] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 28 00:45:03 2022] GET /identity/v3/projects/8f4ff55387564b158cecc09304291ac9 => generated 344 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:03.540628 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5ecd45-e981-4d45-9b37-66736819a752 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:03.547350 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:03.640753 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badf6917-1621-4d0c-adee-90f6df57a503 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:03.676668 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5ecd45-e981-4d45-9b37-66736819a752 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:03.696366 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde5aaf0-0793-4258-9a82-f7fb9ebc6138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:03.697172 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5aaf0-0793-4258-9a82-f7fb9ebc6138 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:03.697583 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5aaf0-0793-4258-9a82-f7fb9ebc6138 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:03.697769 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5aaf0-0793-4258-9a82-f7fb9ebc6138 None admin] PATH_INFO: `/v3/groups/c1d3893922a1415bb305c9b107765fd8` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:03.698972 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde5aaf0-0793-4258-9a82-f7fb9ebc6138 None admin] RBAC: Authorizing `identity:get_group(group_id=c1d3893922a1415bb305c9b107765fd8)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:03.700606 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde5aaf0-0793-4258-9a82-f7fb9ebc6138 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:03.702634 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 224/452] 10.222.0.49 () {56 vars in 1180 bytes} [Sun Aug 28 00:45:03 2022] GET /identity/v3/groups/c1d3893922a1415bb305c9b107765fd8 => generated 226 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:03.708608 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde5aaf0-0793-4258-9a82-f7fb9ebc6138 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:03.723397 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:03.726385 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5dbf07-5a82-479d-a949-57440c7c2a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:03.727178 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5dbf07-5a82-479d-a949-57440c7c2a3a None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:03.727530 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5dbf07-5a82-479d-a949-57440c7c2a3a None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:03.728731 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5dbf07-5a82-479d-a949-57440c7c2a3a None admin] PATH_INFO: `/v3/groups/33d06b62de714b54b030d5438e3b3b5b` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:03.729371 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5dbf07-5a82-479d-a949-57440c7c2a3a None admin] RBAC: Authorizing `identity:get_group(group_id=33d06b62de714b54b030d5438e3b3b5b)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:03.731028 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5dbf07-5a82-479d-a949-57440c7c2a3a None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:03.733071 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 229/453] 10.222.0.49 () {56 vars in 1180 bytes} [Sun Aug 28 00:45:03 2022] GET /identity/v3/groups/33d06b62de714b54b030d5438e3b3b5b => generated 229 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:45:03.739319 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5dbf07-5a82-479d-a949-57440c7c2a3a None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:03.847873 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:03.868564 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde5aaf0-0793-4258-9a82-f7fb9ebc6138 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:03.897950 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5dbf07-5a82-479d-a949-57440c7c2a3a None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:03.915886 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738692c0-b98e-4436-87f1-780aa1e1f79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:03.916501 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738692c0-b98e-4436-87f1-780aa1e1f79b None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:03.916776 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738692c0-b98e-4436-87f1-780aa1e1f79b None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:03.917044 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738692c0-b98e-4436-87f1-780aa1e1f79b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:03.917857 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738692c0-b98e-4436-87f1-780aa1e1f79b None admin] RBAC: Adding query filter params (group.id=c1d3893922a1415bb305c9b107765fd8, role.id=5bcf10de71e7404aaef4d7878053be82, scope.project.id=8dc5332abd014a54adc53ca64239c322) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:03.918167 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738692c0-b98e-4436-87f1-780aa1e1f79b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:03.919694 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738692c0-b98e-4436-87f1-780aa1e1f79b None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:03.943702 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 225/454] 10.222.0.49 () {56 vars in 1376 bytes} [Sun Aug 28 00:45:03 2022] GET /identity/v3/role_assignments?group.id=c1d3893922a1415bb305c9b107765fd8&scope.project.id=8dc5332abd014a54adc53ca64239c322&role.id=5bcf10de71e7404aaef4d7878053be82 => generated 611 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:45:03.946344 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41494e5-9ecb-41ff-9650-a7bec98a86ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:03.946968 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41494e5-9ecb-41ff-9650-a7bec98a86ab None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:03.947239 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41494e5-9ecb-41ff-9650-a7bec98a86ab None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:03.947502 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41494e5-9ecb-41ff-9650-a7bec98a86ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:03.948298 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41494e5-9ecb-41ff-9650-a7bec98a86ab None admin] RBAC: Adding query filter params (group.id=33d06b62de714b54b030d5438e3b3b5b, role.id=2e4889bb71f9434392c0baba59f2534e, scope.project.id=8f4ff55387564b158cecc09304291ac9) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:03.948655 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41494e5-9ecb-41ff-9650-a7bec98a86ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:03.950150 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41494e5-9ecb-41ff-9650-a7bec98a86ab None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:03.957590 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 230/455] 10.222.0.49 () {56 vars in 1376 bytes} [Sun Aug 28 00:45:03 2022] GET /identity/v3/role_assignments?group.id=33d06b62de714b54b030d5438e3b3b5b&scope.project.id=8f4ff55387564b158cecc09304291ac9&role.id=2e4889bb71f9434392c0baba59f2534e => generated 611 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:45:06.585869 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b3e02-3dbc-4821-b828-053c102b574b None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:06.586417 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b3e02-3dbc-4821-b828-053c102b574b None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:06.586570 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b3e02-3dbc-4821-b828-053c102b574b None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:06.588857 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 226/456] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:45:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:06.596014 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1ba4f-4de4-40e1-8111-8ffe641b2587 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:06.597036 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1ba4f-4de4-40e1-8111-8ffe641b2587 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:06.597512 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b1ba4f-4de4-40e1-8111-8ffe641b2587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:06.625381 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-23b1ba4f-4de4-40e1-8111-8ffe641b2587 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:06.627023 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-23b1ba4f-4de4-40e1-8111-8ffe641b2587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:06.720500 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 231/457] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:45:06.911322 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87417006-c13d-4a8d-8bd0-c1f75a2dab62 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:06.912100 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87417006-c13d-4a8d-8bd0-c1f75a2dab62 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:06.912640 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87417006-c13d-4a8d-8bd0-c1f75a2dab62 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:06.914742 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 227/458] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:45:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:06.920096 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a17a0f-a1cd-4c73-b0e3-4c9947d1f836 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:06.920371 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a17a0f-a1cd-4c73-b0e3-4c9947d1f836 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:06.920797 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a17a0f-a1cd-4c73-b0e3-4c9947d1f836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:06.949341 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-20a17a0f-a1cd-4c73-b0e3-4c9947d1f836 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:06.951749 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-20a17a0f-a1cd-4c73-b0e3-4c9947d1f836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:07.050521 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:07.059443 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 232/459] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:45:07.195481 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87417006-c13d-4a8d-8bd0-c1f75a2dab62 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:07.311691 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:07.339158 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96548bd0-6333-4345-82d0-a7446585b373 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:07.340059 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96548bd0-6333-4345-82d0-a7446585b373 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:07.340633 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96548bd0-6333-4345-82d0-a7446585b373 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:07.342991 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 233/460] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:45:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:07.355695 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87417006-c13d-4a8d-8bd0-c1f75a2dab62 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:07.356566 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afbed09-6a08-4375-95b7-b4732e80bf66 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:07.357312 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afbed09-6a08-4375-95b7-b4732e80bf66 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:07.358077 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afbed09-6a08-4375-95b7-b4732e80bf66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:07.391456 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-1afbed09-6a08-4375-95b7-b4732e80bf66 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:07.393019 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-1afbed09-6a08-4375-95b7-b4732e80bf66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:07.397156 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca398e-2735-4f25-8fa5-1872c1e3b9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:07.398440 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca398e-2735-4f25-8fa5-1872c1e3b9f5 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:07.398986 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca398e-2735-4f25-8fa5-1872c1e3b9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:07.399454 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca398e-2735-4f25-8fa5-1872c1e3b9f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:07.420566 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfca398e-2735-4f25-8fa5-1872c1e3b9f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:07.423032 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfca398e-2735-4f25-8fa5-1872c1e3b9f5 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:07.448399 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-bfca398e-2735-4f25-8fa5-1872c1e3b9f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:07.448399 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:07.448399 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:07.448399 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:07.448399 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:07.448399 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:07.448399 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:07.448399 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:07.448399 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:07.448399 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:07.448399 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:07.448399 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:07.448399 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:45:07.448399 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:45:07.448399 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:45:07.448399 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:45:07.449551 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:07.449551 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:07.449551 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:07.449551 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:07.449551 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:07.449551 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:07.449551 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:07.449551 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:07.449551 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:07.449551 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:07.449551 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:07.449551 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:07.449551 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:07.449551 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:07.449551 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:07.449551 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:07.449551 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:45:07.451288 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:45:07.451288 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:07.451288 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:07.451288 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 228/461] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:07.451288 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca398e-2735-4f25-8fa5-1872c1e3b9f5 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:07.490799 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 234/462] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:45:07.492054 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afbed09-6a08-4375-95b7-b4732e80bf66 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:07.608681 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca398e-2735-4f25-8fa5-1872c1e3b9f5 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:07.609851 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afbed09-6a08-4375-95b7-b4732e80bf66 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:07.639567 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:07.645788 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:07.651840 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a008bc9-9beb-4c70-bd61-4ea4ebd3f810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:07.653065 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a008bc9-9beb-4c70-bd61-4ea4ebd3f810 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:07.653553 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a008bc9-9beb-4c70-bd61-4ea4ebd3f810 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:07.654183 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a008bc9-9beb-4c70-bd61-4ea4ebd3f810 None admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:07.655063 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a008bc9-9beb-4c70-bd61-4ea4ebd3f810 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:07.655751 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a008bc9-9beb-4c70-bd61-4ea4ebd3f810 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:07.657874 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a008bc9-9beb-4c70-bd61-4ea4ebd3f810 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:07.662821 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b005641-91df-4d39-8f94-b32aba0e7f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:07.663652 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b005641-91df-4d39-8f94-b32aba0e7f11 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:07.664017 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b005641-91df-4d39-8f94-b32aba0e7f11 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:07.664361 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b005641-91df-4d39-8f94-b32aba0e7f11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:07.673194 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 235/463] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:45:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:07.682707 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b005641-91df-4d39-8f94-b32aba0e7f11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:07.685016 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b005641-91df-4d39-8f94-b32aba0e7f11 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:07.685163 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a008bc9-9beb-4c70-bd61-4ea4ebd3f810 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:07.726601 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-8b005641-91df-4d39-8f94-b32aba0e7f11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:07.726601 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:07.726601 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:07.726601 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:07.726601 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:07.726601 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:07.726601 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:07.726601 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:07.726601 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:07.726601 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:07.726601 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:07.726601 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:07.726601 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:45:07.726601 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:45:07.726601 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:45:07.726601 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:45:07.727700 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:07.727700 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:07.727700 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:07.727700 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:07.727700 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:07.727700 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:07.727700 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:07.727700 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:07.727700 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:07.727700 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:07.727700 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:07.727700 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:07.727700 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:07.727700 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:07.727700 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:07.727700 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:07.727700 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:45:07.728566 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:45:07.728566 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:07.728566 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:07.728566 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 229/464] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:07.735767 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b005641-91df-4d39-8f94-b32aba0e7f11 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:07.824818 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a008bc9-9beb-4c70-bd61-4ea4ebd3f810 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:07.863518 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a86067-db89-42c8-93e2-d03d7900b8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:07.864456 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a86067-db89-42c8-93e2-d03d7900b8bb None admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:07.864881 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a86067-db89-42c8-93e2-d03d7900b8bb None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:07.865374 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a86067-db89-42c8-93e2-d03d7900b8bb None admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:07.866360 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a86067-db89-42c8-93e2-d03d7900b8bb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:07.868334 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a86067-db89-42c8-93e2-d03d7900b8bb None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:07.899839 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 236/465] 10.222.0.49 () {60 vars in 1132 bytes} [Sun Aug 28 00:45:07 2022] POST /identity/v3/users => generated 246 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:45:07.901435 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7fc04-dfce-47a1-9862-15660e863af3 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:07.902011 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7fc04-dfce-47a1-9862-15660e863af3 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:07.902518 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7fc04-dfce-47a1-9862-15660e863af3 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:07.904772 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 237/466] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:45:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:07.917537 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17750662-f011-4c0f-ac51-baf30d26216d None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:07.918168 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17750662-f011-4c0f-ac51-baf30d26216d None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:07.918724 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17750662-f011-4c0f-ac51-baf30d26216d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:07.946810 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b005641-91df-4d39-8f94-b32aba0e7f11 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:07.976998 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-17750662-f011-4c0f-ac51-baf30d26216d None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:07.978147 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-17750662-f011-4c0f-ac51-baf30d26216d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:07.993866 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114e7587-2fb2-4408-8d01-3afcee7369d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:07.994513 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e7587-2fb2-4408-8d01-3afcee7369d3 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:07.994905 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e7587-2fb2-4408-8d01-3afcee7369d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:07.995184 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e7587-2fb2-4408-8d01-3afcee7369d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:07.996096 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114e7587-2fb2-4408-8d01-3afcee7369d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:07.996395 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114e7587-2fb2-4408-8d01-3afcee7369d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:07.998171 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114e7587-2fb2-4408-8d01-3afcee7369d3 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:08.020418 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 230/467] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:45:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:08.021893 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e24e30-f339-4798-965d-068be1c3ede8 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:08.022193 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e24e30-f339-4798-965d-068be1c3ede8 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:08.022496 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e24e30-f339-4798-965d-068be1c3ede8 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:08.023870 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 231/468] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:45:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:08.024755 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e24e30-f339-4798-965d-068be1c3ede8 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:08.040648 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:08.087718 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 238/469] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:45:08.090323 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:08.094223 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17750662-f011-4c0f-ac51-baf30d26216d None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:08.203182 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e24e30-f339-4798-965d-068be1c3ede8 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:08.264866 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17750662-f011-4c0f-ac51-baf30d26216d None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:08.271230 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a38ef7-5813-421a-bead-af99f06842ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:08.272017 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a38ef7-5813-421a-bead-af99f06842ee None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:08.272389 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a38ef7-5813-421a-bead-af99f06842ee None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:08.272845 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a38ef7-5813-421a-bead-af99f06842ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:08.293045 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a38ef7-5813-421a-bead-af99f06842ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:08.296001 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a38ef7-5813-421a-bead-af99f06842ee None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:08.314463 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb474d2-6598-4f8d-b6e1-2d7c516c31f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:08.314933 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-66a38ef7-5813-421a-bead-af99f06842ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:08.314933 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:08.314933 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:08.314933 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:08.314933 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:08.314933 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:08.314933 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:08.314933 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:08.314933 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:08.314933 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:08.314933 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:08.314933 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:08.314933 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:45:08.314933 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:45:08.314933 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:45:08.314933 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:45:08.316760 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:08.316760 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:08.316760 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:08.316760 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:08.316760 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:08.316760 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:08.316760 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:08.316760 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:08.316760 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:08.316760 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:08.316760 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:08.316760 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:08.316760 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:08.316760 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:08.316760 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:08.316760 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:08.316760 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:45:08.317890 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:45:08.317890 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:08.317890 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:08.317890 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 232/470] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:08.319411 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb474d2-6598-4f8d-b6e1-2d7c516c31f6 None admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:08.320037 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb474d2-6598-4f8d-b6e1-2d7c516c31f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:08.320727 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb474d2-6598-4f8d-b6e1-2d7c516c31f6 None admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:08.322247 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4475f-f1be-4a2b-98ef-22529329e8f8 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:08.322410 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb474d2-6598-4f8d-b6e1-2d7c516c31f6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:08.322683 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4475f-f1be-4a2b-98ef-22529329e8f8 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:08.322954 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4475f-f1be-4a2b-98ef-22529329e8f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:08.325992 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb474d2-6598-4f8d-b6e1-2d7c516c31f6 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:08.344572 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-f3d4475f-f1be-4a2b-98ef-22529329e8f8 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:08.346315 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-f3d4475f-f1be-4a2b-98ef-22529329e8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:08.355362 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 239/471] 10.222.0.49 () {60 vars in 1132 bytes} [Sun Aug 28 00:45:08 2022] POST /identity/v3/users => generated 248 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:45:08.357615 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb474d2-6598-4f8d-b6e1-2d7c516c31f6 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:08.401970 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:08.440352 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 233/472] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:45:08.441706 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d4475f-f1be-4a2b-98ef-22529329e8f8 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:08.467961 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:08.509211 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb474d2-6598-4f8d-b6e1-2d7c516c31f6 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:08.551105 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ae190-d493-445a-b08a-9eacc5452694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:08.551692 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ae190-d493-445a-b08a-9eacc5452694 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:08.551995 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ae190-d493-445a-b08a-9eacc5452694 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:08.552269 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ae190-d493-445a-b08a-9eacc5452694 None admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:08.552921 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26ae190-d493-445a-b08a-9eacc5452694 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:08.553226 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26ae190-d493-445a-b08a-9eacc5452694 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:08.554773 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26ae190-d493-445a-b08a-9eacc5452694 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:08.562105 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d4475f-f1be-4a2b-98ef-22529329e8f8 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:08.569842 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 240/473] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:45:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:08.576030 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ae190-d493-445a-b08a-9eacc5452694 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:08.608791 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a62e7a1-3622-43bc-98c4-22ed65c585f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:08.610315 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62e7a1-3622-43bc-98c4-22ed65c585f9 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:08.610892 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62e7a1-3622-43bc-98c4-22ed65c585f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:08.611580 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62e7a1-3622-43bc-98c4-22ed65c585f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:08.626558 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a62e7a1-3622-43bc-98c4-22ed65c585f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:08.628674 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a62e7a1-3622-43bc-98c4-22ed65c585f9 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:08.649988 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-8a62e7a1-3622-43bc-98c4-22ed65c585f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:08.649988 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:08.649988 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:08.649988 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:08.649988 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:08.649988 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:08.649988 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:08.649988 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:08.649988 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:08.649988 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:08.649988 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:08.649988 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:08.649988 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:45:08.649988 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:45:08.649988 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:45:08.649988 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:45:08.651062 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:08.651062 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:08.651062 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:08.651062 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:08.651062 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:08.651062 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:08.651062 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:08.651062 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:08.651062 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:08.651062 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:08.651062 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:08.651062 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:08.651062 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:08.651062 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:08.651062 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:08.651062 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:08.651062 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:45:08.652116 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:45:08.652116 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:08.652116 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:08.654510 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 234/474] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:08.660435 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a62e7a1-3622-43bc-98c4-22ed65c585f9 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:08.706767 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:08.729646 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ae190-d493-445a-b08a-9eacc5452694 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:08.753326 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:08.775710 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ab8e46-af30-4428-ac09-76c2d236c772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:08.776622 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab8e46-af30-4428-ac09-76c2d236c772 None admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:08.777228 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab8e46-af30-4428-ac09-76c2d236c772 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:08.778052 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab8e46-af30-4428-ac09-76c2d236c772 None admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:08.779103 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ab8e46-af30-4428-ac09-76c2d236c772 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:08.780924 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ab8e46-af30-4428-ac09-76c2d236c772 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:08.792113 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a62e7a1-3622-43bc-98c4-22ed65c585f9 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:08.810942 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 241/475] 10.222.0.49 () {60 vars in 1132 bytes} [Sun Aug 28 00:45:08 2022] POST /identity/v3/users => generated 248 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:45:08.844386 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7293de9-f7fb-45c0-9b4c-a4fb54ea56b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:08.845135 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7293de9-f7fb-45c0-9b4c-a4fb54ea56b5 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:08.845411 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7293de9-f7fb-45c0-9b4c-a4fb54ea56b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:08.845858 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7293de9-f7fb-45c0-9b4c-a4fb54ea56b5 None admin] PATH_INFO: `/v3/domains` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:08.846679 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7293de9-f7fb-45c0-9b4c-a4fb54ea56b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:08.847128 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7293de9-f7fb-45c0-9b4c-a4fb54ea56b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:08.848767 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7293de9-f7fb-45c0-9b4c-a4fb54ea56b5 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:08.870090 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 235/476] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:45:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:45:08.876563 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ab8e46-af30-4428-ac09-76c2d236c772 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:08.900532 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7293de9-f7fb-45c0-9b4c-a4fb54ea56b5 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:09.077373 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7293de9-f7fb-45c0-9b4c-a4fb54ea56b5 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:09.082168 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ab8e46-af30-4428-ac09-76c2d236c772 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:09.110085 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:09.116250 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4dce62-c511-4f30-8ffa-6eb149836fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:09.116882 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4dce62-c511-4f30-8ffa-6eb149836fda None admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:09.117406 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4dce62-c511-4f30-8ffa-6eb149836fda None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:09.117937 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4dce62-c511-4f30-8ffa-6eb149836fda None admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:09.118801 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4dce62-c511-4f30-8ffa-6eb149836fda None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:09.120547 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4dce62-c511-4f30-8ffa-6eb149836fda None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:09.127293 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a2811-7131-447e-9b4c-15d770201659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:09.128893 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a2811-7131-447e-9b4c-15d770201659 None admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:09.128893 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a2811-7131-447e-9b4c-15d770201659 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:09.128893 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a2811-7131-447e-9b4c-15d770201659 None admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:09.129546 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552a2811-7131-447e-9b4c-15d770201659 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:09.130528 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.sql.core [None req-1d4dce62-c511-4f30-8ffa-6eb149836fda None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 28 00:45:09.130528 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 28 00:45:09.130528 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [parameters: {'id': '2c510e4b777e411eb9de830dc2f1af55', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 28 00:45:09.130528 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81808) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 28 00:45:09.131464 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552a2811-7131-447e-9b4c-15d770201659 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:09.152808 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-1d4dce62-c511-4f30-8ffa-6eb149836fda None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 28 00:45:09.152808 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:09.152808 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 28 00:45:09.152808 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 28 00:45:09.152808 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 28 00:45:09.152808 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 28 00:45:09.152808 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 28 00:45:09.152808 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application result = self._query(query) Aug 28 00:45:09.152808 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 28 00:45:09.152808 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application conn.query(q) Aug 28 00:45:09.152808 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 28 00:45:09.152808 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 28 00:45:09.152808 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 28 00:45:09.152808 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application result.read() Aug 28 00:45:09.152808 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 28 00:45:09.153858 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 28 00:45:09.153858 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 28 00:45:09.153858 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 28 00:45:09.153858 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 28 00:45:09.153858 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 28 00:45:09.153858 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 28 00:45:09.153858 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 28 00:45:09.153858 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 28 00:45:09.153858 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:09.153858 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 28 00:45:09.153858 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:09.153858 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:09.153858 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 28 00:45:09.153858 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 28 00:45:09.153858 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 28 00:45:09.153858 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return ref.to_dict() Aug 28 00:45:09.153858 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 28 00:45:09.153858 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application next(self.gen) Aug 28 00:45:09.154922 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 28 00:45:09.154922 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application yield resource Aug 28 00:45:09.154922 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 28 00:45:09.154922 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application next(self.gen) Aug 28 00:45:09.154922 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 28 00:45:09.154922 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application self.session.rollback() Aug 28 00:45:09.154922 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 28 00:45:09.154922 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application self.force_reraise() Aug 28 00:45:09.154922 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 28 00:45:09.154922 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise self.value Aug 28 00:45:09.154922 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 28 00:45:09.154922 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 28 00:45:09.154922 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 28 00:45:09.154922 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application session.commit() Aug 28 00:45:09.154922 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 28 00:45:09.154922 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 28 00:45:09.154922 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 28 00:45:09.155873 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application self._prepare_impl() Aug 28 00:45:09.155873 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 28 00:45:09.155873 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application self.session.flush() Aug 28 00:45:09.155873 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 28 00:45:09.155873 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application self._flush(objects) Aug 28 00:45:09.155873 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 28 00:45:09.155873 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 28 00:45:09.155873 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 28 00:45:09.155873 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application compat.raise_( Aug 28 00:45:09.155873 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 28 00:45:09.155873 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception Aug 28 00:45:09.155873 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 28 00:45:09.155873 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application flush_context.execute() Aug 28 00:45:09.155873 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 28 00:45:09.155873 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rec.execute(self) Aug 28 00:45:09.155873 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 28 00:45:09.155873 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 28 00:45:09.156807 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 28 00:45:09.156807 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 28 00:45:09.156807 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 28 00:45:09.156807 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 28 00:45:09.156807 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 28 00:45:09.156807 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 28 00:45:09.156807 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 28 00:45:09.156807 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 28 00:45:09.156807 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 28 00:45:09.156807 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 28 00:45:09.156807 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 28 00:45:09.156807 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 28 00:45:09.156807 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 28 00:45:09.156807 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 28 00:45:09.156807 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 28 00:45:09.156807 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception Aug 28 00:45:09.157727 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 28 00:45:09.157727 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 28 00:45:09.157727 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 28 00:45:09.157727 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 28 00:45:09.157727 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 28 00:45:09.157727 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application result = self._query(query) Aug 28 00:45:09.157727 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 28 00:45:09.157727 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application conn.query(q) Aug 28 00:45:09.157727 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 28 00:45:09.157727 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 28 00:45:09.157727 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 28 00:45:09.157727 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application result.read() Aug 28 00:45:09.157727 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 28 00:45:09.157727 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 28 00:45:09.157727 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 28 00:45:09.157727 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 28 00:45:09.158568 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 28 00:45:09.158568 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 28 00:45:09.158568 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 28 00:45:09.158568 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 28 00:45:09.158568 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 28 00:45:09.158568 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 28 00:45:09.158568 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [parameters: {'id': '2c510e4b777e411eb9de830dc2f1af55', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 28 00:45:09.158568 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 28 00:45:09.158568 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:09.158568 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:45:09.158568 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:09.158568 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:09.158568 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:09.158568 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:09.158568 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:09.158568 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:09.159411 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:09.159411 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:09.159411 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:09.159411 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:09.159411 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:09.159411 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:09.159411 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 28 00:45:09.159411 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 28 00:45:09.159411 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:09.159411 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:09.159411 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 28 00:45:09.159411 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 28 00:45:09.159411 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 28 00:45:09.159411 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 28 00:45:09.159411 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 28 00:45:09.159411 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:09.160853 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 242/477] 10.222.0.49 () {60 vars in 1132 bytes} [Sun Aug 28 00:45:08 2022] POST /identity/v3/users => generated 249 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:45:09.161695 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:09.163779 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 236/478] 10.222.0.49 () {60 vars in 1131 bytes} [Sun Aug 28 00:45:08 2022] POST /identity/v3/roles => generated 144 bytes in 264 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:45:09.170268 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a2811-7131-447e-9b4c-15d770201659 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:09.332246 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a2811-7131-447e-9b4c-15d770201659 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:09.389762 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08971137-af6b-4753-941e-ed620b41f2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:09.390566 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08971137-af6b-4753-941e-ed620b41f2c5 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:09.391474 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08971137-af6b-4753-941e-ed620b41f2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:09.391912 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08971137-af6b-4753-941e-ed620b41f2c5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:09.406107 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08971137-af6b-4753-941e-ed620b41f2c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:45:09.414439 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-08971137-af6b-4753-941e-ed620b41f2c5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:45:09.414439 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:09.414439 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:09.414439 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:09.414439 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:09.414439 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:09.414439 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:09.414439 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:09.414439 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:09.414439 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:09.414439 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:09.414439 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:09.414439 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:45:09.414439 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:45:09.414439 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:45:09.414439 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:45:09.415385 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:45:09.415385 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:45:09.415385 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:45:09.415385 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:45:09.415385 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:09.415385 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:09.415385 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:09.415385 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:09.415385 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:09.415385 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:09.415385 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:09.415385 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:09.415385 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:09.415385 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:09.415385 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:09.415385 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:09.416215 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:09.416215 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:09.416215 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:09.416215 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:09.416215 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:45:09.416215 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:45:09.416215 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:45:09.416215 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:45:09.416215 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:45:09.416215 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:45:09.416215 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 28 00:45:09.416215 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:09.416215 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 243/479] 10.222.0.49 () {56 vars in 1114 bytes} [Sun Aug 28 00:45:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:09.421799 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4dce62-c511-4f30-8ffa-6eb149836fda None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:09.583344 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4dce62-c511-4f30-8ffa-6eb149836fda None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:09.634735 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c617dfcd-2c1b-4c43-9280-e0e9e8b5c410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:09.635398 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c617dfcd-2c1b-4c43-9280-e0e9e8b5c410 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:09.635733 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c617dfcd-2c1b-4c43-9280-e0e9e8b5c410 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:09.636320 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c617dfcd-2c1b-4c43-9280-e0e9e8b5c410 None admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:09.637009 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c617dfcd-2c1b-4c43-9280-e0e9e8b5c410 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:09.637313 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c617dfcd-2c1b-4c43-9280-e0e9e8b5c410 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:09.638906 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c617dfcd-2c1b-4c43-9280-e0e9e8b5c410 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:09.648892 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 237/480] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 28 00:45:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:10.741802 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a09b1e-b1c3-499a-88ec-b6beff8faa8b None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:10.743060 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a09b1e-b1c3-499a-88ec-b6beff8faa8b None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:10.743868 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a09b1e-b1c3-499a-88ec-b6beff8faa8b None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:10.746898 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 244/481] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:45:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:10.755158 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ae077-bee0-4813-a971-47170db1caaa None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:10.756232 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ae077-bee0-4813-a971-47170db1caaa None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:10.756700 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ae077-bee0-4813-a971-47170db1caaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:10.785146 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-ff9ae077-bee0-4813-a971-47170db1caaa None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:10.786342 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-ff9ae077-bee0-4813-a971-47170db1caaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:10.870503 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:10.894990 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 238/482] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:45:11.304254 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bbdbbe-9ea2-4c9d-8cf8-1c4deffa2365 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:11.304773 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bbdbbe-9ea2-4c9d-8cf8-1c4deffa2365 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:11.305209 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bbdbbe-9ea2-4c9d-8cf8-1c4deffa2365 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:11.307067 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 245/483] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:45:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:11.312725 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dcb6db-2f9b-4e60-b16f-9dba395baf69 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:11.313204 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dcb6db-2f9b-4e60-b16f-9dba395baf69 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:11.313643 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dcb6db-2f9b-4e60-b16f-9dba395baf69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:11.342885 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-c3dcb6db-2f9b-4e60-b16f-9dba395baf69 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:11.344362 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-c3dcb6db-2f9b-4e60-b16f-9dba395baf69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:11.432156 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 239/484] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:45:11.449274 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bbdbbe-9ea2-4c9d-8cf8-1c4deffa2365 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:11.564790 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:11.610433 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0caf6f-195d-4d4f-a272-8c118a21711c None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:11.611081 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0caf6f-195d-4d4f-a272-8c118a21711c None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:11.611526 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0caf6f-195d-4d4f-a272-8c118a21711c None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:11.613453 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 240/485] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:45:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:11.619650 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7299ff7-ed46-4023-b814-711b6c88b918 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:11.619958 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7299ff7-ed46-4023-b814-711b6c88b918 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:11.620236 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7299ff7-ed46-4023-b814-711b6c88b918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:11.636588 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bbdbbe-9ea2-4c9d-8cf8-1c4deffa2365 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:11.657393 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-e7299ff7-ed46-4023-b814-711b6c88b918 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:11.658657 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-e7299ff7-ed46-4023-b814-711b6c88b918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:11.708418 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aee0cd-4a66-4631-8de9-4f966f42db0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:11.709213 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aee0cd-4a66-4631-8de9-4f966f42db0d None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:11.709494 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aee0cd-4a66-4631-8de9-4f966f42db0d None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:11.709816 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aee0cd-4a66-4631-8de9-4f966f42db0d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:11.727368 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aee0cd-4a66-4631-8de9-4f966f42db0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:45:11.740708 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-f6aee0cd-4a66-4631-8de9-4f966f42db0d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:45:11.740708 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:11.740708 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:11.740708 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:11.740708 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:11.740708 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:11.740708 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:11.740708 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:11.740708 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:11.740708 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:11.740708 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:11.740708 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:11.740708 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:45:11.740708 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:45:11.740708 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:45:11.740708 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:45:11.741917 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:45:11.741917 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:45:11.741917 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:45:11.741917 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:45:11.741917 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:11.741917 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:11.741917 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:11.741917 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:11.741917 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:11.741917 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:11.741917 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:11.741917 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:11.741917 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:11.741917 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:11.741917 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:11.741917 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:11.743246 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:11.743246 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:11.743246 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:11.743246 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:11.743246 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:45:11.743246 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:45:11.743246 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:45:11.743246 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:45:11.743246 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:45:11.743246 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:45:11.743246 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:45:11.743246 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:11.743246 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 246/486] 10.222.0.49 () {56 vars in 1102 bytes} [Sun Aug 28 00:45:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:11.748934 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aee0cd-4a66-4631-8de9-4f966f42db0d None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:11.783839 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 241/487] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:45:11.785785 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7299ff7-ed46-4023-b814-711b6c88b918 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:11.845698 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:11.898531 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aee0cd-4a66-4631-8de9-4f966f42db0d None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:11.907563 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7299ff7-ed46-4023-b814-711b6c88b918 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:11.940357 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:11.950165 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d21ba92-3c54-4c27-b089-9d2d6f5e37c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:11.951356 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d21ba92-3c54-4c27-b089-9d2d6f5e37c9 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:11.951868 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d21ba92-3c54-4c27-b089-9d2d6f5e37c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:11.952353 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d21ba92-3c54-4c27-b089-9d2d6f5e37c9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:11.960210 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a15b5-5ab7-4a10-9922-c1085b881e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:11.960840 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a15b5-5ab7-4a10-9922-c1085b881e78 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:11.961118 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a15b5-5ab7-4a10-9922-c1085b881e78 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:11.961387 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a15b5-5ab7-4a10-9922-c1085b881e78 None admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:11.962180 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1a15b5-5ab7-4a10-9922-c1085b881e78 None admin] RBAC: Adding query filter params (name=service) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:11.962485 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1a15b5-5ab7-4a10-9922-c1085b881e78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:11.964103 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1a15b5-5ab7-4a10-9922-c1085b881e78 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:11.967092 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d21ba92-3c54-4c27-b089-9d2d6f5e37c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:45:11.973315 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-3d21ba92-3c54-4c27-b089-9d2d6f5e37c9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:45:11.973315 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:11.973315 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:11.973315 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:11.973315 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:11.973315 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:11.973315 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:11.973315 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:11.973315 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:11.973315 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:11.973315 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:11.973315 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:11.973315 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:45:11.973315 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:45:11.973315 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:45:11.973315 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:45:11.974265 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:45:11.974265 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:45:11.974265 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:45:11.974265 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:45:11.974265 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:11.974265 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:11.974265 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:11.974265 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:11.974265 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:11.974265 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:11.974265 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:11.974265 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:11.974265 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:11.974265 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:11.974265 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:11.974265 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:11.975071 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:11.975071 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:11.975071 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:11.975071 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:11.975071 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:45:11.975071 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:45:11.975071 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:45:11.975071 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:45:11.975071 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:45:11.975071 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:45:11.975071 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:45:11.975071 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:11.975739 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 247/488] 10.222.0.49 () {56 vars in 1103 bytes} [Sun Aug 28 00:45:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:45:11.975739 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3541ac1-5574-455e-bfe4-797c41550c47 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:11.976453 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3541ac1-5574-455e-bfe4-797c41550c47 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:11.976551 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3541ac1-5574-455e-bfe4-797c41550c47 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:11.978088 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 248/489] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:45:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:11.978320 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 242/490] 10.222.0.49 () {56 vars in 1102 bytes} [Sun Aug 28 00:45:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:11.983717 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d21ba92-3c54-4c27-b089-9d2d6f5e37c9 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:11.986784 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16724f-78df-4069-9e4e-579ef814ee28 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:11.986784 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16724f-78df-4069-9e4e-579ef814ee28 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:11.986784 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16724f-78df-4069-9e4e-579ef814ee28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:12.011007 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-ce16724f-78df-4069-9e4e-579ef814ee28 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:12.012450 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-ce16724f-78df-4069-9e4e-579ef814ee28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:12.090309 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d21ba92-3c54-4c27-b089-9d2d6f5e37c9 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:12.100276 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:12.103869 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 249/491] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:45:12.105129 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce16724f-78df-4069-9e4e-579ef814ee28 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:12.161593 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8350e081-11b8-4daa-86ad-4f84f17c562e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:12.162291 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350e081-11b8-4daa-86ad-4f84f17c562e None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:12.162584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350e081-11b8-4daa-86ad-4f84f17c562e None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:12.163247 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350e081-11b8-4daa-86ad-4f84f17c562e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:12.179706 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8350e081-11b8-4daa-86ad-4f84f17c562e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:12.182681 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8350e081-11b8-4daa-86ad-4f84f17c562e None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:12.204280 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-8350e081-11b8-4daa-86ad-4f84f17c562e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:12.204280 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:12.204280 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:12.204280 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:12.204280 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:12.204280 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:12.204280 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:12.204280 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:12.204280 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:12.204280 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:12.204280 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:12.204280 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:12.204280 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:45:12.204280 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:45:12.204280 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:45:12.204280 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:45:12.205254 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:12.205254 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:12.205254 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:12.205254 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:12.205254 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:12.205254 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:12.205254 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:12.205254 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:12.205254 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:12.205254 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:12.205254 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:12.205254 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:12.205254 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:12.205254 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:12.205254 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:12.205254 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:12.205254 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:45:12.206445 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:45:12.206445 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:12.206445 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:12.208661 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 243/492] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:12.209788 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8350e081-11b8-4daa-86ad-4f84f17c562e None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:12.260228 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce16724f-78df-4069-9e4e-579ef814ee28 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:12.277123 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:12.312962 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2adcea-8c1f-4c70-8d10-b92444ad5354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:12.314062 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2adcea-8c1f-4c70-8d10-b92444ad5354 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:12.314524 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2adcea-8c1f-4c70-8d10-b92444ad5354 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:12.314811 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2adcea-8c1f-4c70-8d10-b92444ad5354 None admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:12.315970 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2adcea-8c1f-4c70-8d10-b92444ad5354 None admin] RBAC: Adding query filter params (name=service) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:12.316508 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2adcea-8c1f-4c70-8d10-b92444ad5354 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:12.319119 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2adcea-8c1f-4c70-8d10-b92444ad5354 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:12.339821 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 250/493] 10.222.0.49 () {56 vars in 1103 bytes} [Sun Aug 28 00:45:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:12.339821 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2adcea-8c1f-4c70-8d10-b92444ad5354 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:12.361308 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8350e081-11b8-4daa-86ad-4f84f17c562e None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:12.416571 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff25f1-5d7a-49cf-a482-69000329b7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:12.419028 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff25f1-5d7a-49cf-a482-69000329b7b6 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:12.419308 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff25f1-5d7a-49cf-a482-69000329b7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:12.419607 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff25f1-5d7a-49cf-a482-69000329b7b6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:12.439420 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cff25f1-5d7a-49cf-a482-69000329b7b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:45:12.451330 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-5cff25f1-5d7a-49cf-a482-69000329b7b6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:45:12.451330 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:12.451330 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:12.451330 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:12.451330 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:12.451330 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:12.451330 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:12.451330 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:12.451330 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:12.451330 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:12.451330 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:12.451330 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:12.451330 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:45:12.451330 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:45:12.451330 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:45:12.451330 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:45:12.452434 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:45:12.452434 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:45:12.452434 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:45:12.452434 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:45:12.452434 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:12.452434 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:12.452434 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:12.452434 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:12.452434 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:12.452434 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:12.452434 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:12.452434 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:12.452434 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:12.452434 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:12.452434 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:12.452434 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:12.453453 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:12.453453 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:12.453453 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:12.453453 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:12.453453 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:45:12.453453 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:45:12.453453 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:45:12.453453 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:45:12.453453 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:45:12.453453 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:45:12.453453 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:45:12.453453 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:12.453453 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 244/494] 10.222.0.49 () {56 vars in 1102 bytes} [Sun Aug 28 00:45:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:12.453453 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff25f1-5d7a-49cf-a482-69000329b7b6 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:12.485290 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:12.515842 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2adcea-8c1f-4c70-8d10-b92444ad5354 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:12.557898 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c81ea7-86d7-4102-aad1-19c344de7602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:12.558580 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c81ea7-86d7-4102-aad1-19c344de7602 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:12.558874 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c81ea7-86d7-4102-aad1-19c344de7602 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:12.559139 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c81ea7-86d7-4102-aad1-19c344de7602 None admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:12.560099 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c81ea7-86d7-4102-aad1-19c344de7602 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:12.560479 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c81ea7-86d7-4102-aad1-19c344de7602 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:12.562143 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c81ea7-86d7-4102-aad1-19c344de7602 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:12.585823 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 251/495] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:45:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:12.585823 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c81ea7-86d7-4102-aad1-19c344de7602 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:12.602507 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff25f1-5d7a-49cf-a482-69000329b7b6 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:12.629620 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:12.644140 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa55051-9a67-4dab-81ac-023718eb8bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:12.644783 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa55051-9a67-4dab-81ac-023718eb8bc5 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:12.645096 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa55051-9a67-4dab-81ac-023718eb8bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:12.645327 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa55051-9a67-4dab-81ac-023718eb8bc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:12.657223 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa55051-9a67-4dab-81ac-023718eb8bc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:12.658715 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa55051-9a67-4dab-81ac-023718eb8bc5 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:12.674149 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-9fa55051-9a67-4dab-81ac-023718eb8bc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:12.674149 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:12.674149 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:12.674149 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:12.674149 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:12.674149 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:12.674149 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:12.674149 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:12.674149 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:12.674149 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:12.674149 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:12.674149 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:12.674149 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:45:12.674149 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:45:12.674149 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:45:12.674149 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:45:12.675132 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:12.675132 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:12.675132 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:12.675132 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:12.675132 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:12.675132 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:12.675132 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:12.675132 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:12.675132 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:12.675132 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:12.675132 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:12.675132 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:12.675132 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:12.675132 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:12.675132 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:12.675132 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:12.675132 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:45:12.676034 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:45:12.676034 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:12.676034 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:12.676034 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 245/496] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:12.676253 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa55051-9a67-4dab-81ac-023718eb8bc5 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:12.728914 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c81ea7-86d7-4102-aad1-19c344de7602 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:12.759575 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:12.776329 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d948849-cacc-442b-87ae-5609f5c5589a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:12.780544 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d948849-cacc-442b-87ae-5609f5c5589a None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:12.780544 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d948849-cacc-442b-87ae-5609f5c5589a None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:12.780544 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d948849-cacc-442b-87ae-5609f5c5589a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:12.795954 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa55051-9a67-4dab-81ac-023718eb8bc5 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:12.796786 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d948849-cacc-442b-87ae-5609f5c5589a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:45:12.802589 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-3d948849-cacc-442b-87ae-5609f5c5589a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:45:12.802589 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:12.802589 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:12.802589 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:12.802589 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:12.802589 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:12.802589 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:12.802589 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:12.802589 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:12.802589 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:12.802589 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:12.802589 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:12.802589 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:45:12.802589 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:45:12.802589 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:45:12.802589 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:45:12.803744 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:45:12.803744 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:45:12.803744 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:45:12.803744 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:45:12.803744 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:12.803744 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:12.803744 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:12.803744 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:12.803744 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:12.803744 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:12.803744 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:12.803744 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:12.803744 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:12.803744 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:12.803744 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:12.803744 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:12.804696 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:12.804696 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:12.804696 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:12.804696 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:12.804696 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:45:12.804696 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:45:12.804696 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:45:12.804696 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:45:12.804696 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:45:12.804696 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:45:12.804696 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:45:12.804696 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:12.804696 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 252/497] 10.222.0.49 () {56 vars in 1102 bytes} [Sun Aug 28 00:45:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:12.804696 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d948849-cacc-442b-87ae-5609f5c5589a None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:12.837838 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032cc5d9-a511-4a56-a25e-d91748ae2a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:12.838453 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032cc5d9-a511-4a56-a25e-d91748ae2a16 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:12.838733 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032cc5d9-a511-4a56-a25e-d91748ae2a16 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:12.839033 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032cc5d9-a511-4a56-a25e-d91748ae2a16 None admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:12.839734 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032cc5d9-a511-4a56-a25e-d91748ae2a16 None admin] RBAC: Adding query filter params (name=service) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:12.840038 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032cc5d9-a511-4a56-a25e-d91748ae2a16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:12.841420 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032cc5d9-a511-4a56-a25e-d91748ae2a16 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:12.853624 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 246/498] 10.222.0.49 () {56 vars in 1103 bytes} [Sun Aug 28 00:45:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:12.854634 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032cc5d9-a511-4a56-a25e-d91748ae2a16 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:12.910694 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:12.919508 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d948849-cacc-442b-87ae-5609f5c5589a None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:12.958945 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf8168f-7de1-4ebd-8b7e-ce0902e99890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:12.959706 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8168f-7de1-4ebd-8b7e-ce0902e99890 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:12.960009 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8168f-7de1-4ebd-8b7e-ce0902e99890 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:12.960320 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8168f-7de1-4ebd-8b7e-ce0902e99890 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:12.968172 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032cc5d9-a511-4a56-a25e-d91748ae2a16 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:12.969138 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf8168f-7de1-4ebd-8b7e-ce0902e99890 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:12.970647 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf8168f-7de1-4ebd-8b7e-ce0902e99890 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:12.984927 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-7cf8168f-7de1-4ebd-8b7e-ce0902e99890 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 28 00:45:12.984927 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:12.984927 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:12.984927 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:12.984927 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:12.984927 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:12.984927 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:12.984927 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:12.984927 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:12.984927 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:12.984927 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:12.984927 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:12.984927 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:45:12.984927 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:45:12.984927 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:45:12.984927 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:45:12.985922 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:12.985922 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:12.985922 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:45:12.985922 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:45:12.985922 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:45:12.985922 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:45:12.985922 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:12.985922 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:12.985922 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:12.985922 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:12.985922 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:12.985922 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:12.985922 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:12.985922 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:12.985922 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:12.985922 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:12.985922 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:12.985922 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:12.986825 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:12.986825 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:12.986825 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:45:12.986825 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:45:12.986825 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:45:12.986825 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:45:12.986825 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:45:12.986825 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:45:12.986825 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 28 00:45:12.986825 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:12.986825 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 253/499] 10.222.0.49 () {56 vars in 1093 bytes} [Sun Aug 28 00:45:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:12.987424 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde0276-8064-4865-b1fa-679ea0187308 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:12.987989 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde0276-8064-4865-b1fa-679ea0187308 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:12.987989 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde0276-8064-4865-b1fa-679ea0187308 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:12.991796 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 254/500] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:45:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:12.991796 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde0276-8064-4865-b1fa-679ea0187308 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:13.007617 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4851aaab-7664-4c86-8d80-46b6d85af1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:13.008293 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851aaab-7664-4c86-8d80-46b6d85af1fc None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:13.008575 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851aaab-7664-4c86-8d80-46b6d85af1fc None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:13.008842 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851aaab-7664-4c86-8d80-46b6d85af1fc None admin] PATH_INFO: `/v3/domains` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:13.009525 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4851aaab-7664-4c86-8d80-46b6d85af1fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:13.009833 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4851aaab-7664-4c86-8d80-46b6d85af1fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:13.011472 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4851aaab-7664-4c86-8d80-46b6d85af1fc None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:13.013411 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:13.035566 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 247/501] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:45:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:13.037402 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4851aaab-7664-4c86-8d80-46b6d85af1fc None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:13.127639 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde0276-8064-4865-b1fa-679ea0187308 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:13.168008 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938351c2-52f9-4444-9d81-f9cdef9673a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:13.169398 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938351c2-52f9-4444-9d81-f9cdef9673a8 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:13.169925 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938351c2-52f9-4444-9d81-f9cdef9673a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:13.170279 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938351c2-52f9-4444-9d81-f9cdef9673a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:13.171318 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938351c2-52f9-4444-9d81-f9cdef9673a8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:13.171796 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938351c2-52f9-4444-9d81-f9cdef9673a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:13.173767 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938351c2-52f9-4444-9d81-f9cdef9673a8 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:13.183039 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 255/502] 10.222.0.49 () {56 vars in 1103 bytes} [Sun Aug 28 00:45:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:13.183924 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938351c2-52f9-4444-9d81-f9cdef9673a8 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:13.187611 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4851aaab-7664-4c86-8d80-46b6d85af1fc None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:13.206427 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:13.233117 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba201881-bb4d-4ce1-96df-4472b37a9c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:13.234660 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba201881-bb4d-4ce1-96df-4472b37a9c7d None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:13.235141 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba201881-bb4d-4ce1-96df-4472b37a9c7d None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:13.236031 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba201881-bb4d-4ce1-96df-4472b37a9c7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:13.249714 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba201881-bb4d-4ce1-96df-4472b37a9c7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:13.251224 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba201881-bb4d-4ce1-96df-4472b37a9c7d None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:13.268820 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-ba201881-bb4d-4ce1-96df-4472b37a9c7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:13.268820 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:13.268820 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:13.268820 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:13.268820 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:13.268820 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:13.268820 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:13.268820 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:13.268820 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:13.268820 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:13.268820 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:13.268820 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:13.268820 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:45:13.268820 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:45:13.268820 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:45:13.268820 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:45:13.272693 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:13.272693 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:13.272693 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:13.272693 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:13.272693 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:13.272693 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:13.272693 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:13.272693 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:13.272693 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:13.272693 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:13.272693 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:13.272693 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:13.272693 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:13.272693 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:13.272693 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:13.272693 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:13.272693 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:45:13.274053 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:45:13.274053 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:13.274053 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:13.274053 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 248/503] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:13.274053 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c0561-2ca2-41df-85b9-c6c1e9b41cb8 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:13.274053 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c0561-2ca2-41df-85b9-c6c1e9b41cb8 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:13.274053 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c0561-2ca2-41df-85b9-c6c1e9b41cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:13.287931 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-2a9c0561-2ca2-41df-85b9-c6c1e9b41cb8 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:13.289194 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-2a9c0561-2ca2-41df-85b9-c6c1e9b41cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:13.326719 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938351c2-52f9-4444-9d81-f9cdef9673a8 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:13.336412 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:13.367290 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 249/504] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:45:13.368714 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9c0561-2ca2-41df-85b9-c6c1e9b41cb8 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:13.384341 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da6c03e-5dc4-4356-ba29-d730fcaa34dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:13.385305 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da6c03e-5dc4-4356-ba29-d730fcaa34dc None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:13.385650 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da6c03e-5dc4-4356-ba29-d730fcaa34dc None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:13.385935 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da6c03e-5dc4-4356-ba29-d730fcaa34dc None admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:13.386814 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da6c03e-5dc4-4356-ba29-d730fcaa34dc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:13.387195 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da6c03e-5dc4-4356-ba29-d730fcaa34dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:13.388926 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da6c03e-5dc4-4356-ba29-d730fcaa34dc None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:13.429757 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 256/505] 10.222.0.49 () {56 vars in 1133 bytes} [Sun Aug 28 00:45:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:13.430726 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da6c03e-5dc4-4356-ba29-d730fcaa34dc None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:13.520069 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9c0561-2ca2-41df-85b9-c6c1e9b41cb8 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:13.563100 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:13.565789 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a76aede-52d1-4e12-964c-c64871d0b9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:13.566585 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76aede-52d1-4e12-964c-c64871d0b9e7 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:13.566967 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76aede-52d1-4e12-964c-c64871d0b9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:13.567364 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a76aede-52d1-4e12-964c-c64871d0b9e7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:13.577052 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a76aede-52d1-4e12-964c-c64871d0b9e7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:13.578774 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a76aede-52d1-4e12-964c-c64871d0b9e7 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:13.596797 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-2a76aede-52d1-4e12-964c-c64871d0b9e7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 28 00:45:13.596797 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:13.596797 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:13.596797 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:13.596797 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:13.596797 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:13.596797 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:13.596797 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:13.596797 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:13.596797 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:13.596797 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:13.596797 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:13.596797 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:45:13.596797 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:45:13.596797 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:45:13.596797 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:45:13.597851 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:13.597851 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:13.597851 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:45:13.597851 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:45:13.597851 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:45:13.597851 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:45:13.597851 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:13.597851 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:13.597851 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:13.597851 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:13.597851 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:13.597851 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:13.597851 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:13.597851 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:13.597851 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:13.597851 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:13.597851 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:13.597851 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:13.607234 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:13.607234 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:13.607234 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:45:13.607234 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:45:13.607234 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:45:13.607234 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:45:13.607234 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:45:13.607234 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:45:13.607234 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 28 00:45:13.607234 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:13.608462 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da6c03e-5dc4-4356-ba29-d730fcaa34dc None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:13.608613 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 250/506] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 28 00:45:13 2022] GET /identity/v3/users/glance => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:13.608613 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a76aede-52d1-4e12-964c-c64871d0b9e7 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:13.651318 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5313ecd9-5ec9-4a8e-b358-0691e673f774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:13.652050 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313ecd9-5ec9-4a8e-b358-0691e673f774 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:13.652321 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313ecd9-5ec9-4a8e-b358-0691e673f774 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:13.652591 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313ecd9-5ec9-4a8e-b358-0691e673f774 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:13.653365 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:13.664173 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5313ecd9-5ec9-4a8e-b358-0691e673f774 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:13.665666 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5313ecd9-5ec9-4a8e-b358-0691e673f774 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:13.680673 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-5313ecd9-5ec9-4a8e-b358-0691e673f774 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:13.680673 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:13.680673 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:13.680673 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:13.680673 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:13.680673 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:13.680673 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:13.680673 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:13.680673 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:13.680673 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:13.680673 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:13.680673 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:13.680673 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:45:13.680673 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:45:13.680673 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:45:13.680673 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:45:13.681846 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:13.681846 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:13.681846 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:13.681846 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:13.681846 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:13.681846 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:13.681846 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:13.681846 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:13.681846 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:13.681846 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:13.681846 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:13.681846 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:13.681846 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:13.681846 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:13.681846 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:13.681846 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:13.681846 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:45:13.683323 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:45:13.683323 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:13.683323 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:13.683323 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 257/507] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:13.683323 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5313ecd9-5ec9-4a8e-b358-0691e673f774 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:13.737642 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a76aede-52d1-4e12-964c-c64871d0b9e7 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:13.776833 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cff1fd-6e97-4a55-8209-111116c590bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:13.777461 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cff1fd-6e97-4a55-8209-111116c590bc None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:13.777736 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cff1fd-6e97-4a55-8209-111116c590bc None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:13.778012 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cff1fd-6e97-4a55-8209-111116c590bc None admin] PATH_INFO: `/v3/domains` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:13.778669 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cff1fd-6e97-4a55-8209-111116c590bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:13.778968 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cff1fd-6e97-4a55-8209-111116c590bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:13.780403 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cff1fd-6e97-4a55-8209-111116c590bc None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:13.799100 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 251/508] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:45:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:13.800233 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5313ecd9-5ec9-4a8e-b358-0691e673f774 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:13.800811 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cff1fd-6e97-4a55-8209-111116c590bc None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:13.834150 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:13.848028 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6fc19-3876-4bd9-b2bb-2ebf8608bb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:13.848734 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6fc19-3876-4bd9-b2bb-2ebf8608bb36 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:13.849221 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6fc19-3876-4bd9-b2bb-2ebf8608bb36 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:13.849651 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6fc19-3876-4bd9-b2bb-2ebf8608bb36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:13.912750 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:13.921615 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cff1fd-6e97-4a55-8209-111116c590bc None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:13.945847 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e6fc19-3876-4bd9-b2bb-2ebf8608bb36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:13.947490 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e6fc19-3876-4bd9-b2bb-2ebf8608bb36 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:13.964638 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f3d032-066a-4229-8661-9c386529c774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:13.965352 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3d032-066a-4229-8661-9c386529c774 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:13.965633 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3d032-066a-4229-8661-9c386529c774 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:13.965906 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3d032-066a-4229-8661-9c386529c774 None admin] PATH_INFO: `/v3/users` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:13.966671 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f3d032-066a-4229-8661-9c386529c774 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:13.966987 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f3d032-066a-4229-8661-9c386529c774 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:13.968672 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f3d032-066a-4229-8661-9c386529c774 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:14.013573 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 252/509] 10.222.0.49 () {56 vars in 1137 bytes} [Sun Aug 28 00:45:13 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:14.014469 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f3d032-066a-4229-8661-9c386529c774 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:14.074830 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 258/510] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 28 00:45:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:45:14.076288 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6fc19-3876-4bd9-b2bb-2ebf8608bb36 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:14.108768 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:14.151610 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f3d032-066a-4229-8661-9c386529c774 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:14.192316 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577cb96a-2042-49b4-ae6c-a0caa84c0041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:14.192965 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577cb96a-2042-49b4-ae6c-a0caa84c0041 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:14.193240 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577cb96a-2042-49b4-ae6c-a0caa84c0041 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:14.193504 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577cb96a-2042-49b4-ae6c-a0caa84c0041 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:14.194990 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6fc19-3876-4bd9-b2bb-2ebf8608bb36 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:14.205250 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577cb96a-2042-49b4-ae6c-a0caa84c0041 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:14.207300 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577cb96a-2042-49b4-ae6c-a0caa84c0041 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:14.225326 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-577cb96a-2042-49b4-ae6c-a0caa84c0041 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:14.225326 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:14.225326 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:14.225326 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:14.225326 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:14.225326 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:14.225326 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:14.225326 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:14.225326 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:14.225326 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:14.225326 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:14.225326 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:14.225326 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:45:14.225326 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:45:14.225326 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:45:14.225326 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:45:14.232434 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:14.232434 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:14.232434 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:14.232434 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:14.232434 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:14.232434 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:14.232434 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:14.232434 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:14.232434 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:14.232434 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:14.232434 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:14.232434 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:14.232434 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:14.232434 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:14.232434 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:14.232434 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:14.232434 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:45:14.233536 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:45:14.233536 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:14.233536 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:14.233536 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 253/511] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:14.233536 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577cb96a-2042-49b4-ae6c-a0caa84c0041 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:14.238019 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:14.238802 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3254dd-7abd-4172-9d61-6521760be943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:14.239468 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3254dd-7abd-4172-9d61-6521760be943 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:14.239774 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3254dd-7abd-4172-9d61-6521760be943 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:14.240237 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3254dd-7abd-4172-9d61-6521760be943 None admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:14.241017 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3254dd-7abd-4172-9d61-6521760be943 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:14.241358 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3254dd-7abd-4172-9d61-6521760be943 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:14.243012 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3254dd-7abd-4172-9d61-6521760be943 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:14.260222 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 259/512] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:45:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:14.260222 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3254dd-7abd-4172-9d61-6521760be943 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:14.340777 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577cb96a-2042-49b4-ae6c-a0caa84c0041 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:14.352324 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:14.369272 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3254dd-7abd-4172-9d61-6521760be943 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:14.385002 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7779ab-6789-482e-ab9f-ded13349c686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:14.385650 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7779ab-6789-482e-ab9f-ded13349c686 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:14.385971 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7779ab-6789-482e-ab9f-ded13349c686 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:14.386243 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7779ab-6789-482e-ab9f-ded13349c686 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:14.394587 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7779ab-6789-482e-ab9f-ded13349c686 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:14.396109 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7779ab-6789-482e-ab9f-ded13349c686 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:14.408466 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-6b7779ab-6789-482e-ab9f-ded13349c686 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 28 00:45:14.408466 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:14.408466 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:14.408466 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:14.408466 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:14.408466 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:14.408466 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:14.408466 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:14.408466 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:14.408466 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:14.408466 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:14.408466 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:14.408466 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:45:14.408466 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:45:14.408466 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:45:14.408466 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:45:14.409695 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:14.409695 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:14.409695 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:45:14.409695 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:45:14.409695 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:45:14.409695 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:45:14.409695 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:14.409695 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:14.409695 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:14.409695 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:14.409695 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:14.409695 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:14.409695 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:14.409695 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:14.409695 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:14.409695 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:14.409695 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:14.409695 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:14.411620 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:14.411620 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:14.411620 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:45:14.411620 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:45:14.411620 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:45:14.411620 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:45:14.411620 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:45:14.411620 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:45:14.411620 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 28 00:45:14.411620 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:14.411620 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 254/513] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 28 00:45:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:14.411620 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7779ab-6789-482e-ab9f-ded13349c686 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:14.420519 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee40cff-45ab-44a8-8058-112e61aa4d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:14.421341 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee40cff-45ab-44a8-8058-112e61aa4d9a None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:14.421723 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee40cff-45ab-44a8-8058-112e61aa4d9a None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:14.422106 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee40cff-45ab-44a8-8058-112e61aa4d9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:14.489684 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:14.501390 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee40cff-45ab-44a8-8058-112e61aa4d9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:14.502854 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee40cff-45ab-44a8-8058-112e61aa4d9a None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:14.536118 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7779ab-6789-482e-ab9f-ded13349c686 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:14.574363 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23fed5a-74d6-4112-888d-2fae0df250ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:14.575003 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23fed5a-74d6-4112-888d-2fae0df250ec None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:14.575278 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23fed5a-74d6-4112-888d-2fae0df250ec None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:14.575608 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23fed5a-74d6-4112-888d-2fae0df250ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:14.587730 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23fed5a-74d6-4112-888d-2fae0df250ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:14.589194 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23fed5a-74d6-4112-888d-2fae0df250ec None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:14.604154 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-e23fed5a-74d6-4112-888d-2fae0df250ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:14.604154 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:14.604154 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:14.604154 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:14.604154 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:14.604154 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:14.604154 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:14.604154 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:14.604154 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:14.604154 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:14.604154 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:14.604154 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:14.604154 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:45:14.604154 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:45:14.604154 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:45:14.604154 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:45:14.605189 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:14.605189 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:14.605189 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:14.605189 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:14.605189 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:14.605189 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:14.605189 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:14.605189 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:14.605189 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:14.605189 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:14.605189 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:14.605189 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:14.605189 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:14.605189 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:14.605189 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:14.605189 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:14.605189 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:45:14.611373 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:45:14.611373 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:14.611373 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:14.611373 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 255/514] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:14.611373 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23fed5a-74d6-4112-888d-2fae0df250ec None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:14.616143 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:14.634668 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 260/515] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 28 00:45:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:45:14.635532 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee40cff-45ab-44a8-8058-112e61aa4d9a None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:14.738631 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23fed5a-74d6-4112-888d-2fae0df250ec None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:14.750174 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee40cff-45ab-44a8-8058-112e61aa4d9a None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:14.757241 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:14.777949 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670b6774-c5c1-4f0a-a34a-180b7037044d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:14.778577 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b6774-c5c1-4f0a-a34a-180b7037044d None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:14.778901 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b6774-c5c1-4f0a-a34a-180b7037044d None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:14.779173 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b6774-c5c1-4f0a-a34a-180b7037044d None admin] PATH_INFO: `/v3/domains` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:14.779961 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670b6774-c5c1-4f0a-a34a-180b7037044d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:14.780263 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670b6774-c5c1-4f0a-a34a-180b7037044d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:14.781772 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670b6774-c5c1-4f0a-a34a-180b7037044d None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:14.788749 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8555e117-76ac-4e74-88c8-84616575878d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:14.789396 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555e117-76ac-4e74-88c8-84616575878d None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:14.789673 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555e117-76ac-4e74-88c8-84616575878d None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:14.789948 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555e117-76ac-4e74-88c8-84616575878d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:14.796476 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 256/516] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:45:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:14.797549 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670b6774-c5c1-4f0a-a34a-180b7037044d None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:14.798611 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8555e117-76ac-4e74-88c8-84616575878d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:14.800316 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8555e117-76ac-4e74-88c8-84616575878d None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:14.814732 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-8555e117-76ac-4e74-88c8-84616575878d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 28 00:45:14.814732 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:14.814732 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:14.814732 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:14.814732 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:14.814732 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:14.814732 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:14.814732 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:14.814732 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:14.814732 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:14.814732 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:14.814732 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:14.814732 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:45:14.814732 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:45:14.814732 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:45:14.814732 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:45:14.815988 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:14.815988 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:14.815988 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:45:14.815988 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:45:14.815988 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:45:14.815988 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:45:14.815988 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:14.815988 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:14.815988 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:14.815988 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:14.815988 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:14.815988 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:14.815988 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:14.815988 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:14.815988 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:14.815988 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:14.815988 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:14.815988 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:14.817205 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:14.817205 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:14.817205 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:45:14.817205 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:45:14.817205 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:45:14.817205 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:45:14.817205 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:45:14.817205 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:45:14.817205 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 28 00:45:14.817205 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:14.817205 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 261/517] 10.222.0.49 () {56 vars in 1102 bytes} [Sun Aug 28 00:45:14 2022] GET /identity/v3/users/neutron => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:14.817205 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8555e117-76ac-4e74-88c8-84616575878d None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:14.877187 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:14.939970 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8555e117-76ac-4e74-88c8-84616575878d None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:14.940504 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670b6774-c5c1-4f0a-a34a-180b7037044d None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:14.980285 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b771105e-47a1-44cc-8da1-4be39a3d737a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:14.980901 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771105e-47a1-44cc-8da1-4be39a3d737a None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:14.981175 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771105e-47a1-44cc-8da1-4be39a3d737a None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:14.981445 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771105e-47a1-44cc-8da1-4be39a3d737a None admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:14.982107 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b771105e-47a1-44cc-8da1-4be39a3d737a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:14.982418 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b771105e-47a1-44cc-8da1-4be39a3d737a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:14.982556 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a608993c-39fb-4806-8377-8fa349c47a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:14.983111 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608993c-39fb-4806-8377-8fa349c47a33 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:14.983403 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608993c-39fb-4806-8377-8fa349c47a33 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:14.983728 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608993c-39fb-4806-8377-8fa349c47a33 None admin] PATH_INFO: `/v3/users` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:14.983927 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b771105e-47a1-44cc-8da1-4be39a3d737a None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:14.984484 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a608993c-39fb-4806-8377-8fa349c47a33 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:14.984785 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a608993c-39fb-4806-8377-8fa349c47a33 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:14.986478 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a608993c-39fb-4806-8377-8fa349c47a33 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:14.997132 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 262/518] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:45:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:14.998025 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b771105e-47a1-44cc-8da1-4be39a3d737a None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:15.009045 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 257/519] 10.222.0.49 () {56 vars in 1137 bytes} [Sun Aug 28 00:45:14 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:15.009298 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a608993c-39fb-4806-8377-8fa349c47a33 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:15.046421 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:15.118335 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b771105e-47a1-44cc-8da1-4be39a3d737a None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:15.126697 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:15.128447 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a608993c-39fb-4806-8377-8fa349c47a33 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:15.159695 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb5696-9687-4af6-aff0-d719a2442ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:15.160415 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb5696-9687-4af6-aff0-d719a2442ef3 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:15.160704 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb5696-9687-4af6-aff0-d719a2442ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:15.160944 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb5696-9687-4af6-aff0-d719a2442ef3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:15.173070 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244984d7-6092-4a3c-92b8-9706e2ba4ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:15.173398 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfb5696-9687-4af6-aff0-d719a2442ef3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:15.173683 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244984d7-6092-4a3c-92b8-9706e2ba4ecc None admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:15.173959 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244984d7-6092-4a3c-92b8-9706e2ba4ecc None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:15.174225 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244984d7-6092-4a3c-92b8-9706e2ba4ecc None admin] PATH_INFO: `/v3/users` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:15.174873 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244984d7-6092-4a3c-92b8-9706e2ba4ecc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:15.174962 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfb5696-9687-4af6-aff0-d719a2442ef3 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:15.176325 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244984d7-6092-4a3c-92b8-9706e2ba4ecc None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:15.194039 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-8cfb5696-9687-4af6-aff0-d719a2442ef3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:15.194039 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:15.194039 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:15.194039 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:15.194039 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:15.194039 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:15.194039 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:15.194039 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:15.194039 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:15.194039 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:15.194039 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:15.194039 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:15.194039 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:45:15.194039 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:45:15.194039 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:45:15.194039 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:45:15.195580 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:15.195580 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:15.195580 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:15.195580 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:15.195580 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:15.195580 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:15.195580 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:15.195580 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:15.195580 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:15.195580 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:15.195580 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:15.195580 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:15.195580 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:15.195580 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:15.195580 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:15.195580 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:15.195580 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:45:15.201666 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:45:15.201666 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:15.201666 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:15.201666 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 263/520] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:15.201666 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb5696-9687-4af6-aff0-d719a2442ef3 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:15.210175 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 258/521] 10.222.0.49 () {60 vars in 1132 bytes} [Sun Aug 28 00:45:15 2022] POST /identity/v3/users => generated 247 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:45:15.211593 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244984d7-6092-4a3c-92b8-9706e2ba4ecc None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:15.337908 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:15.340520 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb5696-9687-4af6-aff0-d719a2442ef3 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:15.351077 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244984d7-6092-4a3c-92b8-9706e2ba4ecc None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:15.386953 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d5ce25-5a07-4f0a-a69c-aa34addd1749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:15.387692 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d5ce25-5a07-4f0a-a69c-aa34addd1749 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:15.388007 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d5ce25-5a07-4f0a-a69c-aa34addd1749 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:15.388285 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d5ce25-5a07-4f0a-a69c-aa34addd1749 None admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:15.394490 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d5ce25-5a07-4f0a-a69c-aa34addd1749 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:15.394490 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d5ce25-5a07-4f0a-a69c-aa34addd1749 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:15.394490 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d5ce25-5a07-4f0a-a69c-aa34addd1749 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:15.394831 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be62e82b-4505-4fc2-8e75-46acaa2cdfe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:15.394831 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62e82b-4505-4fc2-8e75-46acaa2cdfe2 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:15.394831 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62e82b-4505-4fc2-8e75-46acaa2cdfe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:15.394831 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62e82b-4505-4fc2-8e75-46acaa2cdfe2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:15.403278 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be62e82b-4505-4fc2-8e75-46acaa2cdfe2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:15.404798 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be62e82b-4505-4fc2-8e75-46acaa2cdfe2 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:15.415353 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 264/522] 10.222.0.49 () {56 vars in 1139 bytes} [Sun Aug 28 00:45:15 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:15.416602 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d5ce25-5a07-4f0a-a69c-aa34addd1749 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:15.424462 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-be62e82b-4505-4fc2-8e75-46acaa2cdfe2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:45:15.424462 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:15.424462 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:15.424462 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:15.424462 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:15.424462 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:15.424462 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:15.424462 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:15.424462 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:15.424462 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:15.424462 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:15.424462 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:15.424462 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:45:15.424462 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:45:15.424462 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:45:15.425572 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:45:15.425572 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:15.425572 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:15.425572 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:15.425572 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:15.425572 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:15.425572 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:15.425572 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:15.425572 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:15.425572 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:15.425572 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:15.425572 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:15.425572 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:15.425572 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:15.425572 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:15.425572 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:15.425572 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:15.426703 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:45:15.426703 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:45:15.426703 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:45:15.426703 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:45:15.426703 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:45:15.426703 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:45:15.426703 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:45:15.426703 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:15.426703 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 259/523] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 28 00:45:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:15.431689 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be62e82b-4505-4fc2-8e75-46acaa2cdfe2 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:15.440644 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:15.563962 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be62e82b-4505-4fc2-8e75-46acaa2cdfe2 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:15.570129 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d5ce25-5a07-4f0a-a69c-aa34addd1749 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:15.615144 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4022c02f-066f-4187-9f1e-9ea2305ebf80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:15.615406 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74338d34-0826-4f57-8b4b-de33550179ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:15.615732 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022c02f-066f-4187-9f1e-9ea2305ebf80 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:15.615836 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74338d34-0826-4f57-8b4b-de33550179ab None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:15.616023 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74338d34-0826-4f57-8b4b-de33550179ab None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:15.616174 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022c02f-066f-4187-9f1e-9ea2305ebf80 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:15.616418 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022c02f-066f-4187-9f1e-9ea2305ebf80 None admin] PATH_INFO: `/v3/domains` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:15.616600 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74338d34-0826-4f57-8b4b-de33550179ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:15.617111 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4022c02f-066f-4187-9f1e-9ea2305ebf80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:15.617441 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4022c02f-066f-4187-9f1e-9ea2305ebf80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:15.619167 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4022c02f-066f-4187-9f1e-9ea2305ebf80 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:15.639952 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 260/524] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:45:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:15.642277 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4022c02f-066f-4187-9f1e-9ea2305ebf80 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:15.659808 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:15.715050 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74338d34-0826-4f57-8b4b-de33550179ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:15.717015 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74338d34-0826-4f57-8b4b-de33550179ab None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:15.743147 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:15.781771 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4022c02f-066f-4187-9f1e-9ea2305ebf80 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:15.844244 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db9e050-b13c-4933-9909-52d5dab5be01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:15.845093 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db9e050-b13c-4933-9909-52d5dab5be01 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:15.845555 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db9e050-b13c-4933-9909-52d5dab5be01 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:15.846006 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db9e050-b13c-4933-9909-52d5dab5be01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:15.880857 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 265/525] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 28 00:45:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:45:15.880857 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74338d34-0826-4f57-8b4b-de33550179ab None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:15.950633 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db9e050-b13c-4933-9909-52d5dab5be01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:15.952170 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db9e050-b13c-4933-9909-52d5dab5be01 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:15.970606 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:16.010492 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74338d34-0826-4f57-8b4b-de33550179ab None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:16.036468 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:16.057868 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a800bb82-70cb-4626-895d-874945411454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:16.058607 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800bb82-70cb-4626-895d-874945411454 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:16.059057 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800bb82-70cb-4626-895d-874945411454 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:16.059161 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800bb82-70cb-4626-895d-874945411454 None admin] PATH_INFO: `/v3/projects` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:16.059890 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a800bb82-70cb-4626-895d-874945411454 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:16.060172 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a800bb82-70cb-4626-895d-874945411454 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:16.061649 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a800bb82-70cb-4626-895d-874945411454 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:16.081621 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 266/526] 10.222.0.49 () {56 vars in 1148 bytes} [Sun Aug 28 00:45:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:16.083006 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a800bb82-70cb-4626-895d-874945411454 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:16.098318 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 261/527] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 28 00:45:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:45:16.098318 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db9e050-b13c-4933-9909-52d5dab5be01 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:16.208675 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a800bb82-70cb-4626-895d-874945411454 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:16.225815 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db9e050-b13c-4933-9909-52d5dab5be01 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:16.240085 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:16.259066 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef52cb-4a2c-4e8b-a2d3-a4d53848bfe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:16.259754 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef52cb-4a2c-4e8b-a2d3-a4d53848bfe1 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:16.260005 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef52cb-4a2c-4e8b-a2d3-a4d53848bfe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:16.260337 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef52cb-4a2c-4e8b-a2d3-a4d53848bfe1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:16.265370 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd83a41-b68b-4f8d-a9c5-6f2099733399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:16.266005 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd83a41-b68b-4f8d-a9c5-6f2099733399 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:16.266285 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd83a41-b68b-4f8d-a9c5-6f2099733399 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:16.266700 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd83a41-b68b-4f8d-a9c5-6f2099733399 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:16.267635 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ef52cb-4a2c-4e8b-a2d3-a4d53848bfe1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:16.269140 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ef52cb-4a2c-4e8b-a2d3-a4d53848bfe1 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:16.278890 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd83a41-b68b-4f8d-a9c5-6f2099733399 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:16.280385 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd83a41-b68b-4f8d-a9c5-6f2099733399 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:16.282021 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-c8ef52cb-4a2c-4e8b-a2d3-a4d53848bfe1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:45:16.282021 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:16.282021 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:16.282021 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:16.282021 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:16.282021 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:16.282021 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:16.282021 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:16.282021 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:16.282021 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:16.282021 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:16.282021 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:16.282021 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:45:16.282021 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:45:16.282021 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:45:16.282958 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:45:16.282958 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:16.282958 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:16.282958 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:16.282958 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:16.282958 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:16.282958 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:16.282958 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:16.282958 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:16.282958 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:16.282958 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:16.282958 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:16.282958 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:16.282958 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:16.282958 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:16.282958 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:16.282958 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:16.283847 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:45:16.283847 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:45:16.283847 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:45:16.283847 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:45:16.283847 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:45:16.283847 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:45:16.283847 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:45:16.283847 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:16.283847 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 267/528] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 28 00:45:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:16.284426 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef52cb-4a2c-4e8b-a2d3-a4d53848bfe1 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:16.304309 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-5dd83a41-b68b-4f8d-a9c5-6f2099733399 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:16.304309 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:16.304309 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:16.304309 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:16.304309 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:16.304309 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:16.304309 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:16.304309 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:16.304309 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:16.304309 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:16.304309 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:16.304309 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:16.304309 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:45:16.304309 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:45:16.304309 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:45:16.304309 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:45:16.311281 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:16.311281 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:16.311281 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:16.311281 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:16.311281 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:16.311281 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:16.311281 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:16.311281 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:16.311281 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:16.311281 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:16.311281 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:16.311281 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:16.311281 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:16.311281 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:16.311281 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:16.311281 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:16.311281 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:45:16.313169 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:45:16.313169 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:16.313169 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:16.313169 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 262/529] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:16.313169 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd83a41-b68b-4f8d-a9c5-6f2099733399 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:16.329718 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:16.423346 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef52cb-4a2c-4e8b-a2d3-a4d53848bfe1 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:16.430604 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd83a41-b68b-4f8d-a9c5-6f2099733399 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:16.473562 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471e30c5-1b9a-4f18-a34a-cf8809f24993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:16.474438 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e30c5-1b9a-4f18-a34a-cf8809f24993 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:16.474712 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e30c5-1b9a-4f18-a34a-cf8809f24993 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:16.474975 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e30c5-1b9a-4f18-a34a-cf8809f24993 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:16.480729 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f8c9a8-4675-4144-a53c-35f548f80e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:16.481524 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8c9a8-4675-4144-a53c-35f548f80e3b None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:16.481925 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8c9a8-4675-4144-a53c-35f548f80e3b None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:16.482292 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8c9a8-4675-4144-a53c-35f548f80e3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:16.483974 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f8c9a8-4675-4144-a53c-35f548f80e3b None admin] RBAC: Adding query filter params (role.id=ab658a45d85b49319c5add69c508b564, scope.project.id=6d6e897c6391486e9c44e9277a3ee823, user.id=3dc0655c8156457a8fcb006c9fe85eb9) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:16.484487 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f8c9a8-4675-4144-a53c-35f548f80e3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:16.487070 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471e30c5-1b9a-4f18-a34a-cf8809f24993 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:16.487237 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f8c9a8-4675-4144-a53c-35f548f80e3b None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:16.488617 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471e30c5-1b9a-4f18-a34a-cf8809f24993 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:16.499818 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 268/530] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 28 00:45:16 2022] GET /identity/v3/role_assignments?user.id=3dc0655c8156457a8fcb006c9fe85eb9&scope.project.id=6d6e897c6391486e9c44e9277a3ee823&role.id=ab658a45d85b49319c5add69c508b564 => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:16.499818 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f8c9a8-4675-4144-a53c-35f548f80e3b None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:16.505145 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-471e30c5-1b9a-4f18-a34a-cf8809f24993 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:16.505145 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:16.505145 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:16.505145 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:16.505145 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:16.505145 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:16.505145 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:16.505145 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:16.505145 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:16.505145 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:16.505145 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:16.505145 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:16.505145 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:45:16.505145 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:45:16.505145 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:45:16.505145 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:45:16.506322 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:16.506322 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:16.506322 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:16.506322 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:16.506322 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:16.506322 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:16.506322 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:16.506322 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:16.506322 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:16.506322 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:16.506322 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:16.506322 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:16.506322 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:16.506322 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:16.506322 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:16.506322 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:16.506322 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:45:16.507432 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:45:16.507432 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:16.507432 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:16.511210 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 263/531] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:16.512242 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471e30c5-1b9a-4f18-a34a-cf8809f24993 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:16.535046 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:16.663005 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:16.666799 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f8c9a8-4675-4144-a53c-35f548f80e3b None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:16.686403 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471e30c5-1b9a-4f18-a34a-cf8809f24993 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:16.708017 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1131c4e-9b28-4ce0-a354-18eb9e39d9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:16.708691 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1131c4e-9b28-4ce0-a354-18eb9e39d9ec None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:16.708976 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1131c4e-9b28-4ce0-a354-18eb9e39d9ec None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:16.709252 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1131c4e-9b28-4ce0-a354-18eb9e39d9ec None admin] PATH_INFO: `/v3/projects` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:16.710038 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1131c4e-9b28-4ce0-a354-18eb9e39d9ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:16.710346 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1131c4e-9b28-4ce0-a354-18eb9e39d9ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:16.712143 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1131c4e-9b28-4ce0-a354-18eb9e39d9ec None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:16.730503 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 269/532] 10.222.0.49 () {56 vars in 1148 bytes} [Sun Aug 28 00:45:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:16.736414 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1131c4e-9b28-4ce0-a354-18eb9e39d9ec None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:16.751042 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c4b876-63ca-4875-ad36-f5a082541d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:16.752589 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c4b876-63ca-4875-ad36-f5a082541d6c None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:16.753028 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c4b876-63ca-4875-ad36-f5a082541d6c None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:16.753748 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c4b876-63ca-4875-ad36-f5a082541d6c None admin] PATH_INFO: `/v3/domains` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:16.754624 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c4b876-63ca-4875-ad36-f5a082541d6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:16.755191 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c4b876-63ca-4875-ad36-f5a082541d6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:16.757651 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c4b876-63ca-4875-ad36-f5a082541d6c None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:16.775614 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 264/533] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:45:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:16.777118 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c4b876-63ca-4875-ad36-f5a082541d6c None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:16.888116 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:16.890357 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1131c4e-9b28-4ce0-a354-18eb9e39d9ec None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:16.926667 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c4b876-63ca-4875-ad36-f5a082541d6c None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:16.946467 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3194e4-3964-4ca4-9f17-a0d912196226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:16.947145 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3194e4-3964-4ca4-9f17-a0d912196226 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:16.947452 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3194e4-3964-4ca4-9f17-a0d912196226 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:16.947923 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3194e4-3964-4ca4-9f17-a0d912196226 None admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:16.948631 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3194e4-3964-4ca4-9f17-a0d912196226 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:16.948978 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3194e4-3964-4ca4-9f17-a0d912196226 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:16.950925 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3194e4-3964-4ca4-9f17-a0d912196226 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:16.973742 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 270/534] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:45:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:16.973742 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3194e4-3964-4ca4-9f17-a0d912196226 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:16.975030 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef53099-3751-4909-9fb8-a3f61c22f4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:16.976299 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef53099-3751-4909-9fb8-a3f61c22f4c4 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:16.976766 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef53099-3751-4909-9fb8-a3f61c22f4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:16.977278 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef53099-3751-4909-9fb8-a3f61c22f4c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:16.978373 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef53099-3751-4909-9fb8-a3f61c22f4c4 None admin] RBAC: Adding query filter params (role.id=ab658a45d85b49319c5add69c508b564, scope.project.id=6d6e897c6391486e9c44e9277a3ee823, user.id=22053bd9632346aab63814f740415f69) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:16.979001 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef53099-3751-4909-9fb8-a3f61c22f4c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:16.981221 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef53099-3751-4909-9fb8-a3f61c22f4c4 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:16.996160 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 265/535] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 28 00:45:16 2022] GET /identity/v3/role_assignments?user.id=22053bd9632346aab63814f740415f69&scope.project.id=6d6e897c6391486e9c44e9277a3ee823&role.id=ab658a45d85b49319c5add69c508b564 => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:16.996941 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:16.998653 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef53099-3751-4909-9fb8-a3f61c22f4c4 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:17.106788 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3194e4-3964-4ca4-9f17-a0d912196226 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:17.150746 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d70e1b-ad6e-4db7-8b1f-12e2318ed249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:17.151465 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d70e1b-ad6e-4db7-8b1f-12e2318ed249 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:17.151797 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d70e1b-ad6e-4db7-8b1f-12e2318ed249 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:17.152142 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d70e1b-ad6e-4db7-8b1f-12e2318ed249 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:17.161034 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d70e1b-ad6e-4db7-8b1f-12e2318ed249 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:17.163285 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d70e1b-ad6e-4db7-8b1f-12e2318ed249 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:17.179095 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-17d70e1b-ad6e-4db7-8b1f-12e2318ed249 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:45:17.179095 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:17.179095 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:17.179095 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:17.179095 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:17.179095 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:17.179095 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:17.179095 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:17.179095 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:17.179095 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:17.179095 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:17.179095 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:17.179095 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:45:17.179095 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:45:17.179095 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:45:17.180087 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:45:17.180087 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:17.180087 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:17.180087 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:17.180087 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:17.180087 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:17.180087 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:17.180087 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:17.180087 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:17.180087 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:17.180087 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:17.180087 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:17.180087 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:17.180087 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:17.180087 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:17.180087 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:17.180087 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:17.180943 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:45:17.180943 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:45:17.180943 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:45:17.180943 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:45:17.180943 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:45:17.180943 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:45:17.180943 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:45:17.180943 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:17.181361 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 271/536] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 28 00:45:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:17.189657 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d70e1b-ad6e-4db7-8b1f-12e2318ed249 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:17.266119 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef53099-3751-4909-9fb8-a3f61c22f4c4 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:17.304086 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:17.322329 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262d5eee-d6d1-4651-a505-de68860429bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:17.323078 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d5eee-d6d1-4651-a505-de68860429bf None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:17.323421 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d5eee-d6d1-4651-a505-de68860429bf None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:17.323745 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262d5eee-d6d1-4651-a505-de68860429bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:17.328934 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d70e1b-ad6e-4db7-8b1f-12e2318ed249 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:17.335642 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262d5eee-d6d1-4651-a505-de68860429bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:17.341606 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262d5eee-d6d1-4651-a505-de68860429bf None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:17.368316 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:17.371318 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb7599c-faa6-4ab6-bee4-75b5f9584737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:17.371972 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb7599c-faa6-4ab6-bee4-75b5f9584737 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:17.372247 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb7599c-faa6-4ab6-bee4-75b5f9584737 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:17.372503 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb7599c-faa6-4ab6-bee4-75b5f9584737 None admin] PATH_INFO: `/v3/projects` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:17.373609 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb7599c-faa6-4ab6-bee4-75b5f9584737 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:17.373609 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb7599c-faa6-4ab6-bee4-75b5f9584737 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:17.374372 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-262d5eee-d6d1-4651-a505-de68860429bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:45:17.374372 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:17.374372 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:17.374372 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:17.374372 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:17.374372 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:17.374372 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:17.374372 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:17.374372 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:17.374372 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:17.374372 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:17.374372 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:17.374372 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:45:17.374372 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:45:17.374372 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:45:17.375188 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:45:17.375188 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:17.375188 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:17.375188 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:17.375188 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:17.375188 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:17.375188 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:17.375188 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:17.375188 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:17.375188 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:17.375188 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:17.375188 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:17.375188 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:17.375188 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:17.375188 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:17.375188 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:17.375188 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:17.376837 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:45:17.376837 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:45:17.376837 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:45:17.376837 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:45:17.376837 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:45:17.376837 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:45:17.376837 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:45:17.376837 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:17.377514 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb7599c-faa6-4ab6-bee4-75b5f9584737 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:17.377652 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 266/537] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 28 00:45:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:17.388424 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262d5eee-d6d1-4651-a505-de68860429bf None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:17.390001 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 272/538] 10.222.0.49 () {56 vars in 1148 bytes} [Sun Aug 28 00:45:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:17.396060 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb7599c-faa6-4ab6-bee4-75b5f9584737 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:17.541197 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb7599c-faa6-4ab6-bee4-75b5f9584737 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:17.566055 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262d5eee-d6d1-4651-a505-de68860429bf None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:17.591736 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ee973-bc6a-4030-a8c7-04314c082916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:17.592680 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ee973-bc6a-4030-a8c7-04314c082916 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:17.593234 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ee973-bc6a-4030-a8c7-04314c082916 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:17.593523 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ee973-bc6a-4030-a8c7-04314c082916 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:17.594290 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ee973-bc6a-4030-a8c7-04314c082916 None admin] RBAC: Adding query filter params (role.id=ab658a45d85b49319c5add69c508b564, scope.project.id=6d6e897c6391486e9c44e9277a3ee823, user.id=95355adb5a6a4a69a31904247eac6d69) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:17.594669 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ee973-bc6a-4030-a8c7-04314c082916 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:17.596499 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ee973-bc6a-4030-a8c7-04314c082916 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:17.605572 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 273/539] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 28 00:45:17 2022] GET /identity/v3/role_assignments?user.id=95355adb5a6a4a69a31904247eac6d69&scope.project.id=6d6e897c6391486e9c44e9277a3ee823&role.id=ab658a45d85b49319c5add69c508b564 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:45:17.607107 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e541036-9b4f-46cd-8ccc-806e685c0456 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:17.607424 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e541036-9b4f-46cd-8ccc-806e685c0456 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:17.607722 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e541036-9b4f-46cd-8ccc-806e685c0456 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:17.609022 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 274/540] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:45:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:17.616350 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828b3ac-209a-4a63-acbc-dc514b7a34af None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:17.616705 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828b3ac-209a-4a63-acbc-dc514b7a34af None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:17.616980 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828b3ac-209a-4a63-acbc-dc514b7a34af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:17.626852 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:17.643060 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-a828b3ac-209a-4a63-acbc-dc514b7a34af None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:17.645310 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-a828b3ac-209a-4a63-acbc-dc514b7a34af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:17.659303 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b493c20-cc9b-492f-8396-20c85eaa728c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:17.660309 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b493c20-cc9b-492f-8396-20c85eaa728c None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:17.662430 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b493c20-cc9b-492f-8396-20c85eaa728c None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:17.662893 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b493c20-cc9b-492f-8396-20c85eaa728c None admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:17.663914 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b493c20-cc9b-492f-8396-20c85eaa728c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:17.665348 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b493c20-cc9b-492f-8396-20c85eaa728c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:17.667091 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b493c20-cc9b-492f-8396-20c85eaa728c None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:17.711748 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 267/541] 10.222.0.49 () {56 vars in 1148 bytes} [Sun Aug 28 00:45:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:45:17.718260 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b493c20-cc9b-492f-8396-20c85eaa728c None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:17.758422 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 275/542] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:45:17.860441 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:17.906135 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b493c20-cc9b-492f-8396-20c85eaa728c None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:17.946651 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b33db8b-8ff7-4409-a7b2-7e9ff4d3fb17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:17.947274 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b33db8b-8ff7-4409-a7b2-7e9ff4d3fb17 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:17.947555 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b33db8b-8ff7-4409-a7b2-7e9ff4d3fb17 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:17.947921 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b33db8b-8ff7-4409-a7b2-7e9ff4d3fb17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:17.948766 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b33db8b-8ff7-4409-a7b2-7e9ff4d3fb17 None admin] RBAC: Adding query filter params (role.id=ab658a45d85b49319c5add69c508b564, scope.project.id=6d6e897c6391486e9c44e9277a3ee823, user.id=2d14dcd0cb25427291ab8831924184e2) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:17.949081 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b33db8b-8ff7-4409-a7b2-7e9ff4d3fb17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:17.950579 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b33db8b-8ff7-4409-a7b2-7e9ff4d3fb17 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:17.957686 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 268/543] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 28 00:45:17 2022] GET /identity/v3/role_assignments?user.id=2d14dcd0cb25427291ab8831924184e2&scope.project.id=6d6e897c6391486e9c44e9277a3ee823&role.id=ab658a45d85b49319c5add69c508b564 => generated 259 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:45:18.110578 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828b3ac-209a-4a63-acbc-dc514b7a34af None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:18.262894 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828b3ac-209a-4a63-acbc-dc514b7a34af None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:18.303355 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac2314f-b3b9-4bf3-b0d5-95d628fd80f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:18.304317 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac2314f-b3b9-4bf3-b0d5-95d628fd80f0 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:18.304740 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac2314f-b3b9-4bf3-b0d5-95d628fd80f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:18.305152 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac2314f-b3b9-4bf3-b0d5-95d628fd80f0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:18.307878 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:18.318191 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac2314f-b3b9-4bf3-b0d5-95d628fd80f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:45:18.323830 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-3ac2314f-b3b9-4bf3-b0d5-95d628fd80f0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:45:18.323830 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:18.323830 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:18.323830 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:18.323830 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:18.323830 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:18.323830 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:18.323830 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:18.323830 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:18.323830 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:18.323830 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:18.323830 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:18.323830 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:45:18.323830 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:45:18.323830 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:45:18.323830 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:45:18.325015 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:45:18.325015 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:45:18.325015 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:45:18.325015 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:45:18.325015 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:18.325015 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:18.325015 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:18.325015 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:18.325015 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:18.325015 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:18.325015 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:18.325015 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:18.325015 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:18.325015 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:18.325015 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:18.325015 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:18.326243 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:18.326243 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:18.326243 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:18.326243 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:18.326243 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:45:18.326243 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:45:18.326243 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:45:18.326243 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:45:18.326243 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:45:18.326243 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:45:18.326243 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:45:18.326243 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:18.329136 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 276/544] 10.222.0.49 () {56 vars in 1102 bytes} [Sun Aug 28 00:45:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:18.335544 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b33db8b-8ff7-4409-a7b2-7e9ff4d3fb17 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:18.500524 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b33db8b-8ff7-4409-a7b2-7e9ff4d3fb17 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:18.539745 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:18.557669 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05ac2c-a28a-4246-b0fb-93b93a14f402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:18.558418 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05ac2c-a28a-4246-b0fb-93b93a14f402 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:18.558705 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05ac2c-a28a-4246-b0fb-93b93a14f402 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:18.559023 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05ac2c-a28a-4246-b0fb-93b93a14f402 None admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:18.559795 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e05ac2c-a28a-4246-b0fb-93b93a14f402 None admin] RBAC: Adding query filter params (name=service) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:18.560105 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e05ac2c-a28a-4246-b0fb-93b93a14f402 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:18.561638 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e05ac2c-a28a-4246-b0fb-93b93a14f402 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:18.577494 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 269/545] 10.222.0.49 () {56 vars in 1103 bytes} [Sun Aug 28 00:45:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:18.584615 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac2314f-b3b9-4bf3-b0d5-95d628fd80f0 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:18.769059 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac2314f-b3b9-4bf3-b0d5-95d628fd80f0 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:18.837906 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d124080-4d7e-4342-8c8c-81b7f4b5f734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:18.838798 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d124080-4d7e-4342-8c8c-81b7f4b5f734 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:18.839170 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d124080-4d7e-4342-8c8c-81b7f4b5f734 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:18.839606 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d124080-4d7e-4342-8c8c-81b7f4b5f734 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:18.860649 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d124080-4d7e-4342-8c8c-81b7f4b5f734 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:18.862135 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d124080-4d7e-4342-8c8c-81b7f4b5f734 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:18.865252 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3d70e-5953-4638-b3ab-3187e024cdd0 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:18.865539 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3d70e-5953-4638-b3ab-3187e024cdd0 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:18.865815 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3d70e-5953-4638-b3ab-3187e024cdd0 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:18.867546 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 270/546] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:45:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:18.874309 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522c125-ebf3-4bad-b969-fa826b3c1734 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:18.874688 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522c125-ebf3-4bad-b969-fa826b3c1734 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:18.875118 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522c125-ebf3-4bad-b969-fa826b3c1734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:18.880611 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-8d124080-4d7e-4342-8c8c-81b7f4b5f734 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:18.880611 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:18.880611 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:18.880611 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:18.880611 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:18.880611 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:18.880611 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:18.880611 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:18.880611 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:18.880611 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:18.880611 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:18.880611 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:18.880611 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:45:18.880611 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:45:18.880611 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:45:18.880611 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:45:18.881564 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:18.881564 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:18.881564 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:18.881564 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:18.881564 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:18.881564 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:18.881564 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:18.881564 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:18.881564 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:18.881564 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:18.881564 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:18.881564 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:18.881564 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:18.881564 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:18.881564 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:18.881564 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:18.881564 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:45:18.882408 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:45:18.882408 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:18.882408 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:18.884651 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 277/547] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:18.894204 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d124080-4d7e-4342-8c8c-81b7f4b5f734 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:18.925062 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-8522c125-ebf3-4bad-b969-fa826b3c1734 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:18.927024 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-8522c125-ebf3-4bad-b969-fa826b3c1734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:18.948153 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:19.012837 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d124080-4d7e-4342-8c8c-81b7f4b5f734 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:19.063438 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06decb54-4709-4ab7-aad4-0eb6c9531bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:19.064307 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06decb54-4709-4ab7-aad4-0eb6c9531bf1 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:19.064775 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06decb54-4709-4ab7-aad4-0eb6c9531bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:19.065240 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06decb54-4709-4ab7-aad4-0eb6c9531bf1 None admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:19.066324 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06decb54-4709-4ab7-aad4-0eb6c9531bf1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:19.066762 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06decb54-4709-4ab7-aad4-0eb6c9531bf1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:19.069033 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06decb54-4709-4ab7-aad4-0eb6c9531bf1 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:19.108968 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 278/548] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:45:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:19.110610 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 271/549] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:45:19.114686 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06decb54-4709-4ab7-aad4-0eb6c9531bf1 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:19.283298 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06decb54-4709-4ab7-aad4-0eb6c9531bf1 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:19.294638 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:19.333039 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c46f4ef-baf5-4bf1-a7b0-a566c8d44c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:19.333599 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46f4ef-baf5-4bf1-a7b0-a566c8d44c17 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:19.333876 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46f4ef-baf5-4bf1-a7b0-a566c8d44c17 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:19.334147 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c46f4ef-baf5-4bf1-a7b0-a566c8d44c17 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:19.345568 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c46f4ef-baf5-4bf1-a7b0-a566c8d44c17 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:19.347051 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c46f4ef-baf5-4bf1-a7b0-a566c8d44c17 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:19.369426 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-5c46f4ef-baf5-4bf1-a7b0-a566c8d44c17 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 28 00:45:19.369426 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:19.369426 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:19.369426 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:19.369426 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:19.369426 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:19.369426 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:19.369426 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:19.369426 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:19.369426 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:19.369426 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:19.369426 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:19.369426 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:45:19.369426 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:45:19.369426 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:45:19.369426 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:45:19.372352 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:19.372352 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:19.372352 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:45:19.372352 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:45:19.372352 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:45:19.372352 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:45:19.372352 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:19.372352 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:19.372352 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:19.372352 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:19.372352 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:19.372352 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:19.372352 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:19.372352 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:19.372352 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:19.372352 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:19.372352 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:19.372352 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:19.374607 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:19.374607 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:19.374607 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:45:19.374607 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:45:19.374607 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:45:19.374607 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:45:19.374607 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:45:19.374607 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:45:19.374607 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 28 00:45:19.374607 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:19.374607 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 279/550] 10.222.0.49 () {56 vars in 1096 bytes} [Sun Aug 28 00:45:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:19.378935 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8522c125-ebf3-4bad-b969-fa826b3c1734 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:19.506525 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c46f4ef-baf5-4bf1-a7b0-a566c8d44c17 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:19.573042 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8522c125-ebf3-4bad-b969-fa826b3c1734 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:19.610680 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:19.645319 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f53571-a2d3-4fd0-b20e-ed32aa8642a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:19.646111 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f53571-a2d3-4fd0-b20e-ed32aa8642a1 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:19.646387 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f53571-a2d3-4fd0-b20e-ed32aa8642a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:19.646762 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f53571-a2d3-4fd0-b20e-ed32aa8642a1 None admin] PATH_INFO: `/v3/users` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:19.647887 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f53571-a2d3-4fd0-b20e-ed32aa8642a1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:19.648200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f53571-a2d3-4fd0-b20e-ed32aa8642a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:19.650323 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f53571-a2d3-4fd0-b20e-ed32aa8642a1 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:19.691336 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 272/551] 10.222.0.49 () {56 vars in 1135 bytes} [Sun Aug 28 00:45:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:19.699076 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f53571-a2d3-4fd0-b20e-ed32aa8642a1 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:19.714344 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c46f4ef-baf5-4bf1-a7b0-a566c8d44c17 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:19.753249 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8fe63e-2fa7-4278-a97c-ea9741256985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:19.753909 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8fe63e-2fa7-4278-a97c-ea9741256985 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:19.754189 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8fe63e-2fa7-4278-a97c-ea9741256985 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:19.754461 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8fe63e-2fa7-4278-a97c-ea9741256985 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:19.769001 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8fe63e-2fa7-4278-a97c-ea9741256985 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:45:19.775277 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-1b8fe63e-2fa7-4278-a97c-ea9741256985 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:45:19.775277 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:19.775277 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:19.775277 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:19.775277 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:19.775277 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:19.775277 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:19.775277 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:19.775277 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:19.775277 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:19.775277 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:19.775277 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:19.775277 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:45:19.775277 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:45:19.775277 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:45:19.775277 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:45:19.776521 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:45:19.776521 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:45:19.776521 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:45:19.776521 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:45:19.776521 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:19.776521 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:19.776521 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:19.776521 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:19.776521 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:19.776521 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:19.776521 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:19.776521 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:19.776521 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:19.776521 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:19.776521 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:19.776521 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:19.777371 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:19.777371 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:19.777371 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:19.777371 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:19.777371 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:45:19.777371 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:45:19.777371 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:45:19.777371 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:45:19.777371 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:45:19.777371 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:45:19.777371 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:45:19.777371 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:19.777371 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 280/552] 10.222.0.49 () {56 vars in 1102 bytes} [Sun Aug 28 00:45:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:45:19.782877 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8fe63e-2fa7-4278-a97c-ea9741256985 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:19.837984 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:19.868809 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f53571-a2d3-4fd0-b20e-ed32aa8642a1 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:19.905844 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9143ba2-1e27-486f-9786-9933e933e749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:19.906467 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9143ba2-1e27-486f-9786-9933e933e749 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:19.906742 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9143ba2-1e27-486f-9786-9933e933e749 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:19.907010 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9143ba2-1e27-486f-9786-9933e933e749 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:19.923466 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8fe63e-2fa7-4278-a97c-ea9741256985 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:19.952222 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:19.966220 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b89735-085e-418f-891d-2c9fa36078e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:19.967212 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b89735-085e-418f-891d-2c9fa36078e6 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:19.967729 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b89735-085e-418f-891d-2c9fa36078e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:19.968171 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b89735-085e-418f-891d-2c9fa36078e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:19.969163 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b89735-085e-418f-891d-2c9fa36078e6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:19.969752 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b89735-085e-418f-891d-2c9fa36078e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:19.971319 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b89735-085e-418f-891d-2c9fa36078e6 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:19.979219 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9143ba2-1e27-486f-9786-9933e933e749 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:19.980915 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9143ba2-1e27-486f-9786-9933e933e749 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:19.982723 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 281/553] 10.222.0.49 () {56 vars in 1103 bytes} [Sun Aug 28 00:45:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:19.984304 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0cb5d1-e934-45bd-b5f8-e5406faf0b1f None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:19.984768 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0cb5d1-e934-45bd-b5f8-e5406faf0b1f None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:19.985210 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0cb5d1-e934-45bd-b5f8-e5406faf0b1f None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:19.991586 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 282/554] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:45:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:19.993028 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0cb5d1-e934-45bd-b5f8-e5406faf0b1f None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:20.094720 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 273/555] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 28 00:45:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 28 00:45:20.096202 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471fe81-2beb-4100-966d-b8dba93f0988 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:20.096485 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471fe81-2beb-4100-966d-b8dba93f0988 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:20.096750 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471fe81-2beb-4100-966d-b8dba93f0988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:20.115262 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-7471fe81-2beb-4100-966d-b8dba93f0988 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:20.116522 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-7471fe81-2beb-4100-966d-b8dba93f0988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:20.148238 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:20.170304 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0cb5d1-e934-45bd-b5f8-e5406faf0b1f None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:20.190192 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 274/556] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:45:20.191064 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7471fe81-2beb-4100-966d-b8dba93f0988 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:20.194458 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:20.222249 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18189e1-2a5b-4289-9ae5-ae40fd635ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:20.223632 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18189e1-2a5b-4289-9ae5-ae40fd635ed2 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:20.224288 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18189e1-2a5b-4289-9ae5-ae40fd635ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:20.224873 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18189e1-2a5b-4289-9ae5-ae40fd635ed2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:20.239016 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18189e1-2a5b-4289-9ae5-ae40fd635ed2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:20.241663 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18189e1-2a5b-4289-9ae5-ae40fd635ed2 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:20.262951 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-e18189e1-2a5b-4289-9ae5-ae40fd635ed2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:20.262951 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:20.262951 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:20.262951 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:20.262951 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:20.262951 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:20.262951 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:20.262951 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:20.262951 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:20.262951 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:20.262951 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:20.262951 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:20.262951 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:45:20.262951 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:45:20.262951 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:45:20.262951 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:45:20.264057 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:20.264057 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:20.264057 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:20.264057 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:20.264057 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:20.264057 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:20.264057 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:20.264057 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:20.264057 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:20.264057 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:20.264057 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:20.264057 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:20.264057 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:20.264057 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:20.264057 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:20.264057 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:20.264057 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:45:20.264965 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:45:20.264965 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:20.264965 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:20.267817 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 283/557] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:20.269697 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfac0e6-15cb-41e2-89ac-bb13c5625fc4 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:20.270212 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfac0e6-15cb-41e2-89ac-bb13c5625fc4 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:20.270853 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfac0e6-15cb-41e2-89ac-bb13c5625fc4 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:20.273082 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 284/558] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:45:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:20.276236 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfac0e6-15cb-41e2-89ac-bb13c5625fc4 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:20.315033 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7471fe81-2beb-4100-966d-b8dba93f0988 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:20.359551 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45900fb1-cd6c-40ea-8d47-2360e4eb7ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:20.360222 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45900fb1-cd6c-40ea-8d47-2360e4eb7ca9 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:20.360528 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45900fb1-cd6c-40ea-8d47-2360e4eb7ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:20.360959 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45900fb1-cd6c-40ea-8d47-2360e4eb7ca9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:20.375018 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45900fb1-cd6c-40ea-8d47-2360e4eb7ca9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:20.377295 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45900fb1-cd6c-40ea-8d47-2360e4eb7ca9 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:20.401573 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-45900fb1-cd6c-40ea-8d47-2360e4eb7ca9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:20.401573 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:20.401573 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:20.401573 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:20.401573 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:20.401573 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:20.401573 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:20.401573 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:20.401573 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:20.401573 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:20.401573 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:20.401573 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:20.401573 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:45:20.401573 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:45:20.401573 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:45:20.401573 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:45:20.403388 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:20.403388 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:20.403388 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:20.403388 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:20.403388 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:20.403388 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:20.403388 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:20.403388 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:20.403388 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:20.403388 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:20.403388 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:20.403388 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:20.403388 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:20.403388 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:20.403388 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:20.403388 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:20.403388 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:45:20.404367 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:45:20.404367 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:20.404367 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:20.404367 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 275/559] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:20.408991 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c7c8b6-4a35-4054-97f5-dbc6e339ec92 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:20.409312 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c7c8b6-4a35-4054-97f5-dbc6e339ec92 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:20.409677 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfac0e6-15cb-41e2-89ac-bb13c5625fc4 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:20.409786 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c7c8b6-4a35-4054-97f5-dbc6e339ec92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:20.432888 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-83c7c8b6-4a35-4054-97f5-dbc6e339ec92 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:20.434598 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-83c7c8b6-4a35-4054-97f5-dbc6e339ec92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:20.449625 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fafafbf-8b22-4ef7-985f-d6aa7b0d2101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:20.450636 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fafafbf-8b22-4ef7-985f-d6aa7b0d2101 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:20.451110 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fafafbf-8b22-4ef7-985f-d6aa7b0d2101 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:20.451569 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fafafbf-8b22-4ef7-985f-d6aa7b0d2101 None admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:20.452453 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fafafbf-8b22-4ef7-985f-d6aa7b0d2101 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:20.452964 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fafafbf-8b22-4ef7-985f-d6aa7b0d2101 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:20.454739 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fafafbf-8b22-4ef7-985f-d6aa7b0d2101 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:20.464918 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:20.474439 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 285/560] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:45:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:45:20.474439 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fafafbf-8b22-4ef7-985f-d6aa7b0d2101 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:20.513579 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:20.530958 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 276/561] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:45:20.531905 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c7c8b6-4a35-4054-97f5-dbc6e339ec92 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:20.611548 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fafafbf-8b22-4ef7-985f-d6aa7b0d2101 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:20.649811 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71556216-536e-499f-9915-f8cd5fc466d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:20.650503 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71556216-536e-499f-9915-f8cd5fc466d7 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:20.650785 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71556216-536e-499f-9915-f8cd5fc466d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:20.651014 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71556216-536e-499f-9915-f8cd5fc466d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:20.651788 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71556216-536e-499f-9915-f8cd5fc466d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:20.652039 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71556216-536e-499f-9915-f8cd5fc466d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:20.653494 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71556216-536e-499f-9915-f8cd5fc466d7 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:20.663771 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c7c8b6-4a35-4054-97f5-dbc6e339ec92 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:20.666887 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 286/562] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:45:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:20.672787 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934afc11-45f4-40d8-99f8-61bd3798f601 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:20.673070 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934afc11-45f4-40d8-99f8-61bd3798f601 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:20.673340 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934afc11-45f4-40d8-99f8-61bd3798f601 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:20.674776 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 287/563] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:45:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:20.675568 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934afc11-45f4-40d8-99f8-61bd3798f601 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:20.712427 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dfdd64-8ac5-4154-92b4-f542d1236ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:20.714115 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dfdd64-8ac5-4154-92b4-f542d1236ce0 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:20.714470 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dfdd64-8ac5-4154-92b4-f542d1236ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:20.714752 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dfdd64-8ac5-4154-92b4-f542d1236ce0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:20.728294 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dfdd64-8ac5-4154-92b4-f542d1236ce0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:20.729787 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dfdd64-8ac5-4154-92b4-f542d1236ce0 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:20.744369 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-68dfdd64-8ac5-4154-92b4-f542d1236ce0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 28 00:45:20.744369 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:20.744369 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:20.744369 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:20.744369 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:20.744369 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:20.744369 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:20.744369 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:20.744369 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:20.744369 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:20.744369 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:20.744369 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:20.744369 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:45:20.744369 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:45:20.744369 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:45:20.744369 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:45:20.745694 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:20.745694 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:20.745694 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:45:20.745694 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:45:20.745694 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:45:20.745694 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:45:20.745694 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:20.745694 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:20.745694 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:20.745694 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:20.745694 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:20.745694 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:20.745694 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:20.745694 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:20.745694 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:20.745694 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:20.745694 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:20.745694 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:20.747594 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:20.747594 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:20.747594 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:45:20.747594 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:45:20.747594 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:45:20.747594 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:45:20.747594 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:45:20.747594 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:45:20.747594 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 28 00:45:20.747594 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:20.747594 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 277/564] 10.222.0.49 () {56 vars in 1093 bytes} [Sun Aug 28 00:45:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:20.747594 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dfdd64-8ac5-4154-92b4-f542d1236ce0 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:20.762974 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:20.804064 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:20.815421 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934afc11-45f4-40d8-99f8-61bd3798f601 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:20.851863 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35863f2-20ef-460e-ad9f-1020aad13700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:20.852503 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35863f2-20ef-460e-ad9f-1020aad13700 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:20.852780 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35863f2-20ef-460e-ad9f-1020aad13700 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:20.853056 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35863f2-20ef-460e-ad9f-1020aad13700 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:20.860622 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dfdd64-8ac5-4154-92b4-f542d1236ce0 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:20.863936 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35863f2-20ef-460e-ad9f-1020aad13700 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:45:20.868881 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-b35863f2-20ef-460e-ad9f-1020aad13700 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:45:20.868881 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:20.868881 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:20.868881 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:20.868881 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:20.868881 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:20.868881 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:20.868881 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:20.868881 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:20.868881 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:20.868881 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:20.868881 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:20.868881 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:45:20.868881 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:45:20.868881 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:45:20.868881 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:45:20.869906 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:45:20.869906 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:45:20.869906 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:45:20.869906 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:45:20.869906 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:20.869906 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:20.869906 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:20.869906 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:20.869906 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:20.869906 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:20.869906 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:20.869906 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:20.869906 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:20.869906 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:20.869906 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:20.869906 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:20.871179 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:20.871179 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:20.871179 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:20.871179 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:20.871179 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:45:20.871179 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:45:20.871179 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:45:20.871179 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:45:20.871179 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:45:20.871179 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:45:20.871179 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:45:20.871179 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:20.871179 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 288/565] 10.222.0.49 () {56 vars in 1102 bytes} [Sun Aug 28 00:45:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:20.872093 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b51a09-836a-4f1f-a0b5-1f941b1f8673 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:20.872093 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b51a09-836a-4f1f-a0b5-1f941b1f8673 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:20.872276 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b51a09-836a-4f1f-a0b5-1f941b1f8673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:20.891384 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-c3b51a09-836a-4f1f-a0b5-1f941b1f8673 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:20.892629 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-c3b51a09-836a-4f1f-a0b5-1f941b1f8673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:20.900908 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d468cfa5-cbbd-4041-a511-c9f95012bc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:20.901722 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d468cfa5-cbbd-4041-a511-c9f95012bc58 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:20.902132 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d468cfa5-cbbd-4041-a511-c9f95012bc58 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:20.902422 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d468cfa5-cbbd-4041-a511-c9f95012bc58 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:20.910623 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d468cfa5-cbbd-4041-a511-c9f95012bc58 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:20.912167 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d468cfa5-cbbd-4041-a511-c9f95012bc58 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:20.924560 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-d468cfa5-cbbd-4041-a511-c9f95012bc58 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:45:20.924560 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:20.924560 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:20.924560 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:20.924560 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:20.924560 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:20.924560 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:20.924560 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:20.924560 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:20.924560 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:20.924560 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:20.924560 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:20.924560 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:45:20.924560 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:45:20.924560 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:45:20.930602 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:45:20.930602 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:20.930602 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:20.930602 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:20.930602 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:20.930602 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:20.930602 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:20.930602 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:20.930602 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:20.930602 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:20.930602 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:20.930602 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:20.930602 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:20.930602 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:20.930602 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:20.930602 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:20.930602 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:20.931881 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:45:20.931881 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:45:20.931881 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:45:20.931881 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:45:20.931881 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:45:20.931881 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:45:20.931881 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:45:20.931881 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:20.931881 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 278/566] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 28 00:45:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:20.931881 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d468cfa5-cbbd-4041-a511-c9f95012bc58 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:20.966044 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 289/567] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:45:20.966916 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b51a09-836a-4f1f-a0b5-1f941b1f8673 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:21.032356 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:21.046431 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d468cfa5-cbbd-4041-a511-c9f95012bc58 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:21.054286 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:21.092591 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b51a09-836a-4f1f-a0b5-1f941b1f8673 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:21.101762 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e34aa1-6682-43c8-9bba-04b624edda62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:21.102726 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e34aa1-6682-43c8-9bba-04b624edda62 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:21.103185 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e34aa1-6682-43c8-9bba-04b624edda62 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:21.103587 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e34aa1-6682-43c8-9bba-04b624edda62 None admin] PATH_INFO: `/v3/users` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:21.104718 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e34aa1-6682-43c8-9bba-04b624edda62 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:21.105170 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e34aa1-6682-43c8-9bba-04b624edda62 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:21.106665 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e34aa1-6682-43c8-9bba-04b624edda62 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:21.137209 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 279/568] 10.222.0.49 () {56 vars in 1133 bytes} [Sun Aug 28 00:45:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:21.137209 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e34aa1-6682-43c8-9bba-04b624edda62 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:21.148447 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2607eebe-e856-41c9-848d-07ad630a73b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:21.151494 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2607eebe-e856-41c9-848d-07ad630a73b6 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:21.151494 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2607eebe-e856-41c9-848d-07ad630a73b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:21.151494 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2607eebe-e856-41c9-848d-07ad630a73b6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:21.166653 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2607eebe-e856-41c9-848d-07ad630a73b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:45:21.171603 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-2607eebe-e856-41c9-848d-07ad630a73b6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:45:21.171603 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:21.171603 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:21.171603 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:21.171603 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:21.171603 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:21.171603 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:21.171603 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:21.171603 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:21.171603 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:21.171603 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:21.171603 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:21.171603 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:45:21.171603 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:45:21.171603 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:45:21.171603 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:45:21.172849 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:45:21.172849 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:45:21.172849 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:45:21.172849 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:45:21.172849 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:21.172849 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:21.172849 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:21.172849 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:21.172849 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:21.172849 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:21.172849 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:21.172849 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:21.172849 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:21.172849 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:21.172849 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:21.172849 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:21.174248 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:21.174248 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:21.174248 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:21.174248 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:21.174248 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:45:21.174248 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:45:21.174248 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:45:21.174248 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:45:21.174248 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:45:21.174248 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:45:21.174248 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:45:21.174248 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:21.177641 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 290/569] 10.222.0.49 () {56 vars in 1102 bytes} [Sun Aug 28 00:45:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:21.178366 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2607eebe-e856-41c9-848d-07ad630a73b6 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:21.268124 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e34aa1-6682-43c8-9bba-04b624edda62 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:21.292624 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2607eebe-e856-41c9-848d-07ad630a73b6 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:21.304077 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:21.306812 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb3747c-74e4-4f74-8fcf-706c630a2322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:21.307681 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3747c-74e4-4f74-8fcf-706c630a2322 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:21.307850 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3747c-74e4-4f74-8fcf-706c630a2322 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:21.308134 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3747c-74e4-4f74-8fcf-706c630a2322 None admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:21.308833 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb3747c-74e4-4f74-8fcf-706c630a2322 None admin] RBAC: Adding query filter params (name=service) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:21.309139 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb3747c-74e4-4f74-8fcf-706c630a2322 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:21.310559 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb3747c-74e4-4f74-8fcf-706c630a2322 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:21.319510 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 280/570] 10.222.0.49 () {56 vars in 1103 bytes} [Sun Aug 28 00:45:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:21.320403 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb3747c-74e4-4f74-8fcf-706c630a2322 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:21.331886 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1619f018-b6a1-401f-9004-d2d443eeb83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:21.332501 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1619f018-b6a1-401f-9004-d2d443eeb83a None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:21.332778 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1619f018-b6a1-401f-9004-d2d443eeb83a None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:21.333076 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1619f018-b6a1-401f-9004-d2d443eeb83a None admin] PATH_INFO: `/v3/projects` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:21.333764 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1619f018-b6a1-401f-9004-d2d443eeb83a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:21.334063 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1619f018-b6a1-401f-9004-d2d443eeb83a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:21.335533 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1619f018-b6a1-401f-9004-d2d443eeb83a None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:21.348318 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 291/571] 10.222.0.49 () {56 vars in 1148 bytes} [Sun Aug 28 00:45:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:21.349157 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1619f018-b6a1-401f-9004-d2d443eeb83a None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:21.358674 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:21.432161 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb3747c-74e4-4f74-8fcf-706c630a2322 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:21.450485 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1619f018-b6a1-401f-9004-d2d443eeb83a None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:21.465694 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f69c8a-5f22-4124-8612-1be6bc771397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:21.466326 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f69c8a-5f22-4124-8612-1be6bc771397 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:21.466609 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f69c8a-5f22-4124-8612-1be6bc771397 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:21.466883 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f69c8a-5f22-4124-8612-1be6bc771397 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:21.477268 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f69c8a-5f22-4124-8612-1be6bc771397 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:21.478698 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f69c8a-5f22-4124-8612-1be6bc771397 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:21.484864 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af909acf-bacf-4e66-be6e-465c02d0eabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:21.485479 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af909acf-bacf-4e66-be6e-465c02d0eabb None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:21.485757 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af909acf-bacf-4e66-be6e-465c02d0eabb None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:21.486025 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af909acf-bacf-4e66-be6e-465c02d0eabb None admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:21.486690 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af909acf-bacf-4e66-be6e-465c02d0eabb None admin] RBAC: Adding query filter params (name=service) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:21.486992 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af909acf-bacf-4e66-be6e-465c02d0eabb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:21.488388 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af909acf-bacf-4e66-be6e-465c02d0eabb None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:21.492676 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-e7f69c8a-5f22-4124-8612-1be6bc771397 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:21.492676 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:21.492676 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:21.492676 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:21.492676 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:21.492676 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:21.492676 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:21.492676 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:21.492676 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:21.492676 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:21.492676 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:21.492676 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:21.492676 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:45:21.492676 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:45:21.492676 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:45:21.492676 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:45:21.493631 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:21.493631 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:21.493631 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:21.493631 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:21.493631 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:21.493631 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:21.493631 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:21.493631 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:21.493631 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:21.493631 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:21.493631 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:21.493631 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:21.493631 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:21.493631 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:21.493631 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:21.493631 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:21.493631 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:45:21.494609 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:45:21.494609 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:21.494609 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:21.494609 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 281/572] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:21.494609 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f69c8a-5f22-4124-8612-1be6bc771397 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:21.503507 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 292/573] 10.222.0.49 () {56 vars in 1103 bytes} [Sun Aug 28 00:45:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:21.503507 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af909acf-bacf-4e66-be6e-465c02d0eabb None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:21.536492 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:21.580002 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:21.601579 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f69c8a-5f22-4124-8612-1be6bc771397 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:21.639901 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af909acf-bacf-4e66-be6e-465c02d0eabb None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:21.647132 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d972e0a-e182-40db-8fce-80422963e38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:21.647807 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d972e0a-e182-40db-8fce-80422963e38b None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:21.648086 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d972e0a-e182-40db-8fce-80422963e38b None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:21.648354 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d972e0a-e182-40db-8fce-80422963e38b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:21.659582 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d972e0a-e182-40db-8fce-80422963e38b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:45:21.664962 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-8d972e0a-e182-40db-8fce-80422963e38b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:45:21.664962 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:21.664962 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:21.664962 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:21.664962 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:21.664962 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:21.664962 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:21.664962 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:21.664962 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:21.664962 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:21.664962 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:21.664962 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:21.664962 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:45:21.664962 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:45:21.664962 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:45:21.664962 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:45:21.665946 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:45:21.665946 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:45:21.665946 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:45:21.665946 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:45:21.665946 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:21.665946 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:21.665946 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:21.665946 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:21.665946 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:21.665946 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:21.665946 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:21.665946 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:21.665946 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:21.665946 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:21.665946 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:21.665946 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:21.666783 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:21.666783 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:21.666783 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:21.666783 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:21.666783 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:45:21.666783 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:45:21.666783 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:45:21.666783 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:45:21.666783 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:45:21.666783 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:45:21.666783 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:45:21.666783 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:21.666783 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 282/574] 10.222.0.49 () {56 vars in 1102 bytes} [Sun Aug 28 00:45:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:21.667846 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d972e0a-e182-40db-8fce-80422963e38b None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:21.677135 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997026b1-bb26-4093-8d20-b67b40e62af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:21.677805 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997026b1-bb26-4093-8d20-b67b40e62af9 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:21.678081 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997026b1-bb26-4093-8d20-b67b40e62af9 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:21.678369 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997026b1-bb26-4093-8d20-b67b40e62af9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:21.689778 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997026b1-bb26-4093-8d20-b67b40e62af9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:21.691258 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997026b1-bb26-4093-8d20-b67b40e62af9 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:21.706473 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-997026b1-bb26-4093-8d20-b67b40e62af9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:21.706473 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:21.706473 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:21.706473 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:21.706473 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:21.706473 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:21.706473 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:21.706473 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:21.706473 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:21.706473 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:21.706473 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:21.706473 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:21.706473 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:45:21.706473 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:45:21.706473 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:45:21.706473 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:45:21.707581 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:21.707581 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:21.707581 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:21.707581 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:21.707581 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:21.707581 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:21.707581 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:21.707581 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:21.707581 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:21.707581 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:21.707581 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:21.707581 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:21.707581 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:21.707581 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:21.707581 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:21.707581 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:21.707581 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:45:21.708490 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:45:21.708490 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:21.708490 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:21.708490 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 293/575] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:21.708490 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997026b1-bb26-4093-8d20-b67b40e62af9 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:21.773520 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d972e0a-e182-40db-8fce-80422963e38b None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:21.794805 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:21.807257 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5817fd16-16d8-4f70-accf-912e6372a83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:21.807926 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817fd16-16d8-4f70-accf-912e6372a83b None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:21.808190 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817fd16-16d8-4f70-accf-912e6372a83b None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:21.808474 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817fd16-16d8-4f70-accf-912e6372a83b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:21.809198 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5817fd16-16d8-4f70-accf-912e6372a83b None admin] RBAC: Adding query filter params (role.id=ab658a45d85b49319c5add69c508b564, scope.project.id=6d6e897c6391486e9c44e9277a3ee823, user.id=4ce463b940db4f83a6df7e0561a88567) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:21.809504 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5817fd16-16d8-4f70-accf-912e6372a83b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:21.810933 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5817fd16-16d8-4f70-accf-912e6372a83b None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:21.811881 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997026b1-bb26-4093-8d20-b67b40e62af9 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:21.816460 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 283/576] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 28 00:45:21 2022] GET /identity/v3/role_assignments?user.id=4ce463b940db4f83a6df7e0561a88567&scope.project.id=6d6e897c6391486e9c44e9277a3ee823&role.id=ab658a45d85b49319c5add69c508b564 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:21.817072 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5817fd16-16d8-4f70-accf-912e6372a83b None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:21.819599 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:21.861102 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210ad6b7-2a50-47b9-a8a1-92e8fe18ba16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:21.861726 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210ad6b7-2a50-47b9-a8a1-92e8fe18ba16 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:21.862004 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210ad6b7-2a50-47b9-a8a1-92e8fe18ba16 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:21.862273 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210ad6b7-2a50-47b9-a8a1-92e8fe18ba16 None admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:21.862936 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210ad6b7-2a50-47b9-a8a1-92e8fe18ba16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:21.863245 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210ad6b7-2a50-47b9-a8a1-92e8fe18ba16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:21.864748 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210ad6b7-2a50-47b9-a8a1-92e8fe18ba16 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:21.883434 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 294/577] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:45:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:21.884466 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210ad6b7-2a50-47b9-a8a1-92e8fe18ba16 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:21.934990 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5817fd16-16d8-4f70-accf-912e6372a83b None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:21.973477 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6212f84f-7267-47d3-98bd-48f6c6c92682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:21.974593 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6212f84f-7267-47d3-98bd-48f6c6c92682 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:21.974593 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6212f84f-7267-47d3-98bd-48f6c6c92682 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:21.974593 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6212f84f-7267-47d3-98bd-48f6c6c92682 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:21.987976 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6212f84f-7267-47d3-98bd-48f6c6c92682 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:21.989671 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6212f84f-7267-47d3-98bd-48f6c6c92682 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:22.005631 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-6212f84f-7267-47d3-98bd-48f6c6c92682 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:22.005631 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:22.005631 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:22.005631 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:22.005631 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:22.005631 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:22.005631 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:22.005631 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:22.005631 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:22.005631 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:22.005631 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:22.005631 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:22.005631 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:45:22.005631 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:45:22.005631 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:45:22.005631 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:45:22.006698 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:22.006698 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:22.006698 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:22.006698 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:22.006698 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:22.006698 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:22.006698 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:22.006698 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:22.006698 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:22.006698 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:22.006698 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:22.006698 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:22.006698 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:22.006698 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:22.006698 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:22.006698 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:22.006698 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:45:22.012576 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:45:22.012576 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:22.012576 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:22.012761 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210ad6b7-2a50-47b9-a8a1-92e8fe18ba16 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:22.012839 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 284/578] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:22.012839 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6212f84f-7267-47d3-98bd-48f6c6c92682 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:22.048729 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65800cb5-3648-45ee-a7f4-b61f3251a4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:22.049347 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65800cb5-3648-45ee-a7f4-b61f3251a4aa None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:22.049623 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65800cb5-3648-45ee-a7f4-b61f3251a4aa None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:22.049892 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65800cb5-3648-45ee-a7f4-b61f3251a4aa None admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:22.050566 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65800cb5-3648-45ee-a7f4-b61f3251a4aa None admin] RBAC: Adding query filter params (name=service) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:22.050872 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65800cb5-3648-45ee-a7f4-b61f3251a4aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:22.052324 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65800cb5-3648-45ee-a7f4-b61f3251a4aa None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:22.061516 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 295/579] 10.222.0.49 () {56 vars in 1103 bytes} [Sun Aug 28 00:45:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:22.062365 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65800cb5-3648-45ee-a7f4-b61f3251a4aa None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:22.073129 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:22.083588 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:22.132044 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6212f84f-7267-47d3-98bd-48f6c6c92682 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:22.171034 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac364b7-b64e-4642-bde1-360da182ddbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:22.171685 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac364b7-b64e-4642-bde1-360da182ddbf None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:22.171958 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac364b7-b64e-4642-bde1-360da182ddbf None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:22.172230 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac364b7-b64e-4642-bde1-360da182ddbf None admin] PATH_INFO: `/v3/domains` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:22.172891 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac364b7-b64e-4642-bde1-360da182ddbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:22.173190 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac364b7-b64e-4642-bde1-360da182ddbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:22.174556 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac364b7-b64e-4642-bde1-360da182ddbf None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:22.178350 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65800cb5-3648-45ee-a7f4-b61f3251a4aa None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:22.187252 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 285/580] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:45:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:22.187999 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac364b7-b64e-4642-bde1-360da182ddbf None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:22.220324 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9eff25-9cdb-4351-9c78-dcec65aac63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:22.220961 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9eff25-9cdb-4351-9c78-dcec65aac63e None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:22.221227 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9eff25-9cdb-4351-9c78-dcec65aac63e None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:22.221489 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9eff25-9cdb-4351-9c78-dcec65aac63e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:22.229493 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9eff25-9cdb-4351-9c78-dcec65aac63e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:22.231485 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9eff25-9cdb-4351-9c78-dcec65aac63e None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:22.244890 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-3d9eff25-9cdb-4351-9c78-dcec65aac63e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:45:22.244890 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:22.244890 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:22.244890 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:22.244890 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:22.244890 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:22.244890 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:22.244890 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:22.244890 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:22.244890 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:22.244890 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:22.244890 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:22.244890 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:45:22.244890 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:45:22.244890 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:45:22.245972 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:45:22.245972 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:22.245972 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:22.245972 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:22.245972 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:22.245972 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:22.245972 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:22.245972 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:22.245972 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:22.245972 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:22.245972 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:22.245972 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:22.245972 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:22.245972 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:22.245972 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:22.245972 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:22.245972 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:22.246967 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:45:22.246967 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:45:22.246967 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:45:22.246967 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:45:22.246967 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:45:22.246967 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:45:22.246967 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:45:22.246967 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:22.246967 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 296/581] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 28 00:45:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:22.248281 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9eff25-9cdb-4351-9c78-dcec65aac63e None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:22.301201 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac364b7-b64e-4642-bde1-360da182ddbf None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:22.325840 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:22.327225 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:22.359885 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bc5b76-ae0c-4018-beb2-57f865545184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:22.360925 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc5b76-ae0c-4018-beb2-57f865545184 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:22.361418 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc5b76-ae0c-4018-beb2-57f865545184 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:22.361904 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc5b76-ae0c-4018-beb2-57f865545184 None admin] PATH_INFO: `/v3/domains` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:22.363080 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bc5b76-ae0c-4018-beb2-57f865545184 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:22.363621 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bc5b76-ae0c-4018-beb2-57f865545184 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:22.365916 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bc5b76-ae0c-4018-beb2-57f865545184 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:22.366924 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9eff25-9cdb-4351-9c78-dcec65aac63e None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:22.385584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 286/582] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:45:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:22.387045 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bc5b76-ae0c-4018-beb2-57f865545184 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:22.409796 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ff11ee-121e-46ea-bb79-17b077577365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:22.410838 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff11ee-121e-46ea-bb79-17b077577365 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:22.411181 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff11ee-121e-46ea-bb79-17b077577365 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:22.411515 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff11ee-121e-46ea-bb79-17b077577365 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:22.423452 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ff11ee-121e-46ea-bb79-17b077577365 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:22.424947 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ff11ee-121e-46ea-bb79-17b077577365 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:22.440637 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-f9ff11ee-121e-46ea-bb79-17b077577365 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:22.440637 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:22.440637 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:22.440637 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:22.440637 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:22.440637 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:22.440637 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:22.440637 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:22.440637 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:22.440637 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:22.440637 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:22.440637 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:22.440637 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:45:22.440637 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:45:22.440637 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:45:22.440637 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:45:22.441631 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:22.441631 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:22.441631 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:22.441631 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:22.441631 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:22.441631 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:22.441631 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:22.441631 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:22.441631 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:22.441631 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:22.441631 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:22.441631 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:22.441631 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:22.441631 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:22.441631 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:22.441631 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:22.441631 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:45:22.447520 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:45:22.447520 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:22.447520 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:22.447520 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 297/583] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:22.447520 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ff11ee-121e-46ea-bb79-17b077577365 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:22.546027 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bc5b76-ae0c-4018-beb2-57f865545184 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:22.564537 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ff11ee-121e-46ea-bb79-17b077577365 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:22.585725 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d52a1b-a588-40de-abb1-d51b86e8a19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:22.585982 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:22.586364 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d52a1b-a588-40de-abb1-d51b86e8a19a None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:22.586643 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d52a1b-a588-40de-abb1-d51b86e8a19a None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:22.586948 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d52a1b-a588-40de-abb1-d51b86e8a19a None admin] PATH_INFO: `/v3/users/glance` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:22.596185 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d52a1b-a588-40de-abb1-d51b86e8a19a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:22.597651 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d52a1b-a588-40de-abb1-d51b86e8a19a None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:22.606483 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055b3021-f289-4691-ac17-7066cec3004c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:22.607344 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b3021-f289-4691-ac17-7066cec3004c None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:22.607833 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b3021-f289-4691-ac17-7066cec3004c None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:22.608269 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b3021-f289-4691-ac17-7066cec3004c None admin] PATH_INFO: `/v3/projects` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:22.609183 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055b3021-f289-4691-ac17-7066cec3004c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:22.609308 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-13d52a1b-a588-40de-abb1-d51b86e8a19a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 28 00:45:22.609308 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:22.609308 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:22.609308 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:22.609308 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:22.609308 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:22.609308 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:22.609308 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:22.609308 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:22.609308 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:22.609308 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:22.609308 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:22.609308 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:45:22.609308 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:45:22.609308 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:45:22.609308 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:45:22.610194 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:22.610194 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:22.610194 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:45:22.610194 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:45:22.610194 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:45:22.610194 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:45:22.610194 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:22.610194 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:22.610194 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:22.610194 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:22.610194 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:22.610194 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:22.610194 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:22.610194 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:22.610194 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:22.610194 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:22.610194 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:22.610194 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:22.611189 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:22.611189 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:22.611189 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:45:22.611189 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:45:22.611189 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:45:22.611189 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:45:22.611189 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:45:22.611189 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:45:22.611189 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 28 00:45:22.611189 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:22.611189 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 287/584] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 28 00:45:22 2022] GET /identity/v3/users/glance => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:22.611189 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d52a1b-a588-40de-abb1-d51b86e8a19a None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:22.612461 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055b3021-f289-4691-ac17-7066cec3004c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:22.613514 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055b3021-f289-4691-ac17-7066cec3004c None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:22.633599 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 298/585] 10.222.0.49 () {56 vars in 1148 bytes} [Sun Aug 28 00:45:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:22.633599 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055b3021-f289-4691-ac17-7066cec3004c None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:22.656542 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:22.732412 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d52a1b-a588-40de-abb1-d51b86e8a19a None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:22.746491 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055b3021-f289-4691-ac17-7066cec3004c None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:22.772730 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210ee8e1-0519-473e-a23e-de375ede5f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:22.773385 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210ee8e1-0519-473e-a23e-de375ede5f46 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:22.773671 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210ee8e1-0519-473e-a23e-de375ede5f46 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:22.773969 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210ee8e1-0519-473e-a23e-de375ede5f46 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:22.783091 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210ee8e1-0519-473e-a23e-de375ede5f46 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:22.784501 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210ee8e1-0519-473e-a23e-de375ede5f46 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:22.786147 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a0fd15-5607-4883-9906-67e8196dfaa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:22.786789 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0fd15-5607-4883-9906-67e8196dfaa5 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:22.787077 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0fd15-5607-4883-9906-67e8196dfaa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:22.787355 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0fd15-5607-4883-9906-67e8196dfaa5 None admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:22.788055 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a0fd15-5607-4883-9906-67e8196dfaa5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:22.788350 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a0fd15-5607-4883-9906-67e8196dfaa5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:22.789793 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a0fd15-5607-4883-9906-67e8196dfaa5 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:22.797394 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-210ee8e1-0519-473e-a23e-de375ede5f46 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 28 00:45:22.797394 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:22.797394 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:22.797394 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:22.797394 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:22.797394 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:22.797394 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:22.797394 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:22.797394 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:22.797394 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:22.797394 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:22.797394 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:22.797394 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:45:22.797394 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:45:22.797394 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:45:22.797394 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:45:22.798393 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:22.798393 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:22.798393 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:45:22.798393 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:45:22.798393 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:45:22.798393 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:45:22.798393 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:22.798393 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:22.798393 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:22.798393 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:22.798393 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:22.798393 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:22.798393 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:22.798393 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:22.798393 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:22.798393 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:22.798393 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:22.798393 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:22.799329 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:22.799329 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:22.799329 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:45:22.799329 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:45:22.799329 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:45:22.799329 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:45:22.799329 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:45:22.799329 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:45:22.799329 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 28 00:45:22.799329 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:22.799329 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 288/586] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 28 00:45:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:22.799329 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210ee8e1-0519-473e-a23e-de375ede5f46 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:22.808410 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 299/587] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:45:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:22.813410 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a0fd15-5607-4883-9906-67e8196dfaa5 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:22.858904 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:22.908324 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:22.923091 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210ee8e1-0519-473e-a23e-de375ede5f46 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:22.930438 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a0fd15-5607-4883-9906-67e8196dfaa5 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:22.969039 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed4f3f-d266-449c-ba5e-26017a2c44e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:22.969504 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d6325-3621-4ff3-bf8d-bdaf5d79e81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:22.969706 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed4f3f-d266-449c-ba5e-26017a2c44e4 None admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:22.970249 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed4f3f-d266-449c-ba5e-26017a2c44e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:22.970249 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed4f3f-d266-449c-ba5e-26017a2c44e4 None admin] PATH_INFO: `/v3/projects/6d6e897c6391486e9c44e9277a3ee823/users/3dc0655c8156457a8fcb006c9fe85eb9/roles/ab658a45d85b49319c5add69c508b564` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:22.970434 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d6325-3621-4ff3-bf8d-bdaf5d79e81c None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:22.970520 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d6325-3621-4ff3-bf8d-bdaf5d79e81c None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:22.970882 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d6325-3621-4ff3-bf8d-bdaf5d79e81c None admin] PATH_INFO: `/v3/users` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:22.971713 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30d6325-3621-4ff3-bf8d-bdaf5d79e81c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:22.972081 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30d6325-3621-4ff3-bf8d-bdaf5d79e81c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:22.974504 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30d6325-3621-4ff3-bf8d-bdaf5d79e81c None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:22.988617 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ed4f3f-d266-449c-ba5e-26017a2c44e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=6d6e897c6391486e9c44e9277a3ee823, user_id=3dc0655c8156457a8fcb006c9fe85eb9, role_id=ab658a45d85b49319c5add69c508b564)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:22.990377 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ed4f3f-d266-449c-ba5e-26017a2c44e4 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:23.000385 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 289/588] 10.222.0.49 () {56 vars in 1137 bytes} [Sun Aug 28 00:45:22 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:23.001247 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d6325-3621-4ff3-bf8d-bdaf5d79e81c None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:23.019697 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 300/589] 10.222.0.49 () {58 vars in 1439 bytes} [Sun Aug 28 00:45:22 2022] PUT /identity/v3/projects/6d6e897c6391486e9c44e9277a3ee823/users/3dc0655c8156457a8fcb006c9fe85eb9/roles/ab658a45d85b49319c5add69c508b564 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:45:23.019697 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed4f3f-d266-449c-ba5e-26017a2c44e4 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:23.134789 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:23.164063 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed4f3f-d266-449c-ba5e-26017a2c44e4 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:23.168044 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d6325-3621-4ff3-bf8d-bdaf5d79e81c None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:23.214885 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee6105-651a-4e5c-98b2-6b6320b49a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:23.215489 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e29d15-9757-443d-9428-a173caf0a0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:23.215587 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee6105-651a-4e5c-98b2-6b6320b49a34 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:23.215912 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee6105-651a-4e5c-98b2-6b6320b49a34 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:23.216059 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e29d15-9757-443d-9428-a173caf0a0cc None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:23.216191 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee6105-651a-4e5c-98b2-6b6320b49a34 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:23.216393 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e29d15-9757-443d-9428-a173caf0a0cc None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:23.216575 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e29d15-9757-443d-9428-a173caf0a0cc None admin] PATH_INFO: `/v3/users` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:23.217237 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e29d15-9757-443d-9428-a173caf0a0cc None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:23.217535 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e29d15-9757-443d-9428-a173caf0a0cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:23.219043 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e29d15-9757-443d-9428-a173caf0a0cc None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:23.224708 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ee6105-651a-4e5c-98b2-6b6320b49a34 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:23.226171 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ee6105-651a-4e5c-98b2-6b6320b49a34 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:23.237867 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 290/590] 10.222.0.49 () {56 vars in 1137 bytes} [Sun Aug 28 00:45:23 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:23.238805 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e29d15-9757-443d-9428-a173caf0a0cc None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:23.239075 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-67ee6105-651a-4e5c-98b2-6b6320b49a34 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 28 00:45:23.239075 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:23.239075 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:23.239075 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:23.239075 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:23.239075 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:23.239075 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:23.239075 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:23.239075 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:23.239075 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:23.239075 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:23.239075 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:23.239075 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:45:23.239075 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:45:23.239075 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:45:23.239075 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:45:23.240094 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:23.240094 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:23.240094 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:45:23.240094 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:45:23.240094 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:45:23.240094 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:45:23.240094 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:23.240094 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:23.240094 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:23.240094 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:23.240094 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:23.240094 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:23.240094 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:23.240094 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:23.240094 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:23.240094 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:23.240094 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:23.240094 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:23.242124 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:23.242124 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:23.242124 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:45:23.242124 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:45:23.242124 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:45:23.242124 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:45:23.242124 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:45:23.242124 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:45:23.242124 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 28 00:45:23.242124 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:23.245913 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 301/591] 10.222.0.49 () {56 vars in 1102 bytes} [Sun Aug 28 00:45:23 2022] GET /identity/v3/users/neutron => generated 85 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:23.250615 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee6105-651a-4e5c-98b2-6b6320b49a34 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:23.252644 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:23.344523 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e29d15-9757-443d-9428-a173caf0a0cc None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:23.366629 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee6105-651a-4e5c-98b2-6b6320b49a34 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:23.380956 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e92128-c5b4-4dd4-b61f-5c73807c095d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:23.381697 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e92128-c5b4-4dd4-b61f-5c73807c095d None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:23.382042 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e92128-c5b4-4dd4-b61f-5c73807c095d None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:23.382381 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e92128-c5b4-4dd4-b61f-5c73807c095d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:23.394728 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e92128-c5b4-4dd4-b61f-5c73807c095d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:23.397497 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e92128-c5b4-4dd4-b61f-5c73807c095d None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:23.404534 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef37ab7-6912-40ae-8c79-d406bd06f59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:23.405172 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef37ab7-6912-40ae-8c79-d406bd06f59f None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:23.405448 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef37ab7-6912-40ae-8c79-d406bd06f59f None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:23.405718 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef37ab7-6912-40ae-8c79-d406bd06f59f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:23.417692 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef37ab7-6912-40ae-8c79-d406bd06f59f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:23.419227 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef37ab7-6912-40ae-8c79-d406bd06f59f None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:23.425577 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-d6e92128-c5b4-4dd4-b61f-5c73807c095d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:23.425577 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:23.425577 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:23.425577 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:23.425577 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:23.425577 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:23.425577 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:23.425577 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:23.425577 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:23.425577 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:23.425577 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:23.425577 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:23.425577 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:45:23.425577 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:45:23.425577 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:45:23.425577 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:45:23.427628 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:23.427628 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:23.427628 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:23.427628 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:23.427628 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:23.427628 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:23.427628 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:23.427628 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:23.427628 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:23.427628 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:23.427628 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:23.427628 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:23.427628 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:23.427628 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:23.427628 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:23.427628 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:23.427628 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:45:23.429735 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:45:23.429735 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:23.429735 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:23.430131 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:23.435207 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-eef37ab7-6912-40ae-8c79-d406bd06f59f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:23.435207 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:23.435207 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:23.435207 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:23.435207 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:23.435207 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:23.435207 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:23.435207 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:23.435207 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:23.435207 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:23.435207 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:23.435207 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:23.435207 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:45:23.435207 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:45:23.435207 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:45:23.435207 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:45:23.437750 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:23.437750 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:23.437750 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:23.437750 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:23.437750 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:23.437750 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:23.437750 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:23.437750 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:23.437750 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:23.437750 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:23.437750 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:23.437750 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:23.437750 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:23.437750 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:23.437750 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:23.437750 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:23.437750 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:45:23.440045 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:45:23.440045 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:23.440045 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:23.440341 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 291/592] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:23.440341 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e92128-c5b4-4dd4-b61f-5c73807c095d None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:23.443340 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 302/593] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:45:23.443340 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef37ab7-6912-40ae-8c79-d406bd06f59f None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:23.543726 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:23.557294 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef37ab7-6912-40ae-8c79-d406bd06f59f None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:23.595373 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc1414d-22c2-403f-919a-f5e9883b2a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:23.596365 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1414d-22c2-403f-919a-f5e9883b2a89 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:23.596893 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1414d-22c2-403f-919a-f5e9883b2a89 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:23.597315 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1414d-22c2-403f-919a-f5e9883b2a89 None admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:23.598140 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc1414d-22c2-403f-919a-f5e9883b2a89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:23.598606 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc1414d-22c2-403f-919a-f5e9883b2a89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:23.600258 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc1414d-22c2-403f-919a-f5e9883b2a89 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:23.611847 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e92128-c5b4-4dd4-b61f-5c73807c095d None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:23.614945 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 303/594] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:45:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:23.616002 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc1414d-22c2-403f-919a-f5e9883b2a89 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:23.676899 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953f91da-99e2-45f5-a106-56ee64964310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:23.677849 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f91da-99e2-45f5-a106-56ee64964310 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:23.678314 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f91da-99e2-45f5-a106-56ee64964310 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:23.678639 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f91da-99e2-45f5-a106-56ee64964310 None admin] PATH_INFO: `/v3/users` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:23.680091 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953f91da-99e2-45f5-a106-56ee64964310 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:23.680626 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953f91da-99e2-45f5-a106-56ee64964310 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:23.682642 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:23.683729 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953f91da-99e2-45f5-a106-56ee64964310 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:23.728357 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc1414d-22c2-403f-919a-f5e9883b2a89 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:23.730141 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 292/595] 10.222.0.49 () {56 vars in 1139 bytes} [Sun Aug 28 00:45:23 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:23.732361 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953f91da-99e2-45f5-a106-56ee64964310 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:23.766280 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cdfab0-649f-43cd-bce6-2d353fe15026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:23.766892 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cdfab0-649f-43cd-bce6-2d353fe15026 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:23.767168 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cdfab0-649f-43cd-bce6-2d353fe15026 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:23.767436 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cdfab0-649f-43cd-bce6-2d353fe15026 None admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:23.768112 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cdfab0-649f-43cd-bce6-2d353fe15026 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:23.768412 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cdfab0-649f-43cd-bce6-2d353fe15026 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:23.769790 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cdfab0-649f-43cd-bce6-2d353fe15026 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:23.782224 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 304/596] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:45:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:23.784353 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cdfab0-649f-43cd-bce6-2d353fe15026 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:23.867185 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953f91da-99e2-45f5-a106-56ee64964310 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:23.889221 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:23.906242 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16861621-bc4c-450d-ab57-4b15d68a1046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:23.907085 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16861621-bc4c-450d-ab57-4b15d68a1046 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:23.907263 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16861621-bc4c-450d-ab57-4b15d68a1046 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:23.907524 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16861621-bc4c-450d-ab57-4b15d68a1046 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:23.913148 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cdfab0-649f-43cd-bce6-2d353fe15026 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:23.915075 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16861621-bc4c-450d-ab57-4b15d68a1046 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:23.916700 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16861621-bc4c-450d-ab57-4b15d68a1046 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:23.928986 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-16861621-bc4c-450d-ab57-4b15d68a1046 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:45:23.928986 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:23.928986 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:23.928986 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:23.928986 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:23.928986 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:23.928986 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:23.928986 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:23.928986 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:23.928986 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:23.928986 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:23.928986 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:23.928986 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:45:23.928986 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:45:23.928986 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:45:23.929914 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:45:23.929914 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:23.929914 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:23.929914 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:23.929914 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:23.929914 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:23.929914 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:23.929914 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:23.929914 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:23.929914 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:23.929914 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:23.929914 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:23.929914 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:23.929914 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:23.929914 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:23.929914 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:23.929914 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:23.930855 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:45:23.930855 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:45:23.930855 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:45:23.930855 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:45:23.930855 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:45:23.930855 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:45:23.930855 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:45:23.930855 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:23.930855 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 293/597] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 28 00:45:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:23.931347 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf9a48-3f02-4d88-983c-0b126e5580cd None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:23.932002 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf9a48-3f02-4d88-983c-0b126e5580cd None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:23.932002 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caf9a48-3f02-4d88-983c-0b126e5580cd None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:23.935796 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 294/598] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:45:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:23.935796 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caf9a48-3f02-4d88-983c-0b126e5580cd None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:23.941376 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:23.961274 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fc2270-3f1c-41ac-9793-c27c1cb10f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:23.961916 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc2270-3f1c-41ac-9793-c27c1cb10f1c None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:23.962189 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc2270-3f1c-41ac-9793-c27c1cb10f1c None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:23.962454 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc2270-3f1c-41ac-9793-c27c1cb10f1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:23.974574 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fc2270-3f1c-41ac-9793-c27c1cb10f1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:23.977145 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fc2270-3f1c-41ac-9793-c27c1cb10f1c None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:23.993218 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-12fc2270-3f1c-41ac-9793-c27c1cb10f1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:23.993218 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:23.993218 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:23.993218 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:23.993218 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:23.993218 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:23.993218 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:23.993218 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:23.993218 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:23.993218 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:23.993218 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:23.993218 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:23.993218 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:45:23.993218 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:45:23.993218 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:45:23.993218 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:45:23.994284 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:23.994284 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:23.994284 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:23.994284 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:23.994284 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:23.994284 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:23.994284 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:23.994284 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:23.994284 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:23.994284 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:23.994284 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:23.994284 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:23.994284 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:23.994284 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:23.994284 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:23.994284 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:23.994284 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:45:24.000133 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:45:24.000133 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:24.000133 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:24.000133 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 305/599] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:24.000133 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fc2270-3f1c-41ac-9793-c27c1cb10f1c None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:24.052893 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caf9a48-3f02-4d88-983c-0b126e5580cd None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:24.091479 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b6c6ee-67ad-4eff-9f25-ad3f0113c106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:24.092224 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6c6ee-67ad-4eff-9f25-ad3f0113c106 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:24.092445 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6c6ee-67ad-4eff-9f25-ad3f0113c106 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:24.092718 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6c6ee-67ad-4eff-9f25-ad3f0113c106 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:24.102391 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b6c6ee-67ad-4eff-9f25-ad3f0113c106 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:24.104058 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b6c6ee-67ad-4eff-9f25-ad3f0113c106 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:24.112666 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fc2270-3f1c-41ac-9793-c27c1cb10f1c None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:24.116276 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-46b6c6ee-67ad-4eff-9f25-ad3f0113c106 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:45:24.116276 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:24.116276 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:24.116276 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:24.116276 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:24.116276 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:24.116276 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:24.116276 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:24.116276 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:24.116276 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:24.116276 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:24.116276 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:24.116276 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:45:24.116276 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:45:24.116276 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:45:24.117234 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:45:24.117234 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:24.117234 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:24.117234 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:24.117234 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:24.117234 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:24.117234 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:24.117234 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:24.117234 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:24.117234 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:24.117234 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:24.117234 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:24.117234 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:24.117234 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:24.117234 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:24.117234 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:24.117234 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:24.118126 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:45:24.118126 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:45:24.118126 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:45:24.118126 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:45:24.118126 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:45:24.118126 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:45:24.118126 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:45:24.118126 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:24.118126 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 295/600] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 28 00:45:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:24.118637 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619580f-fcd4-4be0-8954-40537e5726eb None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:24.119033 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619580f-fcd4-4be0-8954-40537e5726eb None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:24.119158 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619580f-fcd4-4be0-8954-40537e5726eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:24.138966 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-d619580f-fcd4-4be0-8954-40537e5726eb None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:24.140510 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-d619580f-fcd4-4be0-8954-40537e5726eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:24.157242 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed89fe9-be43-4abf-8679-e36b9c0565f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:24.157855 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed89fe9-be43-4abf-8679-e36b9c0565f8 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:24.158133 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed89fe9-be43-4abf-8679-e36b9c0565f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:24.158403 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed89fe9-be43-4abf-8679-e36b9c0565f8 None admin] PATH_INFO: `/v3/projects` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:24.159205 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed89fe9-be43-4abf-8679-e36b9c0565f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:24.159503 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed89fe9-be43-4abf-8679-e36b9c0565f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:24.160976 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed89fe9-be43-4abf-8679-e36b9c0565f8 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:24.176180 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 306/601] 10.222.0.49 () {56 vars in 1148 bytes} [Sun Aug 28 00:45:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:24.177088 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed89fe9-be43-4abf-8679-e36b9c0565f8 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:24.188380 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:24.216586 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:24.235694 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 296/602] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:45:24.235694 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619580f-fcd4-4be0-8954-40537e5726eb None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:24.297935 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed89fe9-be43-4abf-8679-e36b9c0565f8 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:24.336239 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1997f6c5-b850-4f42-a590-dab972c298c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:24.337045 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1997f6c5-b850-4f42-a590-dab972c298c7 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:24.337412 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1997f6c5-b850-4f42-a590-dab972c298c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:24.337774 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1997f6c5-b850-4f42-a590-dab972c298c7 None admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:24.338748 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1997f6c5-b850-4f42-a590-dab972c298c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:24.339147 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1997f6c5-b850-4f42-a590-dab972c298c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:24.340685 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1997f6c5-b850-4f42-a590-dab972c298c7 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:24.347940 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619580f-fcd4-4be0-8954-40537e5726eb None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:24.353542 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 307/603] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:45:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:24.354406 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1997f6c5-b850-4f42-a590-dab972c298c7 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:24.390860 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5094290b-02c8-4c8c-90e8-9ead2e94a586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:24.391576 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5094290b-02c8-4c8c-90e8-9ead2e94a586 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:24.391884 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5094290b-02c8-4c8c-90e8-9ead2e94a586 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:24.392155 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5094290b-02c8-4c8c-90e8-9ead2e94a586 None admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:24.392853 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5094290b-02c8-4c8c-90e8-9ead2e94a586 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:24.393154 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5094290b-02c8-4c8c-90e8-9ead2e94a586 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:24.394736 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5094290b-02c8-4c8c-90e8-9ead2e94a586 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:24.412724 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 297/604] 10.222.0.49 () {56 vars in 1148 bytes} [Sun Aug 28 00:45:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:24.413640 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5094290b-02c8-4c8c-90e8-9ead2e94a586 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:24.446886 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:24.469716 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:24.481275 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1997f6c5-b850-4f42-a590-dab972c298c7 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:24.517730 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ff674-5e88-45dd-89bb-c7d2181f7dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:24.518394 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ff674-5e88-45dd-89bb-c7d2181f7dfa None admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:24.518682 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ff674-5e88-45dd-89bb-c7d2181f7dfa None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:24.518945 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ff674-5e88-45dd-89bb-c7d2181f7dfa None admin] PATH_INFO: `/v3/projects/6d6e897c6391486e9c44e9277a3ee823/users/22053bd9632346aab63814f740415f69/roles/ab658a45d85b49319c5add69c508b564` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:24.526012 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5094290b-02c8-4c8c-90e8-9ead2e94a586 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:24.540051 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939ff674-5e88-45dd-89bb-c7d2181f7dfa None admin] RBAC: Authorizing `identity:create_grant(project_id=6d6e897c6391486e9c44e9277a3ee823, user_id=22053bd9632346aab63814f740415f69, role_id=ab658a45d85b49319c5add69c508b564)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:24.542169 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939ff674-5e88-45dd-89bb-c7d2181f7dfa None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:24.556782 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 308/605] 10.222.0.49 () {58 vars in 1439 bytes} [Sun Aug 28 00:45:24 2022] PUT /identity/v3/projects/6d6e897c6391486e9c44e9277a3ee823/users/22053bd9632346aab63814f740415f69/roles/ab658a45d85b49319c5add69c508b564 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:45:24.557959 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ff674-5e88-45dd-89bb-c7d2181f7dfa None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:24.573926 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4486b073-7a96-4131-bf5b-320d1128a970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:24.574599 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4486b073-7a96-4131-bf5b-320d1128a970 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:24.574877 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4486b073-7a96-4131-bf5b-320d1128a970 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:24.575145 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4486b073-7a96-4131-bf5b-320d1128a970 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:24.584162 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4486b073-7a96-4131-bf5b-320d1128a970 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:24.585694 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4486b073-7a96-4131-bf5b-320d1128a970 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:24.599489 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-4486b073-7a96-4131-bf5b-320d1128a970 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:45:24.599489 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:24.599489 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:24.599489 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:24.599489 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:24.599489 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:24.599489 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:24.599489 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:24.599489 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:24.599489 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:24.599489 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:24.599489 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:24.599489 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:45:24.599489 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:45:24.599489 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:45:24.600584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:45:24.600584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:24.600584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:24.600584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:24.600584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:24.600584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:24.600584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:24.600584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:24.600584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:24.600584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:24.600584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:24.600584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:24.600584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:24.600584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:24.600584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:24.600584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:24.600584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:24.601524 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:45:24.601524 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:45:24.601524 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:45:24.601524 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:45:24.601524 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:45:24.601524 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:45:24.601524 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:45:24.601524 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:24.605780 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 298/606] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 28 00:45:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:24.606886 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4486b073-7a96-4131-bf5b-320d1128a970 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:24.708337 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ff674-5e88-45dd-89bb-c7d2181f7dfa None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:24.713652 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:24.737382 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4486b073-7a96-4131-bf5b-320d1128a970 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:24.756498 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b412b57-4cb3-4bed-9313-6ea0e944aa65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:24.757522 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b412b57-4cb3-4bed-9313-6ea0e944aa65 None admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:24.758059 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b412b57-4cb3-4bed-9313-6ea0e944aa65 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:24.758564 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b412b57-4cb3-4bed-9313-6ea0e944aa65 None admin] PATH_INFO: `/v3/projects/6d6e897c6391486e9c44e9277a3ee823/users/95355adb5a6a4a69a31904247eac6d69/roles/ab658a45d85b49319c5add69c508b564` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:24.773880 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:24.777729 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b412b57-4cb3-4bed-9313-6ea0e944aa65 None admin] RBAC: Authorizing `identity:create_grant(project_id=6d6e897c6391486e9c44e9277a3ee823, user_id=95355adb5a6a4a69a31904247eac6d69, role_id=ab658a45d85b49319c5add69c508b564)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:24.779555 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b412b57-4cb3-4bed-9313-6ea0e944aa65 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:24.781562 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edde848-1d9e-4d7e-8812-3c2185257376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:24.782220 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edde848-1d9e-4d7e-8812-3c2185257376 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:24.782634 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edde848-1d9e-4d7e-8812-3c2185257376 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:24.782909 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edde848-1d9e-4d7e-8812-3c2185257376 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:24.796865 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edde848-1d9e-4d7e-8812-3c2185257376 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:45:24.797624 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 309/607] 10.222.0.49 () {58 vars in 1439 bytes} [Sun Aug 28 00:45:24 2022] PUT /identity/v3/projects/6d6e897c6391486e9c44e9277a3ee823/users/95355adb5a6a4a69a31904247eac6d69/roles/ab658a45d85b49319c5add69c508b564 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:45:24.798592 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b412b57-4cb3-4bed-9313-6ea0e944aa65 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:24.810545 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-0edde848-1d9e-4d7e-8812-3c2185257376 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:45:24.810545 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:24.810545 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:24.810545 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:24.810545 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:24.810545 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:24.810545 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:24.810545 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:24.810545 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:24.810545 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:24.810545 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:24.810545 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:24.810545 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:45:24.810545 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:45:24.810545 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:45:24.810545 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:45:24.811780 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:45:24.811780 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:45:24.811780 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:45:24.811780 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:45:24.811780 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:24.811780 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:24.811780 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:24.811780 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:24.811780 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:24.811780 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:24.811780 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:24.811780 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:24.811780 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:24.811780 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:24.811780 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:24.811780 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:24.812820 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:24.812820 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:24.812820 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:24.812820 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:24.812820 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:45:24.812820 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:45:24.812820 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:45:24.812820 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:45:24.812820 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:45:24.812820 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:45:24.812820 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:45:24.812820 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:24.812820 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 299/608] 10.222.0.49 () {56 vars in 1102 bytes} [Sun Aug 28 00:45:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:24.823708 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edde848-1d9e-4d7e-8812-3c2185257376 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:24.977300 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b412b57-4cb3-4bed-9313-6ea0e944aa65 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:25.005560 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edde848-1d9e-4d7e-8812-3c2185257376 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:25.017109 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76388d41-39ce-4ac1-ad8d-2f12c762926a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:25.017974 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76388d41-39ce-4ac1-ad8d-2f12c762926a None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:25.018395 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76388d41-39ce-4ac1-ad8d-2f12c762926a None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:25.018809 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76388d41-39ce-4ac1-ad8d-2f12c762926a None admin] PATH_INFO: `/v3/projects` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:25.019650 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76388d41-39ce-4ac1-ad8d-2f12c762926a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:25.020149 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76388d41-39ce-4ac1-ad8d-2f12c762926a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:25.021966 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76388d41-39ce-4ac1-ad8d-2f12c762926a None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:25.036451 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 310/609] 10.222.0.49 () {56 vars in 1148 bytes} [Sun Aug 28 00:45:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:25.039718 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8f36f-7a98-4bcb-a1c9-97a7a69f4636 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:25.039718 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8f36f-7a98-4bcb-a1c9-97a7a69f4636 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:25.039718 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8f36f-7a98-4bcb-a1c9-97a7a69f4636 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:25.044603 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 311/610] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:45:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:45:25.045461 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d8f36f-7a98-4bcb-a1c9-97a7a69f4636 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:25.053647 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d4e86e-a0e4-4e6a-a758-420ed5aa87e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:25.054265 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d4e86e-a0e4-4e6a-a758-420ed5aa87e1 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:25.054581 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d4e86e-a0e4-4e6a-a758-420ed5aa87e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:25.054850 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d4e86e-a0e4-4e6a-a758-420ed5aa87e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:25.055519 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d4e86e-a0e4-4e6a-a758-420ed5aa87e1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:25.055852 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d4e86e-a0e4-4e6a-a758-420ed5aa87e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:25.057215 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d4e86e-a0e4-4e6a-a758-420ed5aa87e1 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:25.066904 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 300/611] 10.222.0.49 () {56 vars in 1103 bytes} [Sun Aug 28 00:45:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:45:25.068185 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73474e-28ec-4b85-9b09-4cbb40ff54dc None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:25.068467 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73474e-28ec-4b85-9b09-4cbb40ff54dc None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:25.068735 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73474e-28ec-4b85-9b09-4cbb40ff54dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:25.087877 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-db73474e-28ec-4b85-9b09-4cbb40ff54dc None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:25.089093 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-db73474e-28ec-4b85-9b09-4cbb40ff54dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:25.097190 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:25.126768 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:25.180229 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d8f36f-7a98-4bcb-a1c9-97a7a69f4636 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:25.183696 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 301/612] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:45:25.183696 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db73474e-28ec-4b85-9b09-4cbb40ff54dc None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:25.261627 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f3550-ad3b-4957-9962-97ca994a91a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:25.262312 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f3550-ad3b-4957-9962-97ca994a91a8 None admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:25.262546 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f3550-ad3b-4957-9962-97ca994a91a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:25.262811 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f3550-ad3b-4957-9962-97ca994a91a8 None admin] PATH_INFO: `/v3/projects/6d6e897c6391486e9c44e9277a3ee823/users/2d14dcd0cb25427291ab8831924184e2/roles/ab658a45d85b49319c5add69c508b564` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:25.285685 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182f3550-ad3b-4957-9962-97ca994a91a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=6d6e897c6391486e9c44e9277a3ee823, user_id=2d14dcd0cb25427291ab8831924184e2, role_id=ab658a45d85b49319c5add69c508b564)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:25.287144 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182f3550-ad3b-4957-9962-97ca994a91a8 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:25.308322 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 312/613] 10.222.0.49 () {58 vars in 1439 bytes} [Sun Aug 28 00:45:25 2022] PUT /identity/v3/projects/6d6e897c6391486e9c44e9277a3ee823/users/2d14dcd0cb25427291ab8831924184e2/roles/ab658a45d85b49319c5add69c508b564 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:45:25.332670 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db73474e-28ec-4b85-9b09-4cbb40ff54dc None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:25.382180 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc0ebc-4250-4132-8768-cda31c2f8f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:25.383305 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc0ebc-4250-4132-8768-cda31c2f8f4f None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:25.383815 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc0ebc-4250-4132-8768-cda31c2f8f4f None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:25.384285 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc0ebc-4250-4132-8768-cda31c2f8f4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:25.402481 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffc0ebc-4250-4132-8768-cda31c2f8f4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:25.404361 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffc0ebc-4250-4132-8768-cda31c2f8f4f None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:25.406812 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:25.428688 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-1ffc0ebc-4250-4132-8768-cda31c2f8f4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:25.428688 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:25.428688 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:25.428688 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:25.428688 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:25.428688 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:25.428688 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:25.428688 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:25.428688 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:25.428688 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:25.428688 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:25.428688 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:25.428688 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:45:25.428688 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:45:25.428688 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:45:25.428688 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:45:25.429721 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:25.429721 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:25.429721 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:25.429721 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:25.429721 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:25.429721 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:25.429721 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:25.429721 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:25.429721 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:25.429721 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:25.429721 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:25.429721 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:25.429721 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:25.429721 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:25.429721 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:25.429721 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:25.429721 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:45:25.430626 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:45:25.430626 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:25.430626 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:25.430626 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 302/614] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:25.435908 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f3550-ad3b-4957-9962-97ca994a91a8 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:25.498437 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc0ebc-4250-4132-8768-cda31c2f8f4f None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:25.575221 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f3550-ad3b-4957-9962-97ca994a91a8 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:25.577449 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:25.615294 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3883b04-3237-4d3f-bec9-3792a7720386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:25.616096 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3883b04-3237-4d3f-bec9-3792a7720386 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:25.616466 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3883b04-3237-4d3f-bec9-3792a7720386 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:25.616829 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3883b04-3237-4d3f-bec9-3792a7720386 None admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:25.617578 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3883b04-3237-4d3f-bec9-3792a7720386 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:25.619735 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3883b04-3237-4d3f-bec9-3792a7720386 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:25.619735 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3883b04-3237-4d3f-bec9-3792a7720386 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:25.632212 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 313/615] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:45:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:25.645434 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3883b04-3237-4d3f-bec9-3792a7720386 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:25.649432 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc0ebc-4250-4132-8768-cda31c2f8f4f None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:25.704371 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32142b21-09c3-48e9-bc65-cc2c02aa81ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:25.705735 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32142b21-09c3-48e9-bc65-cc2c02aa81ae None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:25.706302 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32142b21-09c3-48e9-bc65-cc2c02aa81ae None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:25.706859 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32142b21-09c3-48e9-bc65-cc2c02aa81ae None admin] PATH_INFO: `/v3/roles/service` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:25.748757 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32142b21-09c3-48e9-bc65-cc2c02aa81ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:45:25.755777 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-32142b21-09c3-48e9-bc65-cc2c02aa81ae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:45:25.755777 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:25.755777 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:25.755777 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:25.755777 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:25.755777 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:25.755777 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:25.755777 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:25.755777 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:25.755777 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:25.755777 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:25.755777 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:25.755777 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:45:25.755777 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:45:25.755777 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:45:25.755777 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:45:25.756757 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:45:25.756757 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:45:25.756757 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:45:25.756757 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:45:25.756757 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:25.756757 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:25.756757 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:25.756757 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:25.756757 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:25.756757 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:25.756757 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:25.756757 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:25.756757 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:25.756757 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:25.756757 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:25.756757 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:25.757594 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:25.757594 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:25.757594 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:25.757594 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:25.757594 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:45:25.757594 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:45:25.757594 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:45:25.757594 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:45:25.757594 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:45:25.757594 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:45:25.757594 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:45:25.757594 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:25.759104 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3883b04-3237-4d3f-bec9-3792a7720386 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:25.767447 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 303/616] 10.222.0.49 () {56 vars in 1102 bytes} [Sun Aug 28 00:45:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:45:25.773260 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32142b21-09c3-48e9-bc65-cc2c02aa81ae None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:25.819233 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5369043a-b72f-4eb5-aa3f-d2043e991b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:25.819924 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369043a-b72f-4eb5-aa3f-d2043e991b03 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:25.820211 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369043a-b72f-4eb5-aa3f-d2043e991b03 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:25.820481 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5369043a-b72f-4eb5-aa3f-d2043e991b03 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:25.833144 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5369043a-b72f-4eb5-aa3f-d2043e991b03 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:25.834663 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5369043a-b72f-4eb5-aa3f-d2043e991b03 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:25.848112 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-5369043a-b72f-4eb5-aa3f-d2043e991b03 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 28 00:45:25.848112 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:25.848112 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:25.848112 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:25.848112 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:25.848112 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:25.848112 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:25.848112 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:25.848112 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:25.848112 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:25.848112 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:25.848112 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:25.848112 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:45:25.848112 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:45:25.848112 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:45:25.848112 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:45:25.849138 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:25.849138 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:25.849138 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:45:25.849138 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:45:25.849138 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:45:25.849138 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:45:25.849138 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:25.849138 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:25.849138 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:25.849138 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:25.849138 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:25.849138 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:25.849138 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:25.849138 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:25.849138 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:25.849138 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:25.849138 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:25.849138 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:25.850077 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:25.850077 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:25.850077 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:45:25.850077 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:45:25.850077 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:45:25.850077 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:45:25.850077 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:45:25.850077 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:45:25.850077 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 28 00:45:25.850077 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:25.850077 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 314/617] 10.222.0.49 () {56 vars in 1096 bytes} [Sun Aug 28 00:45:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:25.856303 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5369043a-b72f-4eb5-aa3f-d2043e991b03 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:25.880179 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:25.897567 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:25.973596 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32142b21-09c3-48e9-bc65-cc2c02aa81ae None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:26.018081 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5369043a-b72f-4eb5-aa3f-d2043e991b03 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:26.039025 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbe5c5e-7887-4204-88cd-849321eed7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:26.040082 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe5c5e-7887-4204-88cd-849321eed7f6 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:26.040574 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe5c5e-7887-4204-88cd-849321eed7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:26.041063 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbe5c5e-7887-4204-88cd-849321eed7f6 None admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:26.042063 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbe5c5e-7887-4204-88cd-849321eed7f6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:26.042574 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbe5c5e-7887-4204-88cd-849321eed7f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:26.044258 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbe5c5e-7887-4204-88cd-849321eed7f6 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:26.056682 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5539ff20-e69c-41b2-a6e1-d2507655132d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:26.057506 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5539ff20-e69c-41b2-a6e1-d2507655132d None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:26.057884 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5539ff20-e69c-41b2-a6e1-d2507655132d None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:26.062394 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5539ff20-e69c-41b2-a6e1-d2507655132d None admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:26.062394 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5539ff20-e69c-41b2-a6e1-d2507655132d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:26.062394 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5539ff20-e69c-41b2-a6e1-d2507655132d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:26.062394 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5539ff20-e69c-41b2-a6e1-d2507655132d None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:26.065492 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 304/618] 10.222.0.49 () {56 vars in 1103 bytes} [Sun Aug 28 00:45:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:45:26.071265 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbe5c5e-7887-4204-88cd-849321eed7f6 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:26.081921 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 315/619] 10.222.0.49 () {56 vars in 1135 bytes} [Sun Aug 28 00:45:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:26.088612 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5539ff20-e69c-41b2-a6e1-d2507655132d None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:26.244497 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5539ff20-e69c-41b2-a6e1-d2507655132d None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:26.248132 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:26.284652 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3df29c-181b-4975-9420-26a93c43f16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:26.286091 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3df29c-181b-4975-9420-26a93c43f16a None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:26.286620 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3df29c-181b-4975-9420-26a93c43f16a None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:26.287112 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3df29c-181b-4975-9420-26a93c43f16a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:26.298372 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3df29c-181b-4975-9420-26a93c43f16a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:26.300173 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3df29c-181b-4975-9420-26a93c43f16a None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:26.316300 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-aa3df29c-181b-4975-9420-26a93c43f16a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:26.316300 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:26.316300 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:26.316300 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:26.316300 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:26.316300 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:26.316300 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:26.316300 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:26.316300 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:26.316300 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:26.316300 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:26.316300 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:26.316300 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:45:26.316300 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:45:26.316300 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:45:26.316300 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:45:26.317357 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:26.317357 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:26.317357 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:26.317357 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:26.317357 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:26.317357 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:26.317357 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:26.317357 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:26.317357 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:26.317357 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:26.317357 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:26.317357 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:26.317357 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:26.317357 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:26.317357 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:26.317357 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:26.317357 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:45:26.318321 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:45:26.318321 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:26.318321 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:26.320842 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 316/620] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:26.326743 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3df29c-181b-4975-9420-26a93c43f16a None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:26.329942 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbe5c5e-7887-4204-88cd-849321eed7f6 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:26.352116 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:26.372773 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cd515d-04ac-4ed3-9cc4-afdc6b413e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:26.374150 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd515d-04ac-4ed3-9cc4-afdc6b413e98 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:26.374642 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd515d-04ac-4ed3-9cc4-afdc6b413e98 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:26.375334 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd515d-04ac-4ed3-9cc4-afdc6b413e98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:26.388474 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cd515d-04ac-4ed3-9cc4-afdc6b413e98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:26.390251 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cd515d-04ac-4ed3-9cc4-afdc6b413e98 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:26.405990 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-39cd515d-04ac-4ed3-9cc4-afdc6b413e98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:26.405990 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:26.405990 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:26.405990 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:26.405990 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:26.405990 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:26.405990 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:26.405990 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:26.405990 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:26.405990 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:26.405990 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:26.405990 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:26.405990 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:45:26.405990 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:45:26.405990 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:45:26.405990 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:45:26.406978 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:26.406978 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:26.406978 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:26.406978 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:26.406978 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:26.406978 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:26.406978 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:26.406978 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:26.406978 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:26.406978 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:26.406978 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:26.406978 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:26.406978 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:26.406978 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:26.406978 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:26.406978 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:26.406978 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:45:26.407935 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:45:26.407935 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:26.407935 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:26.410263 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 305/621] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:26.415498 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cd515d-04ac-4ed3-9cc4-afdc6b413e98 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:26.532735 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cd515d-04ac-4ed3-9cc4-afdc6b413e98 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:26.618352 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6ccfed-7f8d-4712-b4b7-22953f36a8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:26.620559 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ccfed-7f8d-4712-b4b7-22953f36a8a0 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:26.620849 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ccfed-7f8d-4712-b4b7-22953f36a8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:26.621151 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ccfed-7f8d-4712-b4b7-22953f36a8a0 None admin] PATH_INFO: `/v3/domains` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:26.621885 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6ccfed-7f8d-4712-b4b7-22953f36a8a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:26.622194 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6ccfed-7f8d-4712-b4b7-22953f36a8a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:26.623692 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6ccfed-7f8d-4712-b4b7-22953f36a8a0 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:26.638079 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3df29c-181b-4975-9420-26a93c43f16a None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:26.650297 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 306/622] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:45:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:26.655827 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6ccfed-7f8d-4712-b4b7-22953f36a8a0 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:26.675335 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:26.682163 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a29b5-e3b3-477c-882f-bfaa5f109ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:26.683231 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a29b5-e3b3-477c-882f-bfaa5f109ce1 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:26.683757 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a29b5-e3b3-477c-882f-bfaa5f109ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:26.684301 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884a29b5-e3b3-477c-882f-bfaa5f109ce1 None admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:26.685549 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884a29b5-e3b3-477c-882f-bfaa5f109ce1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:26.686090 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884a29b5-e3b3-477c-882f-bfaa5f109ce1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:26.687988 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884a29b5-e3b3-477c-882f-bfaa5f109ce1 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:26.703351 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 317/623] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:45:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:26.710055 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a29b5-e3b3-477c-882f-bfaa5f109ce1 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:26.749338 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:26.827296 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884a29b5-e3b3-477c-882f-bfaa5f109ce1 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:26.867283 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97f9415-516b-4664-9424-2183177da35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:26.868313 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f9415-516b-4664-9424-2183177da35f None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:26.868753 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f9415-516b-4664-9424-2183177da35f None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:26.869087 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f9415-516b-4664-9424-2183177da35f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:26.877377 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97f9415-516b-4664-9424-2183177da35f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:26.879486 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97f9415-516b-4664-9424-2183177da35f None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:26.893527 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-f97f9415-516b-4664-9424-2183177da35f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:45:26.893527 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:26.893527 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:26.893527 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:26.893527 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:26.893527 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:26.893527 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:26.893527 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:26.893527 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:26.893527 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:26.893527 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:26.893527 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:26.893527 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:45:26.893527 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:45:26.893527 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:45:26.894717 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:45:26.894717 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:26.894717 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:26.894717 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:26.894717 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:26.894717 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:26.894717 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:26.894717 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:26.894717 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:26.894717 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:26.894717 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:26.894717 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:26.894717 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:26.894717 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:26.894717 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:26.894717 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:26.894717 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:26.895860 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:45:26.895860 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:45:26.895860 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:45:26.895860 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:45:26.895860 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:45:26.895860 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:45:26.895860 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:45:26.895860 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:26.903691 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 318/624] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 28 00:45:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:45:26.903691 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97f9415-516b-4664-9424-2183177da35f None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:26.967349 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:26.988003 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6ccfed-7f8d-4712-b4b7-22953f36a8a0 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:27.021985 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97f9415-516b-4664-9424-2183177da35f None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:27.054037 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3018456f-0b6b-4209-a484-9b7e197921ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:27.054686 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018456f-0b6b-4209-a484-9b7e197921ff None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:27.055076 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018456f-0b6b-4209-a484-9b7e197921ff None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:27.055344 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018456f-0b6b-4209-a484-9b7e197921ff None admin] PATH_INFO: `/v3/users/nova` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:27.063819 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3018456f-0b6b-4209-a484-9b7e197921ff None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:27.064557 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54180b05-f01d-4ccf-90e1-66aa6cb9264b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:27.065257 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54180b05-f01d-4ccf-90e1-66aa6cb9264b None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:27.065365 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3018456f-0b6b-4209-a484-9b7e197921ff None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:27.065606 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54180b05-f01d-4ccf-90e1-66aa6cb9264b None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:27.066002 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54180b05-f01d-4ccf-90e1-66aa6cb9264b None admin] PATH_INFO: `/v3/projects` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:27.066784 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54180b05-f01d-4ccf-90e1-66aa6cb9264b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:27.067409 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54180b05-f01d-4ccf-90e1-66aa6cb9264b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:27.069569 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54180b05-f01d-4ccf-90e1-66aa6cb9264b None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:27.080995 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-3018456f-0b6b-4209-a484-9b7e197921ff None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 28 00:45:27.080995 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:27.080995 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:27.080995 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:27.080995 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:27.080995 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:27.080995 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:27.080995 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:27.080995 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:27.080995 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:27.080995 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:27.080995 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:27.080995 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:45:27.080995 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:45:27.080995 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:45:27.080995 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:45:27.082034 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:27.082034 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:27.082034 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:45:27.082034 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:45:27.082034 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:45:27.082034 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:45:27.082034 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:27.082034 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:27.082034 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:27.082034 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:27.082034 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:27.082034 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:27.082034 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:27.082034 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:27.082034 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:27.082034 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:27.082034 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:27.082034 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:27.082995 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:27.082995 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:27.082995 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:45:27.082995 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:45:27.082995 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:45:27.082995 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:45:27.082995 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:45:27.082995 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:45:27.082995 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 28 00:45:27.082995 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:27.082995 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 307/625] 10.222.0.49 () {56 vars in 1093 bytes} [Sun Aug 28 00:45:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 427 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:45:27.084119 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ed015-5dad-4848-b798-1066555cb09f None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:27.084299 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 319/626] 10.222.0.49 () {56 vars in 1148 bytes} [Sun Aug 28 00:45:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:27.084448 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ed015-5dad-4848-b798-1066555cb09f None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:27.084448 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ed015-5dad-4848-b798-1066555cb09f None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:27.090219 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54180b05-f01d-4ccf-90e1-66aa6cb9264b None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:27.090543 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 308/627] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:45:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:27.092045 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a412fce-5c88-49ed-b3fe-9a0f40ae1fc4 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:27.092329 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a412fce-5c88-49ed-b3fe-9a0f40ae1fc4 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:27.092633 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a412fce-5c88-49ed-b3fe-9a0f40ae1fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:27.114225 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-5a412fce-5c88-49ed-b3fe-9a0f40ae1fc4 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:27.115679 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-5a412fce-5c88-49ed-b3fe-9a0f40ae1fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:27.196731 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 309/628] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:45:27.197826 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a412fce-5c88-49ed-b3fe-9a0f40ae1fc4 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:27.221700 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:27.222673 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54180b05-f01d-4ccf-90e1-66aa6cb9264b None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:27.238526 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:27.262449 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd7723-232d-46a4-b5b7-954db25f6d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:27.263598 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd7723-232d-46a4-b5b7-954db25f6d12 None admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:27.264099 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd7723-232d-46a4-b5b7-954db25f6d12 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:27.264512 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd7723-232d-46a4-b5b7-954db25f6d12 None admin] PATH_INFO: `/v3/projects/6d6e897c6391486e9c44e9277a3ee823/users/4ce463b940db4f83a6df7e0561a88567/roles/ab658a45d85b49319c5add69c508b564` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:27.283503 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bd7723-232d-46a4-b5b7-954db25f6d12 None admin] RBAC: Authorizing `identity:create_grant(project_id=6d6e897c6391486e9c44e9277a3ee823, user_id=4ce463b940db4f83a6df7e0561a88567, role_id=ab658a45d85b49319c5add69c508b564)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:27.285442 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bd7723-232d-46a4-b5b7-954db25f6d12 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:27.307823 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 320/629] 10.222.0.49 () {58 vars in 1439 bytes} [Sun Aug 28 00:45:27 2022] PUT /identity/v3/projects/6d6e897c6391486e9c44e9277a3ee823/users/4ce463b940db4f83a6df7e0561a88567/roles/ab658a45d85b49319c5add69c508b564 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:45:27.309597 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6c44d-3e3a-487c-ab9a-056216aa360f None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:27.310021 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6c44d-3e3a-487c-ab9a-056216aa360f None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:27.310302 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6c44d-3e3a-487c-ab9a-056216aa360f None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:27.316048 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 321/630] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:45:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:27.319817 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc10575-4bb1-4e31-8bf6-094772976bba None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:27.321064 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc10575-4bb1-4e31-8bf6-094772976bba None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:27.322470 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc10575-4bb1-4e31-8bf6-094772976bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:27.335795 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a412fce-5c88-49ed-b3fe-9a0f40ae1fc4 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:27.360571 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-edc10575-4bb1-4e31-8bf6-094772976bba None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:27.364064 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-edc10575-4bb1-4e31-8bf6-094772976bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:27.415460 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833c139-eac8-4e19-8196-3d29f44a395b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:27.418011 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833c139-eac8-4e19-8196-3d29f44a395b None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:27.418838 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833c139-eac8-4e19-8196-3d29f44a395b None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:27.420379 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833c139-eac8-4e19-8196-3d29f44a395b None admin] PATH_INFO: `/v3/users` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:27.422978 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e833c139-eac8-4e19-8196-3d29f44a395b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:27.424064 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e833c139-eac8-4e19-8196-3d29f44a395b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:27.427853 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e833c139-eac8-4e19-8196-3d29f44a395b None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:27.471407 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 310/631] 10.222.0.49 () {56 vars in 1133 bytes} [Sun Aug 28 00:45:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:27.476998 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833c139-eac8-4e19-8196-3d29f44a395b None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:27.500720 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 322/632] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:45:27.520255 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc10575-4bb1-4e31-8bf6-094772976bba None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:27.576192 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:27.620049 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:27.629547 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc10575-4bb1-4e31-8bf6-094772976bba None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:27.640779 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833c139-eac8-4e19-8196-3d29f44a395b None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:27.666523 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901f9aed-29b2-4819-9eff-2bd386a8f2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:27.667238 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f9aed-29b2-4819-9eff-2bd386a8f2a8 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:27.667533 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f9aed-29b2-4819-9eff-2bd386a8f2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:27.667821 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f9aed-29b2-4819-9eff-2bd386a8f2a8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:27.686568 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2fdf99-3df0-4f92-a104-1f2f501c970b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:27.687510 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901f9aed-29b2-4819-9eff-2bd386a8f2a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:45:27.692613 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2fdf99-3df0-4f92-a104-1f2f501c970b None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:27.692896 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2fdf99-3df0-4f92-a104-1f2f501c970b None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:27.693220 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2fdf99-3df0-4f92-a104-1f2f501c970b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:27.696209 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-901f9aed-29b2-4819-9eff-2bd386a8f2a8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:45:27.696209 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:27.696209 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:27.696209 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:27.696209 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:27.696209 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:27.696209 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:27.696209 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:27.696209 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:27.696209 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:27.696209 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:27.696209 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:27.696209 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:45:27.696209 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:45:27.696209 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:45:27.696209 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:45:27.697136 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:45:27.697136 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:45:27.697136 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:45:27.697136 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:45:27.697136 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:27.697136 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:27.697136 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:27.697136 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:27.697136 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:27.697136 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:27.697136 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:27.697136 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:27.697136 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:27.697136 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:27.697136 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:27.697136 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:27.698017 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:27.698017 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:27.698017 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:27.698017 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:27.698017 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:45:27.698017 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:45:27.698017 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:45:27.698017 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:45:27.698017 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:45:27.698017 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:45:27.698017 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:45:27.698017 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:27.698017 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 323/633] 10.222.0.49 () {56 vars in 1102 bytes} [Sun Aug 28 00:45:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:45:27.704750 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901f9aed-29b2-4819-9eff-2bd386a8f2a8 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:27.812087 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2fdf99-3df0-4f92-a104-1f2f501c970b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:27.814825 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2fdf99-3df0-4f92-a104-1f2f501c970b None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:27.843484 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901f9aed-29b2-4819-9eff-2bd386a8f2a8 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:27.881691 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4537983-812b-4dda-bfa9-8016f6e9f384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:27.882304 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4537983-812b-4dda-bfa9-8016f6e9f384 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:27.882584 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4537983-812b-4dda-bfa9-8016f6e9f384 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:27.882862 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4537983-812b-4dda-bfa9-8016f6e9f384 None admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:27.884044 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4537983-812b-4dda-bfa9-8016f6e9f384 None admin] RBAC: Adding query filter params (name=service) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:27.884354 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4537983-812b-4dda-bfa9-8016f6e9f384 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:27.886583 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4537983-812b-4dda-bfa9-8016f6e9f384 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:27.904840 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 324/634] 10.222.0.49 () {56 vars in 1103 bytes} [Sun Aug 28 00:45:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:27.904840 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a928bd-8faf-44dc-b395-1740afdb0029 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:27.904840 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a928bd-8faf-44dc-b395-1740afdb0029 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:27.904840 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a928bd-8faf-44dc-b395-1740afdb0029 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:27.904840 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 325/635] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:45:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:27.904840 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a928bd-8faf-44dc-b395-1740afdb0029 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:27.911856 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:27.923404 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:27.946775 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 311/636] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 28 00:45:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:45:27.946775 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2fdf99-3df0-4f92-a104-1f2f501c970b None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:28.027812 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a928bd-8faf-44dc-b395-1740afdb0029 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:28.058279 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2fdf99-3df0-4f92-a104-1f2f501c970b None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:28.068322 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76dc992-f62a-4db7-9719-3ef7b390c8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:28.068904 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76dc992-f62a-4db7-9719-3ef7b390c8cc None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:28.069164 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76dc992-f62a-4db7-9719-3ef7b390c8cc None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:28.069750 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76dc992-f62a-4db7-9719-3ef7b390c8cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:28.092925 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76dc992-f62a-4db7-9719-3ef7b390c8cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:45:28.101032 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-e76dc992-f62a-4db7-9719-3ef7b390c8cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:45:28.101032 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:28.101032 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:28.101032 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:28.101032 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:28.101032 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:28.101032 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:28.101032 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:28.101032 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:28.101032 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:28.101032 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:28.101032 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:28.101032 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:45:28.101032 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:45:28.101032 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:45:28.101032 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:45:28.102367 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:45:28.102367 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:45:28.102367 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:45:28.102367 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:45:28.102367 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:28.102367 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:28.102367 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:28.102367 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:28.102367 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:28.102367 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:28.102367 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:28.102367 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:28.102367 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:28.102367 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:28.102367 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:28.102367 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:28.103257 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:28.103257 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:28.103257 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:28.103257 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:28.103257 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:45:28.103257 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:45:28.103257 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:45:28.103257 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:45:28.103257 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:45:28.103257 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:45:28.103257 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:45:28.103257 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:28.103257 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 326/637] 10.222.0.49 () {56 vars in 1102 bytes} [Sun Aug 28 00:45:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:28.106601 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26031af-a19a-4a2d-b139-1c69eb6a1cd0 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:28.107097 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26031af-a19a-4a2d-b139-1c69eb6a1cd0 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:28.107575 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26031af-a19a-4a2d-b139-1c69eb6a1cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:28.132650 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6d7436-8df8-419d-9dc9-421aba745d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:28.133310 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d7436-8df8-419d-9dc9-421aba745d64 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:28.133535 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-f26031af-a19a-4a2d-b139-1c69eb6a1cd0 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:28.133647 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d7436-8df8-419d-9dc9-421aba745d64 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:28.134079 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d7436-8df8-419d-9dc9-421aba745d64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:28.135810 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-f26031af-a19a-4a2d-b139-1c69eb6a1cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:28.149173 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6d7436-8df8-419d-9dc9-421aba745d64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:28.150664 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6d7436-8df8-419d-9dc9-421aba745d64 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:28.168565 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-0d6d7436-8df8-419d-9dc9-421aba745d64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:28.168565 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:28.168565 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:28.168565 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:28.168565 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:28.168565 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:28.168565 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:28.168565 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:28.168565 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:28.168565 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:28.168565 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:28.168565 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:28.168565 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:45:28.168565 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:45:28.168565 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:45:28.168565 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:45:28.169824 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:28.169824 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:28.169824 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:28.169824 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:28.169824 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:28.169824 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:28.169824 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:28.169824 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:28.169824 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:28.169824 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:28.169824 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:28.169824 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:28.169824 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:28.169824 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:28.169824 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:28.169824 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:28.169824 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:45:28.170704 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:45:28.170704 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:28.170704 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:28.170704 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 312/638] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:28.170704 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6d7436-8df8-419d-9dc9-421aba745d64 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:28.201908 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:28.220997 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 327/639] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:45:28.222121 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26031af-a19a-4a2d-b139-1c69eb6a1cd0 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:28.233140 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:28.304502 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6d7436-8df8-419d-9dc9-421aba745d64 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:28.346650 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26031af-a19a-4a2d-b139-1c69eb6a1cd0 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:28.351294 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6c715-55ea-40d0-8e37-4aa88ee09402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:28.352062 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6c715-55ea-40d0-8e37-4aa88ee09402 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:28.352410 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6c715-55ea-40d0-8e37-4aa88ee09402 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:28.352748 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f6c715-55ea-40d0-8e37-4aa88ee09402 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:28.366906 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f6c715-55ea-40d0-8e37-4aa88ee09402 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:28.368818 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f6c715-55ea-40d0-8e37-4aa88ee09402 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:28.388765 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcedd1a-fd50-475c-ba51-9a265d8ad8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:28.389476 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcedd1a-fd50-475c-ba51-9a265d8ad8cd None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:28.389818 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcedd1a-fd50-475c-ba51-9a265d8ad8cd None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:28.390156 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcedd1a-fd50-475c-ba51-9a265d8ad8cd None admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:28.390297 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-c5f6c715-55ea-40d0-8e37-4aa88ee09402 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:28.390297 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:28.390297 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:28.390297 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:28.390297 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:28.390297 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:28.390297 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:28.390297 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:28.390297 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:28.390297 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:28.390297 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:28.390297 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:28.390297 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:45:28.390297 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:45:28.390297 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:45:28.390297 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:45:28.391438 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:28.391438 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:28.391438 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:28.391438 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:28.391438 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:28.391438 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:28.391438 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:28.391438 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:28.391438 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:28.391438 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:28.391438 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:28.391438 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:28.391438 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:28.391438 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:28.391438 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:28.391438 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:28.391438 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:45:28.392607 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:45:28.392607 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:28.392607 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:28.392827 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcedd1a-fd50-475c-ba51-9a265d8ad8cd None admin] RBAC: Adding query filter params (name=service) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:28.392987 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcedd1a-fd50-475c-ba51-9a265d8ad8cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:28.394636 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcedd1a-fd50-475c-ba51-9a265d8ad8cd None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:28.394810 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 313/640] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:28.395803 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6c715-55ea-40d0-8e37-4aa88ee09402 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:28.409957 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 328/641] 10.222.0.49 () {56 vars in 1103 bytes} [Sun Aug 28 00:45:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:28.409957 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcedd1a-fd50-475c-ba51-9a265d8ad8cd None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:28.495514 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:28.505514 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:28.540792 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f6c715-55ea-40d0-8e37-4aa88ee09402 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:28.541058 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcedd1a-fd50-475c-ba51-9a265d8ad8cd None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:28.582458 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f128c64-c94f-4956-890e-7283f713dcf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:28.582695 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b4cde-1057-462b-8e31-e9ba4da67292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:28.582822 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b4cde-1057-462b-8e31-e9ba4da67292 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:28.582969 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f128c64-c94f-4956-890e-7283f713dcf0 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:28.583482 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b4cde-1057-462b-8e31-e9ba4da67292 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:28.583828 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b4cde-1057-462b-8e31-e9ba4da67292 None admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:28.584102 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f128c64-c94f-4956-890e-7283f713dcf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:28.584598 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f128c64-c94f-4956-890e-7283f713dcf0 None admin] PATH_INFO: `/v3/domains` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:28.584750 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300b4cde-1057-462b-8e31-e9ba4da67292 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:28.584925 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300b4cde-1057-462b-8e31-e9ba4da67292 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:28.585801 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f128c64-c94f-4956-890e-7283f713dcf0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:28.586359 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f128c64-c94f-4956-890e-7283f713dcf0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:28.586459 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300b4cde-1057-462b-8e31-e9ba4da67292 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:28.588774 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f128c64-c94f-4956-890e-7283f713dcf0 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:28.601138 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 329/642] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:45:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:28.602027 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b4cde-1057-462b-8e31-e9ba4da67292 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:28.608742 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 314/643] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:45:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:28.610432 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f128c64-c94f-4956-890e-7283f713dcf0 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:28.736333 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b4cde-1057-462b-8e31-e9ba4da67292 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:28.763184 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f128c64-c94f-4956-890e-7283f713dcf0 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:28.765298 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:28.777305 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a3872-3cc3-4114-9ee8-7643912f82f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:28.778208 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a3872-3cc3-4114-9ee8-7643912f82f2 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:28.779083 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a3872-3cc3-4114-9ee8-7643912f82f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:28.779771 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a3872-3cc3-4114-9ee8-7643912f82f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:28.793046 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745a3872-3cc3-4114-9ee8-7643912f82f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:28.794552 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745a3872-3cc3-4114-9ee8-7643912f82f2 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:28.813533 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-745a3872-3cc3-4114-9ee8-7643912f82f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:28.813533 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:28.813533 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:28.813533 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:28.813533 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:28.813533 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:28.813533 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:28.813533 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:28.813533 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:28.813533 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:28.813533 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:28.813533 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:28.813533 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:45:28.813533 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:45:28.813533 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:45:28.813533 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:45:28.814649 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:28.814649 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:28.814649 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:28.814649 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:28.814649 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:28.814649 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:28.814649 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:28.814649 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:28.814649 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:28.814649 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:28.814649 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:28.814649 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:28.814649 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:28.814649 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:28.814649 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:28.814649 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:28.814649 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:45:28.820742 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:45:28.820742 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:28.820742 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:28.820742 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 330/644] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:28.820993 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b3961-52ac-41e2-9586-0f6be3169e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:28.821423 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a3872-3cc3-4114-9ee8-7643912f82f2 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:28.821498 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b3961-52ac-41e2-9586-0f6be3169e0e None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:28.821498 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b3961-52ac-41e2-9586-0f6be3169e0e None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:28.821498 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03b3961-52ac-41e2-9586-0f6be3169e0e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:28.839715 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:28.841356 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03b3961-52ac-41e2-9586-0f6be3169e0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:45:28.848664 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-a03b3961-52ac-41e2-9586-0f6be3169e0e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:45:28.848664 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:28.848664 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:28.848664 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:28.848664 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:28.848664 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:28.848664 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:28.848664 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:28.848664 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:28.848664 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:28.848664 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:28.848664 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:28.848664 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:45:28.848664 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:45:28.848664 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:45:28.848664 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:45:28.849816 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:45:28.849816 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:45:28.849816 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:45:28.849816 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:45:28.849816 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:28.849816 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:28.849816 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:28.849816 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:28.849816 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:28.849816 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:28.849816 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:28.849816 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:28.849816 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:28.849816 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:28.849816 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:28.849816 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:28.850912 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:28.850912 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:28.850912 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:28.850912 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:28.850912 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:45:28.850912 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:45:28.850912 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:45:28.850912 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:45:28.850912 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:45:28.850912 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:45:28.850912 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:45:28.850912 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:28.854041 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 315/645] 10.222.0.49 () {56 vars in 1102 bytes} [Sun Aug 28 00:45:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:28.854041 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b3961-52ac-41e2-9586-0f6be3169e0e None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:28.938042 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a3872-3cc3-4114-9ee8-7643912f82f2 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:28.979492 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e61dc7b-c08c-4324-b271-c9040a2cdf88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:28.980584 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e61dc7b-c08c-4324-b271-c9040a2cdf88 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:28.981260 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e61dc7b-c08c-4324-b271-c9040a2cdf88 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:28.981537 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e61dc7b-c08c-4324-b271-c9040a2cdf88 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:28.989449 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03b3961-52ac-41e2-9586-0f6be3169e0e None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:28.990576 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e61dc7b-c08c-4324-b271-c9040a2cdf88 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:28.992720 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e61dc7b-c08c-4324-b271-c9040a2cdf88 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:29.007578 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-1e61dc7b-c08c-4324-b271-c9040a2cdf88 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 28 00:45:29.007578 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:29.007578 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:29.007578 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:29.007578 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:29.007578 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:29.007578 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:29.007578 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:29.007578 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:29.007578 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:29.007578 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:29.007578 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:29.007578 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:45:29.007578 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:45:29.007578 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:45:29.007578 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:45:29.008849 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:29.008849 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:29.008849 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:45:29.008849 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:45:29.008849 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:45:29.008849 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:45:29.008849 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:29.008849 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:29.008849 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:29.008849 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:29.008849 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:29.008849 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:29.008849 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:29.008849 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:29.008849 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:29.008849 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:29.008849 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:29.008849 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:29.010024 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:29.010024 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:29.010024 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:45:29.010024 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:45:29.010024 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:45:29.010024 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:45:29.010024 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:45:29.010024 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:45:29.010024 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 28 00:45:29.010024 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:29.011002 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 331/646] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 28 00:45:28 2022] GET /identity/v3/users/glance => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:29.011914 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e61dc7b-c08c-4324-b271-c9040a2cdf88 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:29.034452 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4138a0e0-6814-4ad9-9694-650aea4e2f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:29.035095 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138a0e0-6814-4ad9-9694-650aea4e2f91 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:29.035376 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138a0e0-6814-4ad9-9694-650aea4e2f91 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:29.035646 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4138a0e0-6814-4ad9-9694-650aea4e2f91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:29.043161 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4138a0e0-6814-4ad9-9694-650aea4e2f91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:29.044933 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4138a0e0-6814-4ad9-9694-650aea4e2f91 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:29.057279 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-4138a0e0-6814-4ad9-9694-650aea4e2f91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:45:29.057279 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:29.057279 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:29.057279 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:29.057279 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:29.057279 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:29.057279 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:29.057279 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:29.057279 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:29.057279 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:29.057279 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:29.057279 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:29.057279 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:45:29.057279 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:45:29.057279 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:45:29.058397 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:45:29.058397 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:29.058397 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:29.058397 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:29.058397 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:29.058397 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:29.058397 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:29.058397 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:29.058397 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:29.058397 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:29.058397 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:29.058397 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:29.058397 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:29.058397 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:29.058397 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:29.058397 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:29.058397 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:29.059322 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:45:29.059322 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:45:29.059322 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:45:29.059322 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:45:29.059322 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:45:29.059322 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:45:29.059322 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:45:29.059322 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:29.064072 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 316/647] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 28 00:45:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:29.064498 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4138a0e0-6814-4ad9-9694-650aea4e2f91 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:29.077110 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:29.128030 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:29.146900 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e61dc7b-c08c-4324-b271-c9040a2cdf88 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:29.170103 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4138a0e0-6814-4ad9-9694-650aea4e2f91 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:29.183654 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae947094-9b7e-4027-b4f3-6d9054ee835c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:29.184600 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae947094-9b7e-4027-b4f3-6d9054ee835c None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:29.185059 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae947094-9b7e-4027-b4f3-6d9054ee835c None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:29.185525 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae947094-9b7e-4027-b4f3-6d9054ee835c None admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:29.186356 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae947094-9b7e-4027-b4f3-6d9054ee835c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:29.186838 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae947094-9b7e-4027-b4f3-6d9054ee835c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:29.188439 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae947094-9b7e-4027-b4f3-6d9054ee835c None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:29.200797 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 332/648] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:45:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:29.201882 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae947094-9b7e-4027-b4f3-6d9054ee835c None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:29.208943 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87695c2-0ff9-4906-9e9c-780ec3de05ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:29.209569 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87695c2-0ff9-4906-9e9c-780ec3de05ec None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:29.209848 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87695c2-0ff9-4906-9e9c-780ec3de05ec None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:29.210082 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87695c2-0ff9-4906-9e9c-780ec3de05ec None admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:29.210792 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87695c2-0ff9-4906-9e9c-780ec3de05ec None admin] RBAC: Adding query filter params (name=service) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:29.211091 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87695c2-0ff9-4906-9e9c-780ec3de05ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:29.212462 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87695c2-0ff9-4906-9e9c-780ec3de05ec None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:29.221698 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 317/649] 10.222.0.49 () {56 vars in 1103 bytes} [Sun Aug 28 00:45:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:29.226741 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87695c2-0ff9-4906-9e9c-780ec3de05ec None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:29.304635 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:29.309886 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae947094-9b7e-4027-b4f3-6d9054ee835c None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:29.329796 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87695c2-0ff9-4906-9e9c-780ec3de05ec None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:29.353979 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a084af-9eb8-4192-9740-52eeb3f4cc3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:29.354574 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:29.355854 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a084af-9eb8-4192-9740-52eeb3f4cc3c None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:29.356207 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a084af-9eb8-4192-9740-52eeb3f4cc3c None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:29.356656 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a084af-9eb8-4192-9740-52eeb3f4cc3c None admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:29.357457 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a084af-9eb8-4192-9740-52eeb3f4cc3c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:29.357760 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a084af-9eb8-4192-9740-52eeb3f4cc3c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:29.359247 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a084af-9eb8-4192-9740-52eeb3f4cc3c None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:29.367521 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2bbc72-86a5-4c2c-bb05-e83e363809aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:29.368166 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bbc72-86a5-4c2c-bb05-e83e363809aa None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:29.368443 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bbc72-86a5-4c2c-bb05-e83e363809aa None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:29.368716 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bbc72-86a5-4c2c-bb05-e83e363809aa None admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:29.369450 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2bbc72-86a5-4c2c-bb05-e83e363809aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:29.369755 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2bbc72-86a5-4c2c-bb05-e83e363809aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:29.371231 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2bbc72-86a5-4c2c-bb05-e83e363809aa None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:29.379263 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 333/650] 10.222.0.49 () {56 vars in 1137 bytes} [Sun Aug 28 00:45:29 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:29.380097 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a084af-9eb8-4192-9740-52eeb3f4cc3c None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:29.386350 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 318/651] 10.222.0.49 () {56 vars in 1148 bytes} [Sun Aug 28 00:45:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:29.387500 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2bbc72-86a5-4c2c-bb05-e83e363809aa None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:29.480742 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a084af-9eb8-4192-9740-52eeb3f4cc3c None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:29.486860 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2bbc72-86a5-4c2c-bb05-e83e363809aa None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:29.514090 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ade8c-5fd7-4c2a-ba21-42e519ffb098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:29.514758 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ade8c-5fd7-4c2a-ba21-42e519ffb098 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:29.515043 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ade8c-5fd7-4c2a-ba21-42e519ffb098 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:29.515304 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ade8c-5fd7-4c2a-ba21-42e519ffb098 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:29.523227 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137ade8c-5fd7-4c2a-ba21-42e519ffb098 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:29.524779 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137ade8c-5fd7-4c2a-ba21-42e519ffb098 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:29.525043 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dad2c7-2033-4f94-b504-ff454cb748f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:29.525686 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dad2c7-2033-4f94-b504-ff454cb748f9 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:29.525964 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dad2c7-2033-4f94-b504-ff454cb748f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:29.526263 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dad2c7-2033-4f94-b504-ff454cb748f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:29.536456 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dad2c7-2033-4f94-b504-ff454cb748f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:29.536752 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-137ade8c-5fd7-4c2a-ba21-42e519ffb098 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 28 00:45:29.536752 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:29.536752 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:29.536752 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:29.536752 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:29.536752 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:29.536752 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:29.536752 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:29.536752 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:29.536752 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:29.536752 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:29.536752 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:29.536752 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:45:29.536752 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:45:29.536752 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:45:29.536752 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:45:29.538016 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:29.538016 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:29.538016 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:45:29.538016 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:45:29.538016 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:45:29.538016 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:45:29.538016 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:29.538016 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:29.538016 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:29.538016 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:29.538016 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:29.538016 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:29.538016 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:29.538016 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:29.538016 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:29.538016 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:29.538016 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:29.538016 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:29.539088 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:29.539088 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:29.539088 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:45:29.539088 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:45:29.539088 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:45:29.539088 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:45:29.539088 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:45:29.539088 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:45:29.539088 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 28 00:45:29.539088 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:29.539647 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dad2c7-2033-4f94-b504-ff454cb748f9 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:29.539777 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 334/652] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 28 00:45:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:29.539777 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ade8c-5fd7-4c2a-ba21-42e519ffb098 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:29.556368 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-c0dad2c7-2033-4f94-b504-ff454cb748f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:29.556368 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:29.556368 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:29.556368 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:29.556368 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:29.556368 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:29.556368 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:29.556368 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:29.556368 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:29.556368 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:29.556368 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:29.556368 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:29.556368 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:45:29.556368 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:45:29.556368 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:45:29.556368 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:45:29.557576 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:29.557576 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:29.557576 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:29.557576 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:29.557576 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:29.557576 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:29.557576 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:29.557576 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:29.557576 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:29.557576 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:29.557576 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:29.557576 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:29.557576 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:29.557576 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:29.557576 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:29.557576 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:29.557576 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:45:29.558689 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:45:29.558689 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:29.558689 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:29.558689 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 319/653] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:29.558689 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dad2c7-2033-4f94-b504-ff454cb748f9 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:29.560765 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:29.592832 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:29.642320 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ade8c-5fd7-4c2a-ba21-42e519ffb098 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:29.659319 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dad2c7-2033-4f94-b504-ff454cb748f9 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:29.676961 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805cddd1-cab8-4a5f-9bfb-97be63defe68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:29.677567 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805cddd1-cab8-4a5f-9bfb-97be63defe68 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:29.677841 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805cddd1-cab8-4a5f-9bfb-97be63defe68 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:29.678107 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805cddd1-cab8-4a5f-9bfb-97be63defe68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:29.692671 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b7f5b-1e22-4ca7-8a1e-edbfaf820d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:29.693272 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b7f5b-1e22-4ca7-8a1e-edbfaf820d7b None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:29.693536 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b7f5b-1e22-4ca7-8a1e-edbfaf820d7b None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:29.693797 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b7f5b-1e22-4ca7-8a1e-edbfaf820d7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:29.694506 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b7f5b-1e22-4ca7-8a1e-edbfaf820d7b None admin] RBAC: Adding query filter params (role.id=ab658a45d85b49319c5add69c508b564, scope.project.id=6d6e897c6391486e9c44e9277a3ee823, user.id=3dc0655c8156457a8fcb006c9fe85eb9) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:29.694807 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b7f5b-1e22-4ca7-8a1e-edbfaf820d7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:29.696261 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b7f5b-1e22-4ca7-8a1e-edbfaf820d7b None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:29.702067 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 320/654] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 28 00:45:29 2022] GET /identity/v3/role_assignments?user.id=3dc0655c8156457a8fcb006c9fe85eb9&scope.project.id=6d6e897c6391486e9c44e9277a3ee823&role.id=ab658a45d85b49319c5add69c508b564 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:29.702987 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783253b-5032-4e40-985e-2f52d92080a3 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:29.703265 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783253b-5032-4e40-985e-2f52d92080a3 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:29.703529 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783253b-5032-4e40-985e-2f52d92080a3 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:29.704755 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 321/655] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:45:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:29.705751 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b783253b-5032-4e40-985e-2f52d92080a3 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:29.770126 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805cddd1-cab8-4a5f-9bfb-97be63defe68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:29.771760 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805cddd1-cab8-4a5f-9bfb-97be63defe68 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:29.790622 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:29.822549 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:29.828069 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b783253b-5032-4e40-985e-2f52d92080a3 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:29.869321 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1439e98-54d1-4570-bc4b-9a76b14ada38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:29.870160 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1439e98-54d1-4570-bc4b-9a76b14ada38 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:29.870490 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1439e98-54d1-4570-bc4b-9a76b14ada38 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:29.870870 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1439e98-54d1-4570-bc4b-9a76b14ada38 None admin] PATH_INFO: `/v3/users` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:29.871617 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1439e98-54d1-4570-bc4b-9a76b14ada38 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:29.871949 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1439e98-54d1-4570-bc4b-9a76b14ada38 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:29.873382 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1439e98-54d1-4570-bc4b-9a76b14ada38 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:29.891315 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 335/656] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 28 00:45:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:45:29.892693 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805cddd1-cab8-4a5f-9bfb-97be63defe68 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:29.896246 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 322/657] 10.222.0.49 () {56 vars in 1137 bytes} [Sun Aug 28 00:45:29 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:29.897897 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac8abb-295f-4dc5-a13c-f2de78ce2931 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:29.898184 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac8abb-295f-4dc5-a13c-f2de78ce2931 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:29.898454 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac8abb-295f-4dc5-a13c-f2de78ce2931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:29.918926 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-7eac8abb-295f-4dc5-a13c-f2de78ce2931 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:29.920548 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-7eac8abb-295f-4dc5-a13c-f2de78ce2931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:29.999307 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 323/658] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:45:30.000191 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac8abb-295f-4dc5-a13c-f2de78ce2931 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:30.018730 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805cddd1-cab8-4a5f-9bfb-97be63defe68 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:30.041296 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:30.067245 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31660ea1-c8e6-4824-9c2f-c1c0a555383e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:30.068196 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31660ea1-c8e6-4824-9c2f-c1c0a555383e None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:30.068892 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31660ea1-c8e6-4824-9c2f-c1c0a555383e None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:30.069341 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31660ea1-c8e6-4824-9c2f-c1c0a555383e None admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:30.070724 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31660ea1-c8e6-4824-9c2f-c1c0a555383e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:30.071353 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31660ea1-c8e6-4824-9c2f-c1c0a555383e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:30.073480 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31660ea1-c8e6-4824-9c2f-c1c0a555383e None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:30.090094 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:30.092563 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 336/659] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:45:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:30.094134 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31660ea1-c8e6-4824-9c2f-c1c0a555383e None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:30.107369 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac8abb-295f-4dc5-a13c-f2de78ce2931 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:30.145802 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc6242-f177-44fe-9ee9-62537e251372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:30.146530 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc6242-f177-44fe-9ee9-62537e251372 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:30.146903 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc6242-f177-44fe-9ee9-62537e251372 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:30.147274 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc6242-f177-44fe-9ee9-62537e251372 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:30.158498 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc6242-f177-44fe-9ee9-62537e251372 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:30.160126 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc6242-f177-44fe-9ee9-62537e251372 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:30.176715 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-7bcc6242-f177-44fe-9ee9-62537e251372 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:30.176715 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:30.176715 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:30.176715 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:30.176715 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:30.176715 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:30.176715 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:30.176715 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:30.176715 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:30.176715 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:30.176715 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:30.176715 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:30.176715 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:45:30.176715 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:45:30.176715 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:45:30.176715 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:45:30.177897 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:30.177897 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:30.177897 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:30.177897 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:30.177897 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:30.177897 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:30.177897 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:30.177897 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:30.177897 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:30.177897 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:30.177897 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:30.177897 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:30.177897 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:30.177897 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:30.177897 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:30.177897 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:30.177897 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:45:30.178990 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:45:30.178990 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:30.178990 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:30.183719 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 324/660] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:30.183719 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc6242-f177-44fe-9ee9-62537e251372 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:30.231852 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31660ea1-c8e6-4824-9c2f-c1c0a555383e None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:30.270440 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447dcb35-6f4f-4f31-beca-e1111c8108fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:30.271053 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447dcb35-6f4f-4f31-beca-e1111c8108fd None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:30.271327 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447dcb35-6f4f-4f31-beca-e1111c8108fd None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:30.271599 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447dcb35-6f4f-4f31-beca-e1111c8108fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:30.299514 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc6242-f177-44fe-9ee9-62537e251372 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:30.321357 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:30.335224 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1332c2ee-2c52-4bd3-93fd-5c4bf3a5d0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:30.335884 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332c2ee-2c52-4bd3-93fd-5c4bf3a5d0bf None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:30.336162 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332c2ee-2c52-4bd3-93fd-5c4bf3a5d0bf None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:30.336434 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1332c2ee-2c52-4bd3-93fd-5c4bf3a5d0bf None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:30.344054 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1332c2ee-2c52-4bd3-93fd-5c4bf3a5d0bf None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:30.345482 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1332c2ee-2c52-4bd3-93fd-5c4bf3a5d0bf None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:30.347349 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:30.347638 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447dcb35-6f4f-4f31-beca-e1111c8108fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:30.349232 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447dcb35-6f4f-4f31-beca-e1111c8108fd None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:30.358565 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-1332c2ee-2c52-4bd3-93fd-5c4bf3a5d0bf None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 28 00:45:30.358565 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:30.358565 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:30.358565 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:30.358565 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:30.358565 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:30.358565 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:30.358565 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:30.358565 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:30.358565 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:30.358565 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:30.358565 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:30.358565 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:45:30.358565 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:45:30.358565 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:45:30.358565 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:45:30.359571 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:30.359571 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:30.359571 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:45:30.359571 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:45:30.359571 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:45:30.359571 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:45:30.359571 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:30.359571 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:30.359571 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:30.359571 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:30.359571 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:30.359571 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:30.359571 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:30.359571 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:30.359571 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:30.359571 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:30.359571 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:30.359571 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:30.360574 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:30.360574 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:30.360574 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:45:30.360574 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:45:30.360574 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:45:30.360574 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:45:30.360574 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:45:30.360574 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:45:30.360574 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 28 00:45:30.360574 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:30.360574 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 325/661] 10.222.0.49 () {56 vars in 1102 bytes} [Sun Aug 28 00:45:30 2022] GET /identity/v3/users/neutron => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:30.360574 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1332c2ee-2c52-4bd3-93fd-5c4bf3a5d0bf None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:30.464571 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 337/662] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 28 00:45:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:45:30.464571 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447dcb35-6f4f-4f31-beca-e1111c8108fd None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:30.469800 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1332c2ee-2c52-4bd3-93fd-5c4bf3a5d0bf None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:30.504331 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d568a23-63ec-40c2-b76c-83757aada883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:30.504945 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d568a23-63ec-40c2-b76c-83757aada883 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:30.505226 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d568a23-63ec-40c2-b76c-83757aada883 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:30.505506 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d568a23-63ec-40c2-b76c-83757aada883 None admin] PATH_INFO: `/v3/domains` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:30.506151 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d568a23-63ec-40c2-b76c-83757aada883 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:30.506460 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d568a23-63ec-40c2-b76c-83757aada883 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:30.507876 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d568a23-63ec-40c2-b76c-83757aada883 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:30.519575 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 326/663] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:45:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:30.520438 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d568a23-63ec-40c2-b76c-83757aada883 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:30.550032 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:30.575102 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447dcb35-6f4f-4f31-beca-e1111c8108fd None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:30.582523 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:30.614574 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba4243-c565-4865-83c5-821d7fb97763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:30.615202 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba4243-c565-4865-83c5-821d7fb97763 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:30.615473 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba4243-c565-4865-83c5-821d7fb97763 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:30.615747 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba4243-c565-4865-83c5-821d7fb97763 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:30.627480 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba4243-c565-4865-83c5-821d7fb97763 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:45:30.630107 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d568a23-63ec-40c2-b76c-83757aada883 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:30.632322 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-6dba4243-c565-4865-83c5-821d7fb97763 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:45:30.632322 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:30.632322 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:30.632322 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:30.632322 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:30.632322 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:30.632322 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:30.632322 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:30.632322 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:30.632322 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:30.632322 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:30.632322 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:30.632322 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:45:30.632322 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:45:30.632322 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:45:30.632322 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:45:30.633301 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:45:30.633301 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:45:30.633301 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:45:30.633301 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:45:30.633301 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:30.633301 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:30.633301 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:30.633301 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:30.633301 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:30.633301 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:30.633301 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:30.633301 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:30.633301 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:30.633301 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:30.633301 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:30.633301 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:30.634148 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:30.634148 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:30.634148 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:30.634148 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:30.634148 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:45:30.634148 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:45:30.634148 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:45:30.634148 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:45:30.634148 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:45:30.634148 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:45:30.634148 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:45:30.634148 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:30.634148 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 338/664] 10.222.0.49 () {56 vars in 1102 bytes} [Sun Aug 28 00:45:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:30.634858 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba4243-c565-4865-83c5-821d7fb97763 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:30.672847 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2d574a-90a6-4229-a54f-74519d9ffc71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:30.673437 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d574a-90a6-4229-a54f-74519d9ffc71 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:30.673725 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d574a-90a6-4229-a54f-74519d9ffc71 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:30.673988 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d574a-90a6-4229-a54f-74519d9ffc71 None admin] PATH_INFO: `/v3/users` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:30.674700 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2d574a-90a6-4229-a54f-74519d9ffc71 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:30.675005 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2d574a-90a6-4229-a54f-74519d9ffc71 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:30.676438 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2d574a-90a6-4229-a54f-74519d9ffc71 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:30.695280 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 327/665] 10.222.0.49 () {56 vars in 1139 bytes} [Sun Aug 28 00:45:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:30.696217 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2d574a-90a6-4229-a54f-74519d9ffc71 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:30.753400 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba4243-c565-4865-83c5-821d7fb97763 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:30.791260 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb7cde-1f79-4628-abfc-18b0a863278d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:30.792361 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb7cde-1f79-4628-abfc-18b0a863278d None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:30.793151 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb7cde-1f79-4628-abfc-18b0a863278d None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:30.793427 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb7cde-1f79-4628-abfc-18b0a863278d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:30.796848 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:30.806685 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fb7cde-1f79-4628-abfc-18b0a863278d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:30.808245 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fb7cde-1f79-4628-abfc-18b0a863278d None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:30.812132 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2d574a-90a6-4229-a54f-74519d9ffc71 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:30.823983 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-22fb7cde-1f79-4628-abfc-18b0a863278d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:30.823983 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:30.823983 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:30.823983 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:30.823983 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:30.823983 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:30.823983 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:30.823983 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:30.823983 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:30.823983 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:30.823983 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:30.823983 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:30.823983 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:45:30.823983 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:45:30.823983 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:45:30.823983 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:45:30.825040 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:30.825040 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:30.825040 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:30.825040 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:30.825040 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:30.825040 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:30.825040 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:30.825040 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:30.825040 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:30.825040 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:30.825040 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:30.825040 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:30.825040 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:30.825040 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:30.825040 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:30.825040 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:30.825040 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:45:30.825945 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:45:30.825945 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:30.825945 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:30.825945 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 339/666] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:30.825945 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb7cde-1f79-4628-abfc-18b0a863278d None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:30.837574 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:30.860571 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8246a2e-05c5-486c-b382-c517c8ae3d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:30.861225 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8246a2e-05c5-486c-b382-c517c8ae3d3b None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:30.861500 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8246a2e-05c5-486c-b382-c517c8ae3d3b None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:30.861793 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8246a2e-05c5-486c-b382-c517c8ae3d3b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:30.870098 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8246a2e-05c5-486c-b382-c517c8ae3d3b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:30.871548 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8246a2e-05c5-486c-b382-c517c8ae3d3b None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:30.884286 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-e8246a2e-05c5-486c-b382-c517c8ae3d3b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:45:30.884286 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:30.884286 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:30.884286 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:30.884286 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:30.884286 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:30.884286 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:30.884286 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:30.884286 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:30.884286 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:30.884286 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:30.884286 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:30.884286 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:45:30.884286 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:45:30.884286 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:45:30.885233 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:45:30.885233 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:30.885233 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:30.885233 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:30.885233 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:30.885233 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:30.885233 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:30.885233 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:30.885233 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:30.885233 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:30.885233 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:30.885233 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:30.885233 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:30.885233 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:30.885233 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:30.885233 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:30.885233 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:30.886290 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:45:30.886290 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:45:30.886290 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:45:30.886290 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:45:30.886290 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:45:30.886290 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:45:30.886290 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:45:30.886290 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:30.886290 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 328/667] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 28 00:45:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:30.886816 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8246a2e-05c5-486c-b382-c517c8ae3d3b None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:30.944318 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb7cde-1f79-4628-abfc-18b0a863278d None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:30.981711 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee55ab4-eedf-4f47-a1e0-6df72601615d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:30.982519 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee55ab4-eedf-4f47-a1e0-6df72601615d None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:30.982800 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee55ab4-eedf-4f47-a1e0-6df72601615d None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:30.983063 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee55ab4-eedf-4f47-a1e0-6df72601615d None admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:30.983926 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee55ab4-eedf-4f47-a1e0-6df72601615d None admin] RBAC: Adding query filter params (name=service) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:30.984558 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee55ab4-eedf-4f47-a1e0-6df72601615d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:30.985953 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee55ab4-eedf-4f47-a1e0-6df72601615d None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:30.992725 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8246a2e-05c5-486c-b382-c517c8ae3d3b None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:30.999566 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 340/668] 10.222.0.49 () {56 vars in 1103 bytes} [Sun Aug 28 00:45:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:30.999566 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee55ab4-eedf-4f47-a1e0-6df72601615d None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:31.036104 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca2425-60a0-42a8-9c24-9c1ab6b47cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:31.036717 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca2425-60a0-42a8-9c24-9c1ab6b47cf2 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:31.036998 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca2425-60a0-42a8-9c24-9c1ab6b47cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:31.037269 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca2425-60a0-42a8-9c24-9c1ab6b47cf2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:31.050169 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:31.091225 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:31.102890 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee55ab4-eedf-4f47-a1e0-6df72601615d None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:31.121050 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bca2425-60a0-42a8-9c24-9c1ab6b47cf2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:31.122553 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bca2425-60a0-42a8-9c24-9c1ab6b47cf2 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:31.145365 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac7242-aab1-4fd7-8651-55f8ddb25673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:31.145980 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac7242-aab1-4fd7-8651-55f8ddb25673 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:31.146260 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac7242-aab1-4fd7-8651-55f8ddb25673 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:31.146531 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac7242-aab1-4fd7-8651-55f8ddb25673 None admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:31.147178 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcac7242-aab1-4fd7-8651-55f8ddb25673 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:31.147491 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcac7242-aab1-4fd7-8651-55f8ddb25673 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:31.148926 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcac7242-aab1-4fd7-8651-55f8ddb25673 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:31.162081 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 341/669] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:45:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:31.162928 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac7242-aab1-4fd7-8651-55f8ddb25673 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:31.246458 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 329/670] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 28 00:45:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:45:31.247035 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca2425-60a0-42a8-9c24-9c1ab6b47cf2 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:31.296870 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac7242-aab1-4fd7-8651-55f8ddb25673 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:31.312542 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:31.336175 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:31.341480 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1c828-63b3-48c0-a081-dd97c99ad025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:31.342323 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1c828-63b3-48c0-a081-dd97c99ad025 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:31.342435 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1c828-63b3-48c0-a081-dd97c99ad025 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:31.342624 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1c828-63b3-48c0-a081-dd97c99ad025 None admin] PATH_INFO: `/v3/projects` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:31.343322 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b1c828-63b3-48c0-a081-dd97c99ad025 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:31.343624 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b1c828-63b3-48c0-a081-dd97c99ad025 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:31.345773 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b1c828-63b3-48c0-a081-dd97c99ad025 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:31.363653 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 342/671] 10.222.0.49 () {56 vars in 1148 bytes} [Sun Aug 28 00:45:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:31.363653 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1c828-63b3-48c0-a081-dd97c99ad025 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:31.372008 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca2425-60a0-42a8-9c24-9c1ab6b47cf2 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:31.411268 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb0f5e6-1e04-420f-b70e-5a4be2dea534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:31.411945 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb0f5e6-1e04-420f-b70e-5a4be2dea534 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:31.412224 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb0f5e6-1e04-420f-b70e-5a4be2dea534 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:31.412500 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb0f5e6-1e04-420f-b70e-5a4be2dea534 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:31.422990 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb0f5e6-1e04-420f-b70e-5a4be2dea534 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:31.424506 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb0f5e6-1e04-420f-b70e-5a4be2dea534 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:31.440810 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-1fb0f5e6-1e04-420f-b70e-5a4be2dea534 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:31.440810 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:31.440810 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:31.440810 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:31.440810 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:31.440810 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:31.440810 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:31.440810 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:31.440810 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:31.440810 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:31.440810 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:31.440810 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:31.440810 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:45:31.440810 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:45:31.440810 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:45:31.440810 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:45:31.441876 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:31.441876 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:31.441876 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:31.441876 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:31.441876 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:31.441876 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:31.441876 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:31.441876 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:31.441876 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:31.441876 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:31.441876 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:31.441876 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:31.441876 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:31.441876 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:31.441876 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:31.441876 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:31.441876 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:45:31.442768 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:45:31.442768 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:31.442768 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:31.446833 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 330/672] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:31.447748 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb0f5e6-1e04-420f-b70e-5a4be2dea534 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:31.469762 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1c828-63b3-48c0-a081-dd97c99ad025 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:31.515152 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e89a393-dfcd-4238-915c-cd2e2e0933ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:31.516740 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89a393-dfcd-4238-915c-cd2e2e0933ab None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:31.517002 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89a393-dfcd-4238-915c-cd2e2e0933ab None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:31.517569 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89a393-dfcd-4238-915c-cd2e2e0933ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:31.529849 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e89a393-dfcd-4238-915c-cd2e2e0933ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:31.532193 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e89a393-dfcd-4238-915c-cd2e2e0933ab None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:31.547053 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-8e89a393-dfcd-4238-915c-cd2e2e0933ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:45:31.547053 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:31.547053 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:31.547053 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:31.547053 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:31.547053 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:31.547053 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:31.547053 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:31.547053 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:31.547053 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:31.547053 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:31.547053 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:31.547053 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:45:31.547053 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:45:31.547053 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:45:31.548290 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:45:31.548290 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:31.548290 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:31.548290 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:31.548290 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:31.548290 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:31.548290 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:31.548290 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:31.548290 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:31.548290 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:31.548290 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:31.548290 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:31.548290 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:31.548290 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:31.548290 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:31.548290 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:31.548290 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:31.549593 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:45:31.549593 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:45:31.549593 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:45:31.549593 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:45:31.549593 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:45:31.549593 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:45:31.549593 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:45:31.549593 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:31.549593 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 343/673] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 28 00:45:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:31.549593 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e89a393-dfcd-4238-915c-cd2e2e0933ab None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:31.573506 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb0f5e6-1e04-420f-b70e-5a4be2dea534 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:31.585618 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:31.614447 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:31.624046 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21985f33-9737-4855-b7eb-aab1aff3877e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:31.624700 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21985f33-9737-4855-b7eb-aab1aff3877e None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:31.625089 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21985f33-9737-4855-b7eb-aab1aff3877e None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:31.625285 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21985f33-9737-4855-b7eb-aab1aff3877e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:31.637777 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21985f33-9737-4855-b7eb-aab1aff3877e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:31.639263 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21985f33-9737-4855-b7eb-aab1aff3877e None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:31.654923 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-21985f33-9737-4855-b7eb-aab1aff3877e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:31.654923 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:31.654923 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:31.654923 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:31.654923 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:31.654923 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:31.654923 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:31.654923 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:31.654923 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:31.654923 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:31.654923 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:31.654923 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:31.654923 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:45:31.654923 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:45:31.654923 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:45:31.654923 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:45:31.655989 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:31.655989 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:31.655989 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:31.655989 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:31.655989 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:31.655989 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:31.655989 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:31.655989 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:31.655989 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:31.655989 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:31.655989 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:31.655989 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:31.655989 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:31.655989 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:31.655989 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:31.655989 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:31.655989 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:45:31.656889 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:45:31.656889 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:31.656889 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:31.656889 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 331/674] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:31.656889 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21985f33-9737-4855-b7eb-aab1aff3877e None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:31.674391 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e89a393-dfcd-4238-915c-cd2e2e0933ab None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:31.712147 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e717ee3b-080e-4074-97eb-8a0f4370f1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:31.712762 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717ee3b-080e-4074-97eb-8a0f4370f1f5 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:31.713033 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717ee3b-080e-4074-97eb-8a0f4370f1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:31.713299 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e717ee3b-080e-4074-97eb-8a0f4370f1f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:31.714081 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e717ee3b-080e-4074-97eb-8a0f4370f1f5 None admin] RBAC: Adding query filter params (role.id=ab658a45d85b49319c5add69c508b564, scope.project.id=6d6e897c6391486e9c44e9277a3ee823, user.id=22053bd9632346aab63814f740415f69) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:31.714385 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e717ee3b-080e-4074-97eb-8a0f4370f1f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:31.715953 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e717ee3b-080e-4074-97eb-8a0f4370f1f5 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:31.722352 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 344/675] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 28 00:45:31 2022] GET /identity/v3/role_assignments?user.id=22053bd9632346aab63814f740415f69&scope.project.id=6d6e897c6391486e9c44e9277a3ee823&role.id=ab658a45d85b49319c5add69c508b564 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:31.723205 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e717ee3b-080e-4074-97eb-8a0f4370f1f5 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:31.788395 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21985f33-9737-4855-b7eb-aab1aff3877e None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:31.831137 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678a8c79-a9fe-4c08-9071-b58de0458c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:31.832378 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a8c79-a9fe-4c08-9071-b58de0458c48 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:31.832664 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a8c79-a9fe-4c08-9071-b58de0458c48 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:31.832939 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678a8c79-a9fe-4c08-9071-b58de0458c48 None admin] PATH_INFO: `/v3/domains` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:31.833611 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678a8c79-a9fe-4c08-9071-b58de0458c48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:31.834022 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678a8c79-a9fe-4c08-9071-b58de0458c48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:31.835447 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678a8c79-a9fe-4c08-9071-b58de0458c48 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:31.838991 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:31.849269 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e717ee3b-080e-4074-97eb-8a0f4370f1f5 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:31.854397 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 332/676] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:45:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:31.855404 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678a8c79-a9fe-4c08-9071-b58de0458c48 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:31.893023 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a18781-0bfc-43c6-8cd7-f5cee79d6e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:31.893652 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a18781-0bfc-43c6-8cd7-f5cee79d6e24 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:31.893926 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a18781-0bfc-43c6-8cd7-f5cee79d6e24 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:31.894189 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a18781-0bfc-43c6-8cd7-f5cee79d6e24 None admin] PATH_INFO: `/v3/projects` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:31.894872 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a18781-0bfc-43c6-8cd7-f5cee79d6e24 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:31.895170 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a18781-0bfc-43c6-8cd7-f5cee79d6e24 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:31.896643 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a18781-0bfc-43c6-8cd7-f5cee79d6e24 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:31.904455 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:31.909695 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 345/677] 10.222.0.49 () {56 vars in 1148 bytes} [Sun Aug 28 00:45:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:31.910774 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e94e61-466a-4d82-a41b-c9196299fb4e None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:31.911049 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e94e61-466a-4d82-a41b-c9196299fb4e None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:31.911312 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e94e61-466a-4d82-a41b-c9196299fb4e None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:31.917820 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 346/678] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:45:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:31.918432 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e94e61-466a-4d82-a41b-c9196299fb4e None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:31.974047 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678a8c79-a9fe-4c08-9071-b58de0458c48 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:32.009627 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a18cd-f044-48c0-ac80-9eb5bf00f821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:32.010249 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a18cd-f044-48c0-ac80-9eb5bf00f821 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:32.010567 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a18cd-f044-48c0-ac80-9eb5bf00f821 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:32.010842 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a18cd-f044-48c0-ac80-9eb5bf00f821 None admin] PATH_INFO: `/v3/domains` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:32.011499 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1a18cd-f044-48c0-ac80-9eb5bf00f821 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:32.011848 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1a18cd-f044-48c0-ac80-9eb5bf00f821 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:32.013235 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1a18cd-f044-48c0-ac80-9eb5bf00f821 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:32.026607 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 333/679] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:45:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:32.027310 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a18cd-f044-48c0-ac80-9eb5bf00f821 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:32.036949 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e94e61-466a-4d82-a41b-c9196299fb4e None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:32.072918 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d151a49-d477-4c8f-8707-8a075de4ab34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:32.073472 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d151a49-d477-4c8f-8707-8a075de4ab34 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:32.073745 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d151a49-d477-4c8f-8707-8a075de4ab34 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:32.074051 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d151a49-d477-4c8f-8707-8a075de4ab34 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:32.082521 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d151a49-d477-4c8f-8707-8a075de4ab34 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:32.084006 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d151a49-d477-4c8f-8707-8a075de4ab34 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:32.096436 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-8d151a49-d477-4c8f-8707-8a075de4ab34 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 28 00:45:32.096436 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:32.096436 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:32.096436 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:32.096436 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:32.096436 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:32.096436 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:32.096436 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:32.096436 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:32.096436 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:32.096436 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:32.096436 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:32.096436 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:45:32.096436 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:45:32.096436 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:45:32.096436 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:45:32.097458 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:32.097458 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:32.097458 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:45:32.097458 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:45:32.097458 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:45:32.097458 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:45:32.097458 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:32.097458 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:32.097458 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:32.097458 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:32.097458 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:32.097458 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:32.097458 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:32.097458 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:32.097458 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:32.097458 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:32.097458 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:32.097458 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:32.098386 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:32.098386 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:32.098386 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:45:32.098386 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:45:32.098386 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:45:32.098386 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:45:32.098386 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:45:32.098386 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:45:32.098386 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 28 00:45:32.098386 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:32.098386 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 347/680] 10.222.0.49 () {56 vars in 1096 bytes} [Sun Aug 28 00:45:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:32.099914 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4fd739-d2c5-496b-837e-c485a02a9fd0 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:32.099914 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4fd739-d2c5-496b-837e-c485a02a9fd0 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:32.099914 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4fd739-d2c5-496b-837e-c485a02a9fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:32.117283 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-6a4fd739-d2c5-496b-837e-c485a02a9fd0 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:32.118482 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-6a4fd739-d2c5-496b-837e-c485a02a9fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:32.129370 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:32.136466 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:32.139523 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a18cd-f044-48c0-ac80-9eb5bf00f821 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:32.174860 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d893431-5199-4c0d-8933-65738a504e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:32.175477 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d893431-5199-4c0d-8933-65738a504e25 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:32.175774 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d893431-5199-4c0d-8933-65738a504e25 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:32.176059 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d893431-5199-4c0d-8933-65738a504e25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:32.176806 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d893431-5199-4c0d-8933-65738a504e25 None admin] RBAC: Adding query filter params (role.id=ab658a45d85b49319c5add69c508b564, scope.project.id=6d6e897c6391486e9c44e9277a3ee823, user.id=95355adb5a6a4a69a31904247eac6d69) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:32.177096 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d893431-5199-4c0d-8933-65738a504e25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:32.178534 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d893431-5199-4c0d-8933-65738a504e25 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:32.185266 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 334/681] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 28 00:45:32 2022] GET /identity/v3/role_assignments?user.id=95355adb5a6a4a69a31904247eac6d69&scope.project.id=6d6e897c6391486e9c44e9277a3ee823&role.id=ab658a45d85b49319c5add69c508b564 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:32.185877 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d893431-5199-4c0d-8933-65738a504e25 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:32.217735 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 348/682] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:45:32.219220 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4fd739-d2c5-496b-837e-c485a02a9fd0 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:32.349325 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4fd739-d2c5-496b-837e-c485a02a9fd0 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:32.361866 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d893431-5199-4c0d-8933-65738a504e25 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:32.387653 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1136bbc-21fa-459b-a91c-68d1824dad37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:32.388638 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1136bbc-21fa-459b-a91c-68d1824dad37 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:32.389109 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1136bbc-21fa-459b-a91c-68d1824dad37 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:32.389593 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1136bbc-21fa-459b-a91c-68d1824dad37 None admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:32.391244 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1136bbc-21fa-459b-a91c-68d1824dad37 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:32.391863 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1136bbc-21fa-459b-a91c-68d1824dad37 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:32.393519 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1136bbc-21fa-459b-a91c-68d1824dad37 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:32.413055 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4962028b-058f-4550-a27a-08c630ea2dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:32.413693 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962028b-058f-4550-a27a-08c630ea2dc1 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:32.413966 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962028b-058f-4550-a27a-08c630ea2dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:32.414230 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962028b-058f-4550-a27a-08c630ea2dc1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:32.415268 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 349/683] 10.222.0.49 () {56 vars in 1135 bytes} [Sun Aug 28 00:45:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:32.424693 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1136bbc-21fa-459b-a91c-68d1824dad37 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:32.426318 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4962028b-058f-4550-a27a-08c630ea2dc1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:32.427904 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:32.428576 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4962028b-058f-4550-a27a-08c630ea2dc1 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:32.444698 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-4962028b-058f-4550-a27a-08c630ea2dc1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:45:32.444698 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:32.444698 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:32.444698 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:32.444698 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:32.444698 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:32.444698 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:32.444698 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:32.444698 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:32.444698 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:32.444698 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:32.444698 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:32.444698 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:45:32.444698 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:45:32.444698 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:45:32.445635 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:45:32.445635 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:32.445635 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:32.445635 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:32.445635 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:32.445635 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:32.445635 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:32.445635 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:32.445635 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:32.445635 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:32.445635 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:32.445635 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:32.445635 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:32.445635 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:32.445635 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:32.445635 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:32.445635 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:32.446770 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:45:32.446770 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:45:32.446770 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:45:32.446770 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:45:32.446770 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:45:32.446770 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:45:32.446770 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:45:32.446770 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:32.446770 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 335/684] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 28 00:45:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:32.456653 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4962028b-058f-4550-a27a-08c630ea2dc1 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:32.486734 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:32.561483 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1136bbc-21fa-459b-a91c-68d1824dad37 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:32.573450 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4962028b-058f-4550-a27a-08c630ea2dc1 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:32.609808 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d147053d-390c-4e06-856a-c19bcf570adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:32.610484 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d147053d-390c-4e06-856a-c19bcf570adc None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:32.611247 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d147053d-390c-4e06-856a-c19bcf570adc None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:32.611610 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d147053d-390c-4e06-856a-c19bcf570adc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:32.617039 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa209f56-f4df-4240-b5cb-e0b618775d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:32.617870 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa209f56-f4df-4240-b5cb-e0b618775d73 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:32.618313 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa209f56-f4df-4240-b5cb-e0b618775d73 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:32.618736 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa209f56-f4df-4240-b5cb-e0b618775d73 None admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:32.619566 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa209f56-f4df-4240-b5cb-e0b618775d73 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:32.620098 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa209f56-f4df-4240-b5cb-e0b618775d73 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:32.621725 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa209f56-f4df-4240-b5cb-e0b618775d73 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:32.646006 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 336/685] 10.222.0.49 () {56 vars in 1148 bytes} [Sun Aug 28 00:45:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:32.647188 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa209f56-f4df-4240-b5cb-e0b618775d73 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:32.702465 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d147053d-390c-4e06-856a-c19bcf570adc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:32.704749 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d147053d-390c-4e06-856a-c19bcf570adc None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:32.707839 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:32.740914 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:32.759869 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa209f56-f4df-4240-b5cb-e0b618775d73 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:32.797481 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990749c2-24d5-4d80-b508-dad14600601a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:32.798530 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990749c2-24d5-4d80-b508-dad14600601a None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:32.799028 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990749c2-24d5-4d80-b508-dad14600601a None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:32.799504 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990749c2-24d5-4d80-b508-dad14600601a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:32.811202 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990749c2-24d5-4d80-b508-dad14600601a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:45:32.816399 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-990749c2-24d5-4d80-b508-dad14600601a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:45:32.816399 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:32.816399 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:32.816399 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:32.816399 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:32.816399 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:32.816399 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:32.816399 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:32.816399 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:32.816399 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:32.816399 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:32.816399 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:32.816399 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:45:32.816399 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:45:32.816399 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:45:32.816399 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:45:32.817348 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:45:32.817348 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:45:32.817348 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:45:32.817348 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:45:32.817348 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:32.817348 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:32.817348 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:32.817348 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:32.817348 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:32.817348 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:32.817348 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:32.817348 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:32.817348 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:32.817348 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:32.817348 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:32.817348 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:32.818198 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:32.818198 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:32.818198 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:32.818198 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:32.818198 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:45:32.818198 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:45:32.818198 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:45:32.818198 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:45:32.818198 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:45:32.818198 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:45:32.818198 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:45:32.818198 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:32.820927 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 337/686] 10.222.0.49 () {56 vars in 1096 bytes} [Sun Aug 28 00:45:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:32.821939 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990749c2-24d5-4d80-b508-dad14600601a None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:32.841769 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 350/687] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 28 00:45:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:45:32.843081 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d147053d-390c-4e06-856a-c19bcf570adc None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:32.933809 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990749c2-24d5-4d80-b508-dad14600601a None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:32.950363 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d147053d-390c-4e06-856a-c19bcf570adc None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:32.952032 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:32.971035 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cea11d-36dc-4b8b-916c-292afc8593c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:32.971473 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cea11d-36dc-4b8b-916c-292afc8593c2 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:32.971846 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cea11d-36dc-4b8b-916c-292afc8593c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:32.972124 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cea11d-36dc-4b8b-916c-292afc8593c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:32.972862 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cea11d-36dc-4b8b-916c-292afc8593c2 None admin] RBAC: Adding query filter params (role.id=ab658a45d85b49319c5add69c508b564, scope.project.id=6d6e897c6391486e9c44e9277a3ee823, user.id=2d14dcd0cb25427291ab8831924184e2) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:32.973169 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cea11d-36dc-4b8b-916c-292afc8593c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:32.974599 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cea11d-36dc-4b8b-916c-292afc8593c2 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:32.981122 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 338/688] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 28 00:45:32 2022] GET /identity/v3/role_assignments?user.id=2d14dcd0cb25427291ab8831924184e2&scope.project.id=6d6e897c6391486e9c44e9277a3ee823&role.id=ab658a45d85b49319c5add69c508b564 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:32.982123 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cea11d-36dc-4b8b-916c-292afc8593c2 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:32.994654 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:33.002565 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0987d6e1-fd95-4995-a769-9a7a8f2a52bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:33.003218 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0987d6e1-fd95-4995-a769-9a7a8f2a52bc None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:33.003601 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0987d6e1-fd95-4995-a769-9a7a8f2a52bc None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:33.003803 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0987d6e1-fd95-4995-a769-9a7a8f2a52bc None admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:33.004581 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0987d6e1-fd95-4995-a769-9a7a8f2a52bc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:33.004873 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0987d6e1-fd95-4995-a769-9a7a8f2a52bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:33.006314 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0987d6e1-fd95-4995-a769-9a7a8f2a52bc None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:33.023442 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 351/689] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 28 00:45:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:33.033087 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0987d6e1-fd95-4995-a769-9a7a8f2a52bc None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:33.103541 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cea11d-36dc-4b8b-916c-292afc8593c2 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:33.165504 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e3d232-d521-4aee-adac-3198c3e7037b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:33.166455 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e3d232-d521-4aee-adac-3198c3e7037b None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:33.166985 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e3d232-d521-4aee-adac-3198c3e7037b None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:33.167432 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e3d232-d521-4aee-adac-3198c3e7037b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:33.184536 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e3d232-d521-4aee-adac-3198c3e7037b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:33.186038 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e3d232-d521-4aee-adac-3198c3e7037b None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:33.206103 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-d5e3d232-d521-4aee-adac-3198c3e7037b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:33.206103 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:33.206103 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:33.206103 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:33.206103 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:33.206103 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:33.206103 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:33.206103 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:33.206103 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:33.206103 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:33.206103 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:33.206103 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:33.206103 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:45:33.206103 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:45:33.206103 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:45:33.206103 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:45:33.207098 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:33.207098 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:33.207098 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:33.207098 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:33.207098 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:33.207098 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:33.207098 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:33.207098 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:33.207098 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:33.207098 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:33.207098 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:33.207098 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:33.207098 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:33.207098 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:33.207098 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:33.207098 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:33.207098 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:45:33.208424 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:45:33.208424 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:33.208424 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:33.211789 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 339/690] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:33.214726 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e3d232-d521-4aee-adac-3198c3e7037b None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:33.238542 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0987d6e1-fd95-4995-a769-9a7a8f2a52bc None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:33.284081 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d042e8-e5e6-432d-9e8c-281bd19ffc48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:33.284771 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d042e8-e5e6-432d-9e8c-281bd19ffc48 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:33.285053 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d042e8-e5e6-432d-9e8c-281bd19ffc48 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:33.285323 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d042e8-e5e6-432d-9e8c-281bd19ffc48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:33.290104 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:33.302031 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d042e8-e5e6-432d-9e8c-281bd19ffc48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:33.303819 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d042e8-e5e6-432d-9e8c-281bd19ffc48 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:33.323175 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-65d042e8-e5e6-432d-9e8c-281bd19ffc48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:33.323175 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:33.323175 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:33.323175 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:33.323175 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:33.323175 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:33.323175 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:33.323175 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:33.323175 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:33.323175 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:33.323175 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:33.323175 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:33.323175 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:45:33.323175 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:45:33.323175 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:45:33.323175 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:45:33.324463 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:33.324463 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:33.324463 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:33.324463 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:33.324463 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:33.324463 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:33.324463 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:33.324463 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:33.324463 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:33.324463 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:33.324463 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:33.324463 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:33.324463 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:33.324463 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:33.324463 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:33.324463 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:33.324463 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:45:33.325495 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:45:33.325495 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:33.325495 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:33.327739 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 352/691] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:33.332282 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d042e8-e5e6-432d-9e8c-281bd19ffc48 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:33.344187 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e3d232-d521-4aee-adac-3198c3e7037b None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:33.355648 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:33.389525 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643fadac-f2a6-47a2-84d9-bd6b97c6ebac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:33.389877 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643fadac-f2a6-47a2-84d9-bd6b97c6ebac None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:33.390136 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643fadac-f2a6-47a2-84d9-bd6b97c6ebac None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:33.390411 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643fadac-f2a6-47a2-84d9-bd6b97c6ebac None admin] PATH_INFO: `/v3/domains` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:33.391069 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643fadac-f2a6-47a2-84d9-bd6b97c6ebac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:33.391369 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643fadac-f2a6-47a2-84d9-bd6b97c6ebac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:33.393082 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643fadac-f2a6-47a2-84d9-bd6b97c6ebac None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:33.409487 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 340/692] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:45:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:33.415549 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643fadac-f2a6-47a2-84d9-bd6b97c6ebac None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:33.496002 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d042e8-e5e6-432d-9e8c-281bd19ffc48 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:33.569966 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c887d-8196-422b-86ba-488afb88b98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:33.570633 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c887d-8196-422b-86ba-488afb88b98e None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:33.570882 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c887d-8196-422b-86ba-488afb88b98e None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:33.571115 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c887d-8196-422b-86ba-488afb88b98e None admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:33.571799 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571c887d-8196-422b-86ba-488afb88b98e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:33.572103 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571c887d-8196-422b-86ba-488afb88b98e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:33.573531 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571c887d-8196-422b-86ba-488afb88b98e None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:33.602642 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643fadac-f2a6-47a2-84d9-bd6b97c6ebac None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:33.610813 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 353/693] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:45:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:33.621378 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c887d-8196-422b-86ba-488afb88b98e None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:33.652040 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:33.679774 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25edff0a-9f46-48e0-8bda-fde6ca6839cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:33.680470 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25edff0a-9f46-48e0-8bda-fde6ca6839cf None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:33.680751 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25edff0a-9f46-48e0-8bda-fde6ca6839cf None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:33.681018 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25edff0a-9f46-48e0-8bda-fde6ca6839cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:33.695702 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25edff0a-9f46-48e0-8bda-fde6ca6839cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:33.695702 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25edff0a-9f46-48e0-8bda-fde6ca6839cf None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:33.701865 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-25edff0a-9f46-48e0-8bda-fde6ca6839cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:45:33.701865 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:33.701865 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:33.701865 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:33.701865 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:33.701865 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:33.701865 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:33.701865 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:33.701865 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:33.701865 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:33.701865 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:33.701865 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:33.701865 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:45:33.701865 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:45:33.701865 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:45:33.702799 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:45:33.702799 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:33.702799 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:33.702799 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:33.702799 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:33.702799 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:33.702799 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:33.702799 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:33.702799 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:33.702799 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:33.702799 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:33.702799 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:33.702799 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:33.702799 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:33.702799 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:33.702799 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:33.702799 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:33.703713 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:45:33.703713 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:45:33.703713 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:45:33.703713 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:45:33.703713 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:45:33.703713 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:45:33.703713 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:45:33.703713 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:33.715692 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 341/694] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 28 00:45:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:33.715692 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25edff0a-9f46-48e0-8bda-fde6ca6839cf None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:33.776253 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:33.814055 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25edff0a-9f46-48e0-8bda-fde6ca6839cf None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:33.819166 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c887d-8196-422b-86ba-488afb88b98e None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:33.849402 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a4beb-7407-4325-b650-b641bbfbea7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:33.850385 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a4beb-7407-4325-b650-b641bbfbea7f None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:33.850860 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a4beb-7407-4325-b650-b641bbfbea7f None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:33.851341 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a4beb-7407-4325-b650-b641bbfbea7f None admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:33.852293 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82a4beb-7407-4325-b650-b641bbfbea7f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:33.852849 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82a4beb-7407-4325-b650-b641bbfbea7f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:33.854538 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82a4beb-7407-4325-b650-b641bbfbea7f None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:33.871777 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 342/695] 10.222.0.49 () {56 vars in 1148 bytes} [Sun Aug 28 00:45:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:33.874557 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a4beb-7407-4325-b650-b641bbfbea7f None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:33.878446 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a38d9-2432-485c-8163-e4914fee11ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:33.878446 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a38d9-2432-485c-8163-e4914fee11ca None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:33.878697 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a38d9-2432-485c-8163-e4914fee11ca None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:33.878856 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a38d9-2432-485c-8163-e4914fee11ca None admin] PATH_INFO: `/v3/users/nova` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:33.891564 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479a38d9-2432-485c-8163-e4914fee11ca None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:33.893577 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479a38d9-2432-485c-8163-e4914fee11ca None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:33.906778 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-479a38d9-2432-485c-8163-e4914fee11ca None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 28 00:45:33.906778 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:33.906778 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:33.906778 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:33.906778 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:33.906778 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:33.906778 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:33.906778 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:33.906778 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:33.906778 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:33.906778 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:33.906778 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:33.906778 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:45:33.906778 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:45:33.906778 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:45:33.906778 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:45:33.907834 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:33.907834 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:33.907834 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:45:33.907834 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:45:33.907834 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:45:33.907834 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:45:33.907834 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:33.907834 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:33.907834 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:33.907834 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:33.907834 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:33.907834 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:33.907834 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:33.907834 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:33.907834 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:33.907834 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:33.907834 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:33.907834 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:33.908823 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:33.908823 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:33.908823 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:45:33.908823 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:45:33.908823 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:45:33.908823 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:45:33.908823 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:45:33.908823 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:45:33.908823 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 28 00:45:33.908823 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:33.911539 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 354/696] 10.222.0.49 () {56 vars in 1093 bytes} [Sun Aug 28 00:45:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:33.913077 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed26eb33-8218-4d2d-968f-af5b3bf739d6 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:33.913630 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed26eb33-8218-4d2d-968f-af5b3bf739d6 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:33.914100 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed26eb33-8218-4d2d-968f-af5b3bf739d6 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:33.919906 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 355/697] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:45:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:33.921536 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7745c5fc-755b-48eb-a0fb-5b6393d8048c None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:33.922048 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7745c5fc-755b-48eb-a0fb-5b6393d8048c None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:33.922574 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7745c5fc-755b-48eb-a0fb-5b6393d8048c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:33.924432 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:33.944219 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-7745c5fc-755b-48eb-a0fb-5b6393d8048c None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:33.945977 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-7745c5fc-755b-48eb-a0fb-5b6393d8048c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:33.983985 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a4beb-7407-4325-b650-b641bbfbea7f None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:34.020293 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a178830-76ff-4a33-88bb-d89901ea8886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:34.020897 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a178830-76ff-4a33-88bb-d89901ea8886 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:34.021175 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a178830-76ff-4a33-88bb-d89901ea8886 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:34.021486 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a178830-76ff-4a33-88bb-d89901ea8886 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:34.022214 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a178830-76ff-4a33-88bb-d89901ea8886 None admin] RBAC: Adding query filter params (role.id=ab658a45d85b49319c5add69c508b564, scope.project.id=6d6e897c6391486e9c44e9277a3ee823, user.id=4ce463b940db4f83a6df7e0561a88567) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:34.022518 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a178830-76ff-4a33-88bb-d89901ea8886 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:34.023975 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a178830-76ff-4a33-88bb-d89901ea8886 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:34.035277 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 343/698] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 28 00:45:33 2022] GET /identity/v3/role_assignments?user.id=4ce463b940db4f83a6df7e0561a88567&scope.project.id=6d6e897c6391486e9c44e9277a3ee823&role.id=ab658a45d85b49319c5add69c508b564 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:34.035277 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a178830-76ff-4a33-88bb-d89901ea8886 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:34.038371 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 356/699] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:45:34.178685 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a178830-76ff-4a33-88bb-d89901ea8886 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:34.181218 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:34.232510 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cc28f4-3230-4229-8d07-513044350746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:34.233142 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc28f4-3230-4229-8d07-513044350746 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:34.233418 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc28f4-3230-4229-8d07-513044350746 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:34.233689 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc28f4-3230-4229-8d07-513044350746 None admin] PATH_INFO: `/v3/users` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:34.234438 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cc28f4-3230-4229-8d07-513044350746 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:34.234742 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cc28f4-3230-4229-8d07-513044350746 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:34.236298 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cc28f4-3230-4229-8d07-513044350746 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:34.263321 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 344/700] 10.222.0.49 () {56 vars in 1133 bytes} [Sun Aug 28 00:45:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:34.268771 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7745c5fc-755b-48eb-a0fb-5b6393d8048c None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:34.339178 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:34.376717 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7745c5fc-755b-48eb-a0fb-5b6393d8048c None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:34.391218 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cc28f4-3230-4229-8d07-513044350746 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:34.437511 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e99ade-8614-412d-a7ce-2ccc10d80f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:34.438747 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e99ade-8614-412d-a7ce-2ccc10d80f67 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:34.439650 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e99ade-8614-412d-a7ce-2ccc10d80f67 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:34.440502 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e99ade-8614-412d-a7ce-2ccc10d80f67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:34.530040 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cc28f4-3230-4229-8d07-513044350746 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:34.542287 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e99ade-8614-412d-a7ce-2ccc10d80f67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:34.544886 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e99ade-8614-412d-a7ce-2ccc10d80f67 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:34.586339 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a31e7-5b2d-4fb6-821d-3dcdb513a8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:34.587236 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a31e7-5b2d-4fb6-821d-3dcdb513a8e5 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:34.587517 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a31e7-5b2d-4fb6-821d-3dcdb513a8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:34.587967 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a31e7-5b2d-4fb6-821d-3dcdb513a8e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:34.601277 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a31e7-5b2d-4fb6-821d-3dcdb513a8e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:34.603034 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a31e7-5b2d-4fb6-821d-3dcdb513a8e5 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:34.623784 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-584a31e7-5b2d-4fb6-821d-3dcdb513a8e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:34.623784 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:34.623784 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:34.623784 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:34.623784 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:34.623784 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:34.623784 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:34.623784 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:34.623784 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:34.623784 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:34.623784 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:34.623784 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:34.623784 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:45:34.623784 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:45:34.623784 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:45:34.623784 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:45:34.625249 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:34.625249 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:34.625249 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:34.625249 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:34.625249 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:34.625249 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:34.625249 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:34.625249 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:34.625249 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:34.625249 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:34.625249 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:34.625249 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:34.625249 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:34.625249 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:34.625249 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:34.625249 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:34.625249 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:45:34.626254 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:45:34.626254 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:34.626254 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:34.630053 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 345/701] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:45:34.631507 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:34.632471 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a31e7-5b2d-4fb6-821d-3dcdb513a8e5 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:34.650684 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:34.683919 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 357/702] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 28 00:45:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 28 00:45:34.685682 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ad82b-ecac-4b65-afcf-8100e7e0d0c7 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:34.686120 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ad82b-ecac-4b65-afcf-8100e7e0d0c7 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:34.686513 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ad82b-ecac-4b65-afcf-8100e7e0d0c7 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:34.688427 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 358/703] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:45:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:34.692852 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ad82b-ecac-4b65-afcf-8100e7e0d0c7 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:34.757395 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a31e7-5b2d-4fb6-821d-3dcdb513a8e5 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:34.794982 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978cb4f4-820a-4859-8408-90dc87061714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:34.796138 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978cb4f4-820a-4859-8408-90dc87061714 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:34.796612 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978cb4f4-820a-4859-8408-90dc87061714 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:34.797073 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978cb4f4-820a-4859-8408-90dc87061714 None admin] PATH_INFO: `/v3/domains` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:34.797988 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978cb4f4-820a-4859-8408-90dc87061714 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:34.798570 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978cb4f4-820a-4859-8408-90dc87061714 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:34.800280 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978cb4f4-820a-4859-8408-90dc87061714 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:34.814484 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 346/704] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:45:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:45:34.816196 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd0fa9-afe7-4cfc-9cd4-141ccea1aebb None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:34.816691 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd0fa9-afe7-4cfc-9cd4-141ccea1aebb None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:34.817171 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd0fa9-afe7-4cfc-9cd4-141ccea1aebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:34.822127 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ad82b-ecac-4b65-afcf-8100e7e0d0c7 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:34.841498 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-e6dd0fa9-afe7-4cfc-9cd4-141ccea1aebb None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:34.843583 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-e6dd0fa9-afe7-4cfc-9cd4-141ccea1aebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:34.863593 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b240f4f2-e3f3-495d-aac6-814c98235a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:34.864346 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240f4f2-e3f3-495d-aac6-814c98235a11 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:34.864555 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240f4f2-e3f3-495d-aac6-814c98235a11 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:34.864881 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240f4f2-e3f3-495d-aac6-814c98235a11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:34.877417 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b240f4f2-e3f3-495d-aac6-814c98235a11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:34.880042 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b240f4f2-e3f3-495d-aac6-814c98235a11 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:34.897246 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-b240f4f2-e3f3-495d-aac6-814c98235a11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:34.897246 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:34.897246 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:34.897246 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:34.897246 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:34.897246 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:34.897246 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:34.897246 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:34.897246 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:34.897246 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:34.897246 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:34.897246 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:34.897246 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:45:34.897246 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:45:34.897246 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:45:34.897246 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:45:34.898288 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:34.898288 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:34.898288 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:34.898288 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:34.898288 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:34.898288 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:34.898288 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:34.898288 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:34.898288 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:34.898288 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:34.898288 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:34.898288 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:34.898288 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:34.898288 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:34.898288 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:34.898288 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:34.898288 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:45:34.899185 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:45:34.899185 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:34.899185 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:34.903204 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 359/705] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:34.904206 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b240f4f2-e3f3-495d-aac6-814c98235a11 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:34.926220 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:34.939745 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 347/706] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:45:34.940710 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd0fa9-afe7-4cfc-9cd4-141ccea1aebb None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:34.948311 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:35.032785 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b240f4f2-e3f3-495d-aac6-814c98235a11 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:35.071091 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3211f-e128-41e7-8b42-c3440bfd4b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:35.072695 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3211f-e128-41e7-8b42-c3440bfd4b85 None admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:35.073217 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3211f-e128-41e7-8b42-c3440bfd4b85 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:35.073698 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3211f-e128-41e7-8b42-c3440bfd4b85 None admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:35.074611 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f3211f-e128-41e7-8b42-c3440bfd4b85 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:35.076340 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f3211f-e128-41e7-8b42-c3440bfd4b85 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:35.103316 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 360/707] 10.222.0.49 () {60 vars in 1132 bytes} [Sun Aug 28 00:45:34 2022] POST /identity/v3/users => generated 254 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:45:35.162460 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd0fa9-afe7-4cfc-9cd4-141ccea1aebb None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:35.206592 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586c9db2-9fb9-4086-8571-0a17a3703321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:35.207593 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c9db2-9fb9-4086-8571-0a17a3703321 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:35.208107 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c9db2-9fb9-4086-8571-0a17a3703321 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:35.208602 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c9db2-9fb9-4086-8571-0a17a3703321 None admin] PATH_INFO: `/v3/domains` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:35.209516 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586c9db2-9fb9-4086-8571-0a17a3703321 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:35.210004 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586c9db2-9fb9-4086-8571-0a17a3703321 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:35.211563 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586c9db2-9fb9-4086-8571-0a17a3703321 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:35.225600 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 348/708] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:45:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:35.231136 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3211f-e128-41e7-8b42-c3440bfd4b85 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:35.274549 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586c9db2-9fb9-4086-8571-0a17a3703321 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:35.370782 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:35.373323 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:35.402306 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3211f-e128-41e7-8b42-c3440bfd4b85 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:35.421707 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586c9db2-9fb9-4086-8571-0a17a3703321 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:35.445543 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de647c0-624a-4076-9c2e-3ec1565ccb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:35.446710 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de647c0-624a-4076-9c2e-3ec1565ccb83 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:35.446999 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de647c0-624a-4076-9c2e-3ec1565ccb83 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:35.447280 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de647c0-624a-4076-9c2e-3ec1565ccb83 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:35.457346 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de647c0-624a-4076-9c2e-3ec1565ccb83 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:35.459099 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de647c0-624a-4076-9c2e-3ec1565ccb83 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:35.462801 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260ea6d2-e9b6-4c71-9703-a6cfd75f3802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:35.463833 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ea6d2-e9b6-4c71-9703-a6cfd75f3802 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:35.464376 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ea6d2-e9b6-4c71-9703-a6cfd75f3802 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:35.464835 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ea6d2-e9b6-4c71-9703-a6cfd75f3802 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:35.465656 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260ea6d2-e9b6-4c71-9703-a6cfd75f3802 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:35.467207 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260ea6d2-e9b6-4c71-9703-a6cfd75f3802 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:35.472411 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-3de647c0-624a-4076-9c2e-3ec1565ccb83 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:45:35.472411 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:35.472411 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:35.472411 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:35.472411 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:35.472411 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:35.472411 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:35.472411 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:35.472411 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:35.472411 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:35.472411 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:35.472411 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:35.472411 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:45:35.472411 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:45:35.472411 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:45:35.473373 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:45:35.473373 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:35.473373 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:35.473373 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:35.473373 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:35.473373 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:35.473373 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:35.473373 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:35.473373 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:35.473373 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:35.473373 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:35.473373 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:35.473373 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:35.473373 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:35.473373 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:35.473373 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:35.473373 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:35.474298 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:45:35.474298 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:45:35.474298 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:45:35.474298 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:45:35.474298 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:45:35.474298 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:45:35.474298 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:45:35.474298 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:35.474298 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 361/709] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 28 00:45:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:35.479604 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de647c0-624a-4076-9c2e-3ec1565ccb83 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:35.483230 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-260ea6d2-e9b6-4c71-9703-a6cfd75f3802 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 28 00:45:35.483230 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:35.483230 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:45:35.483230 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:45:35.483230 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:45:35.483230 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:45:35.483230 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:45:35.483230 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:45:35.483230 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 28 00:45:35.483230 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:35.483230 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:45:35.483230 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:35.483230 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:35.483230 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:35.483230 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:35.483230 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:35.483230 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:35.484315 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:35.484315 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:35.484315 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:35.484315 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:35.484315 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:35.484315 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:35.484315 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:45:35.484315 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:45:35.484315 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:45:35.484315 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:45:35.484315 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:35.484315 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:35.484315 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:35.484315 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:35.484315 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:35.484315 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:35.485196 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:35.485196 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:35.485196 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:35.485196 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:35.485196 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:35.485196 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:35.485196 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:35.485196 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:35.485196 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:35.485196 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:35.485196 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:45:35.485196 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:45:35.485196 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 28 00:45:35.485196 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:35.486649 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 349/710] 10.222.0.49 () {56 vars in 1129 bytes} [Sun Aug 28 00:45:35 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:45:35.493923 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260ea6d2-e9b6-4c71-9703-a6cfd75f3802 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:35.622906 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260ea6d2-e9b6-4c71-9703-a6cfd75f3802 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:35.625273 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de647c0-624a-4076-9c2e-3ec1565ccb83 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:35.651848 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:35.662437 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e7f9a-3b43-454a-9279-4d5980193db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:35.663816 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e7f9a-3b43-454a-9279-4d5980193db2 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:35.664421 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e7f9a-3b43-454a-9279-4d5980193db2 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:35.665008 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e7f9a-3b43-454a-9279-4d5980193db2 None admin] PATH_INFO: `/v3/services` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:35.665910 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474e7f9a-3b43-454a-9279-4d5980193db2 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:35.666414 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474e7f9a-3b43-454a-9279-4d5980193db2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:35.668316 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474e7f9a-3b43-454a-9279-4d5980193db2 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:35.668723 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c810a-18a3-48cc-99b6-302584937bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:35.669349 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c810a-18a3-48cc-99b6-302584937bf3 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:35.669632 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c810a-18a3-48cc-99b6-302584937bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:35.669906 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c810a-18a3-48cc-99b6-302584937bf3 None admin] PATH_INFO: `/v3/projects` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:35.670648 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6c810a-18a3-48cc-99b6-302584937bf3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:35.670957 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6c810a-18a3-48cc-99b6-302584937bf3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:35.673211 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6c810a-18a3-48cc-99b6-302584937bf3 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:35.675415 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:35.676722 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 350/711] 10.222.0.49 () {56 vars in 1124 bytes} [Sun Aug 28 00:45:35 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:35.678418 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26602f-fcd3-48da-9389-6ba9de0b4310 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:35.678940 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26602f-fcd3-48da-9389-6ba9de0b4310 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:35.679398 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26602f-fcd3-48da-9389-6ba9de0b4310 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:35.681515 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 351/712] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:45:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:35.683305 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26602f-fcd3-48da-9389-6ba9de0b4310 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:35.696232 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 362/713] 10.222.0.49 () {56 vars in 1148 bytes} [Sun Aug 28 00:45:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:35.698008 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e50f2-af10-41a5-9dbf-8cd48011549a None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:35.698296 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e50f2-af10-41a5-9dbf-8cd48011549a None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:35.698578 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e50f2-af10-41a5-9dbf-8cd48011549a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:35.727986 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-6f8e50f2-af10-41a5-9dbf-8cd48011549a None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:35.732270 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-6f8e50f2-af10-41a5-9dbf-8cd48011549a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:35.809598 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26602f-fcd3-48da-9389-6ba9de0b4310 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:35.821419 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 363/714] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:45:35.822604 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8e50f2-af10-41a5-9dbf-8cd48011549a None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:35.854771 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7cc2a2-8f00-4ad2-b701-743a3659072c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:35.855616 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7cc2a2-8f00-4ad2-b701-743a3659072c None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:35.855934 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7cc2a2-8f00-4ad2-b701-743a3659072c None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:35.856206 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7cc2a2-8f00-4ad2-b701-743a3659072c None admin] PATH_INFO: `/v3/services` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:35.856851 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7cc2a2-8f00-4ad2-b701-743a3659072c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:35.857552 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7cc2a2-8f00-4ad2-b701-743a3659072c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:35.859231 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7cc2a2-8f00-4ad2-b701-743a3659072c None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:35.866520 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 352/715] 10.222.0.49 () {56 vars in 1124 bytes} [Sun Aug 28 00:45:35 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:35.940692 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8e50f2-af10-41a5-9dbf-8cd48011549a None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:35.970382 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:35.983179 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b92eb0-6890-423f-930a-65bb0ab3ccbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:35.984293 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b92eb0-6890-423f-930a-65bb0ab3ccbb None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:35.984797 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b92eb0-6890-423f-930a-65bb0ab3ccbb None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:35.985258 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b92eb0-6890-423f-930a-65bb0ab3ccbb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:35.986246 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b92eb0-6890-423f-930a-65bb0ab3ccbb None admin] RBAC: Adding query filter params (role.id=2e4889bb71f9434392c0baba59f2534e, scope.project.id=6d6e897c6391486e9c44e9277a3ee823, user.id=3dc0655c8156457a8fcb006c9fe85eb9) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:35.986752 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b92eb0-6890-423f-930a-65bb0ab3ccbb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:35.988468 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b92eb0-6890-423f-930a-65bb0ab3ccbb None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:35.995735 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 364/716] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 28 00:45:35 2022] GET /identity/v3/role_assignments?user.id=3dc0655c8156457a8fcb006c9fe85eb9&scope.project.id=6d6e897c6391486e9c44e9277a3ee823&role.id=2e4889bb71f9434392c0baba59f2534e => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:36.176776 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7cc2a2-8f00-4ad2-b701-743a3659072c None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:36.243920 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:36.298768 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7cc2a2-8f00-4ad2-b701-743a3659072c None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:36.454298 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d2652-630c-4870-9fb6-7050ee67b3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:36.455725 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d2652-630c-4870-9fb6-7050ee67b3a9 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:36.456198 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d2652-630c-4870-9fb6-7050ee67b3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:36.456711 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d2652-630c-4870-9fb6-7050ee67b3a9 None admin] PATH_INFO: `/v3/services/network` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:36.457489 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d2652-630c-4870-9fb6-7050ee67b3a9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:36.459043 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d2652-630c-4870-9fb6-7050ee67b3a9 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:36.468888 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-ac5d2652-630c-4870-9fb6-7050ee67b3a9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 28 00:45:36.468888 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:36.468888 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:45:36.468888 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:45:36.468888 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:45:36.468888 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:45:36.468888 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:45:36.468888 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:45:36.468888 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 28 00:45:36.468888 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:36.468888 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:45:36.468888 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:36.468888 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:36.468888 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:36.468888 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:36.468888 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:36.468888 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:36.469893 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:36.469893 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:36.469893 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:36.469893 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:36.469893 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:36.469893 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:36.469893 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:45:36.469893 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:45:36.469893 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:45:36.469893 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:45:36.469893 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:36.469893 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:36.469893 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:36.469893 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:36.469893 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:36.469893 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:36.470753 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:36.470753 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:36.470753 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:36.470753 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:36.470753 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:36.470753 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:36.470753 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:36.470753 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:36.470753 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:36.470753 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:36.470753 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:45:36.470753 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:45:36.470753 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 28 00:45:36.470753 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:36.473628 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 353/717] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 28 00:45:36 2022] GET /identity/v3/services/network => generated 88 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:36.479730 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b92eb0-6890-423f-930a-65bb0ab3ccbb None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:36.597406 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b92eb0-6890-423f-930a-65bb0ab3ccbb None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:36.638465 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703711d8-1039-4c71-a334-f4591fb63156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:36.639527 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703711d8-1039-4c71-a334-f4591fb63156 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:36.640020 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703711d8-1039-4c71-a334-f4591fb63156 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:36.640513 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703711d8-1039-4c71-a334-f4591fb63156 None admin] PATH_INFO: `/v3/services` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:36.641357 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703711d8-1039-4c71-a334-f4591fb63156 None admin] RBAC: Adding query filter params (name=network) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:36.641849 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703711d8-1039-4c71-a334-f4591fb63156 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:36.643408 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703711d8-1039-4c71-a334-f4591fb63156 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:36.648936 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 365/718] 10.222.0.49 () {56 vars in 1112 bytes} [Sun Aug 28 00:45:36 2022] GET /identity/v3/services?name=network => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:36.654997 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d2652-630c-4870-9fb6-7050ee67b3a9 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:36.753866 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6729649f-345b-4336-9e50-50745cf59e2e None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:36.754917 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6729649f-345b-4336-9e50-50745cf59e2e None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:36.755396 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6729649f-345b-4336-9e50-50745cf59e2e None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:36.757427 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 366/719] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:45:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:45:36.764554 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e9a89-3ffa-412d-bfe2-494eaaffd6cb None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:36.765252 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e9a89-3ffa-412d-bfe2-494eaaffd6cb None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:36.765716 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e9a89-3ffa-412d-bfe2-494eaaffd6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:36.784735 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-497e9a89-3ffa-412d-bfe2-494eaaffd6cb None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:36.786270 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-497e9a89-3ffa-412d-bfe2-494eaaffd6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:36.801219 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d2652-630c-4870-9fb6-7050ee67b3a9 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:36.835983 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:36.840071 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:36.861266 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 367/720] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:45:36.876531 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d9e30c-c207-4ce2-b7df-6d5ffdf986f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:36.877167 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d9e30c-c207-4ce2-b7df-6d5ffdf986f5 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:36.877448 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d9e30c-c207-4ce2-b7df-6d5ffdf986f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:36.877719 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d9e30c-c207-4ce2-b7df-6d5ffdf986f5 None admin] PATH_INFO: `/v3/services` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:36.878369 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d9e30c-c207-4ce2-b7df-6d5ffdf986f5 None admin] RBAC: Adding query filter params (type=network) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:36.878667 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d9e30c-c207-4ce2-b7df-6d5ffdf986f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:36.880059 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d9e30c-c207-4ce2-b7df-6d5ffdf986f5 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:36.885389 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 354/721] 10.222.0.49 () {56 vars in 1112 bytes} [Sun Aug 28 00:45:36 2022] GET /identity/v3/services?type=network => generated 124 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:37.203377 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e9a89-3ffa-412d-bfe2-494eaaffd6cb None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:37.325712 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e9a89-3ffa-412d-bfe2-494eaaffd6cb None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:37.363232 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1efc713-2cd5-4bc9-a320-322ca58e47bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:37.364257 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1efc713-2cd5-4bc9-a320-322ca58e47bb None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:37.364728 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1efc713-2cd5-4bc9-a320-322ca58e47bb None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:37.365218 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1efc713-2cd5-4bc9-a320-322ca58e47bb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:37.376645 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1efc713-2cd5-4bc9-a320-322ca58e47bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:45:37.381839 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-c1efc713-2cd5-4bc9-a320-322ca58e47bb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:45:37.381839 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:37.381839 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:37.381839 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:37.381839 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:37.381839 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:37.381839 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:37.381839 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:37.381839 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:37.381839 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:37.381839 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:37.381839 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:37.381839 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:45:37.381839 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:45:37.381839 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:45:37.381839 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:45:37.382788 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:45:37.382788 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:45:37.382788 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:45:37.382788 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:45:37.382788 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:37.382788 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:37.382788 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:37.382788 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:37.382788 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:37.382788 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:37.382788 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:37.382788 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:37.382788 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:37.382788 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:37.382788 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:37.382788 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:37.383611 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:37.383611 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:37.383611 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:37.383611 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:37.383611 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:45:37.383611 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:45:37.383611 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:45:37.383611 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:45:37.383611 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:45:37.383611 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:45:37.383611 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:45:37.383611 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:37.386357 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 368/722] 10.222.0.49 () {56 vars in 1096 bytes} [Sun Aug 28 00:45:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:37.391989 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d9e30c-c207-4ce2-b7df-6d5ffdf986f5 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:37.539548 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d9e30c-c207-4ce2-b7df-6d5ffdf986f5 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:37.584478 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b31fd6f-86c1-4484-91f3-cca7d8372f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:37.585502 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31fd6f-86c1-4484-91f3-cca7d8372f7b None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:37.586015 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31fd6f-86c1-4484-91f3-cca7d8372f7b None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:37.586477 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31fd6f-86c1-4484-91f3-cca7d8372f7b None admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:37.587404 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b31fd6f-86c1-4484-91f3-cca7d8372f7b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:37.587986 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b31fd6f-86c1-4484-91f3-cca7d8372f7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:37.589700 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b31fd6f-86c1-4484-91f3-cca7d8372f7b None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:37.604563 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 355/723] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 28 00:45:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:37.610483 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1efc713-2cd5-4bc9-a320-322ca58e47bb None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:37.689246 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:37.772114 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1efc713-2cd5-4bc9-a320-322ca58e47bb None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:37.792608 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1bb8ce-c6e0-417d-a4c6-4ad428d84cd9 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:37.792802 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1bb8ce-c6e0-417d-a4c6-4ad428d84cd9 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:37.793065 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1bb8ce-c6e0-417d-a4c6-4ad428d84cd9 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:37.794407 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 356/724] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:45:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:37.800931 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e8c3b-1362-4166-891b-a6df78c10202 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:37.801213 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e8c3b-1362-4166-891b-a6df78c10202 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:37.801478 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e8c3b-1362-4166-891b-a6df78c10202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:37.834459 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-e85e8c3b-1362-4166-891b-a6df78c10202 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:37.835634 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-e85e8c3b-1362-4166-891b-a6df78c10202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:37.839996 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db64bc-7ceb-484b-9239-ebaeefa8c2dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:37.840601 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db64bc-7ceb-484b-9239-ebaeefa8c2dd None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:37.840875 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db64bc-7ceb-484b-9239-ebaeefa8c2dd None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:37.841149 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db64bc-7ceb-484b-9239-ebaeefa8c2dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:37.857588 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79db64bc-7ceb-484b-9239-ebaeefa8c2dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:37.859078 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79db64bc-7ceb-484b-9239-ebaeefa8c2dd None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:37.890702 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-79db64bc-7ceb-484b-9239-ebaeefa8c2dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:37.890702 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:37.890702 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:37.890702 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:37.890702 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:37.890702 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:37.890702 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:37.890702 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:37.890702 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:37.890702 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:37.890702 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:37.890702 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:37.890702 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:45:37.890702 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:45:37.890702 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:45:37.890702 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:45:37.891845 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:37.891845 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:37.891845 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:37.891845 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:37.891845 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:37.891845 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:37.891845 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:37.891845 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:37.891845 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:37.891845 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:37.891845 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:37.891845 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:37.891845 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:37.891845 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:37.891845 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:37.891845 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:37.891845 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:45:37.893376 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:45:37.893376 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:37.893376 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:37.893376 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 369/725] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:37.898125 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db64bc-7ceb-484b-9239-ebaeefa8c2dd None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:37.922932 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:37.972729 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 357/726] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 28 00:45:38.061908 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:38.070384 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db64bc-7ceb-484b-9239-ebaeefa8c2dd None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:38.238672 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeee26c-017a-47a7-8e34-2877cd33d3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:38.239290 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeee26c-017a-47a7-8e34-2877cd33d3ae None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:38.239570 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeee26c-017a-47a7-8e34-2877cd33d3ae None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:38.239868 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeee26c-017a-47a7-8e34-2877cd33d3ae None admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:38.240525 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeee26c-017a-47a7-8e34-2877cd33d3ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:38.240829 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeee26c-017a-47a7-8e34-2877cd33d3ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:38.242220 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeee26c-017a-47a7-8e34-2877cd33d3ae None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:38.258775 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 370/727] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:45:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:45:38.268826 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85e8c3b-1362-4166-891b-a6df78c10202 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:38.305082 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeee26c-017a-47a7-8e34-2877cd33d3ae None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:38.423078 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeee26c-017a-47a7-8e34-2877cd33d3ae None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:38.436994 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85e8c3b-1362-4166-891b-a6df78c10202 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:38.468811 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502006e0-a3fd-457e-8bb0-33e846bbebfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:38.469444 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502006e0-a3fd-457e-8bb0-33e846bbebfe None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:38.469719 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502006e0-a3fd-457e-8bb0-33e846bbebfe None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:38.469983 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502006e0-a3fd-457e-8bb0-33e846bbebfe None admin] PATH_INFO: `/v3/roles/service` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:38.477109 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4144ff2d-db1f-4b74-972c-cee4dcbc90b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:38.478045 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144ff2d-db1f-4b74-972c-cee4dcbc90b3 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:38.478538 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144ff2d-db1f-4b74-972c-cee4dcbc90b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:38.479065 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144ff2d-db1f-4b74-972c-cee4dcbc90b3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:38.481922 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502006e0-a3fd-457e-8bb0-33e846bbebfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:45:38.487599 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4144ff2d-db1f-4b74-972c-cee4dcbc90b3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:38.488383 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-502006e0-a3fd-457e-8bb0-33e846bbebfe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:45:38.488383 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:38.488383 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:38.488383 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:38.488383 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:38.488383 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:38.488383 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:38.488383 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:38.488383 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:38.488383 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:38.488383 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:38.488383 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:38.488383 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:45:38.488383 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:45:38.488383 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:45:38.488383 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:45:38.489297 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:45:38.489297 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:45:38.489297 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:45:38.489297 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:45:38.489297 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:38.489297 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:38.489297 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:38.489297 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:38.489297 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:38.489297 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:38.489297 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:38.489297 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:38.489297 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:38.489297 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:38.489297 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:38.489297 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:38.492394 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:38.492394 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:38.492394 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:38.492394 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:38.492394 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:45:38.492394 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:45:38.492394 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:45:38.492394 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:45:38.492394 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:45:38.492394 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:45:38.492394 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:45:38.492394 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:38.492394 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 371/728] 10.222.0.49 () {56 vars in 1102 bytes} [Sun Aug 28 00:45:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:45:38.492394 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6813a-27ec-405c-ae10-0d7169f9a427 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:38.493147 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6813a-27ec-405c-ae10-0d7169f9a427 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:38.493147 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6813a-27ec-405c-ae10-0d7169f9a427 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:38.496041 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4144ff2d-db1f-4b74-972c-cee4dcbc90b3 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:38.497411 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 372/729] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:45:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:38.498302 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6813a-27ec-405c-ae10-0d7169f9a427 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:38.509451 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-4144ff2d-db1f-4b74-972c-cee4dcbc90b3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 28 00:45:38.509451 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:38.509451 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:38.509451 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:38.509451 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:38.509451 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:38.509451 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:38.509451 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:38.509451 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:38.509451 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:38.509451 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:38.509451 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:38.509451 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:45:38.509451 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:45:38.509451 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:45:38.509451 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:45:38.510508 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:38.510508 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:38.510508 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:45:38.510508 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:45:38.510508 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:45:38.510508 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:45:38.510508 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:38.510508 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:38.510508 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:38.510508 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:38.510508 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:38.510508 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:38.510508 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:38.510508 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:38.510508 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:38.510508 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:38.510508 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:38.510508 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:38.511479 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:38.511479 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:38.511479 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:45:38.511479 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:45:38.511479 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:45:38.511479 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:45:38.511479 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:45:38.511479 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:45:38.511479 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 28 00:45:38.511479 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:38.511479 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 358/730] 10.222.0.49 () {56 vars in 1096 bytes} [Sun Aug 28 00:45:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:38.512279 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be7bc2-0531-4177-b3e8-729d9f986ca0 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:38.515689 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be7bc2-0531-4177-b3e8-729d9f986ca0 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:38.515689 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be7bc2-0531-4177-b3e8-729d9f986ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:38.519821 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:38.534635 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-86be7bc2-0531-4177-b3e8-729d9f986ca0 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:38.536058 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-86be7bc2-0531-4177-b3e8-729d9f986ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:38.567636 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:38.614997 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6813a-27ec-405c-ae10-0d7169f9a427 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:38.615905 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 359/731] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:45:38.618185 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86be7bc2-0531-4177-b3e8-729d9f986ca0 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:38.651184 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e1dce0-964f-4cd0-80db-18097aed571a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:38.651857 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1dce0-964f-4cd0-80db-18097aed571a None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:38.652138 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1dce0-964f-4cd0-80db-18097aed571a None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:38.652406 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1dce0-964f-4cd0-80db-18097aed571a None admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:38.653073 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e1dce0-964f-4cd0-80db-18097aed571a None admin] RBAC: Adding query filter params (name=service) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:38.653381 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e1dce0-964f-4cd0-80db-18097aed571a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:38.654753 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e1dce0-964f-4cd0-80db-18097aed571a None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:38.667985 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 373/732] 10.222.0.49 () {56 vars in 1103 bytes} [Sun Aug 28 00:45:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:38.669409 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc1fea-dd96-4842-8339-9cbb917e09c5 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:38.669695 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc1fea-dd96-4842-8339-9cbb917e09c5 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:38.669968 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fc1fea-dd96-4842-8339-9cbb917e09c5 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:38.675239 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 374/733] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:45:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:38.675239 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fc1fea-dd96-4842-8339-9cbb917e09c5 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:38.753259 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86be7bc2-0531-4177-b3e8-729d9f986ca0 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:38.769811 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:38.790362 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be7e2b6-9c6e-4d2b-8b30-8e93968de345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:38.791341 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7e2b6-9c6e-4d2b-8b30-8e93968de345 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:38.791494 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7e2b6-9c6e-4d2b-8b30-8e93968de345 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:38.791891 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7e2b6-9c6e-4d2b-8b30-8e93968de345 None admin] PATH_INFO: `/v3/users` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:38.792726 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be7e2b6-9c6e-4d2b-8b30-8e93968de345 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:38.793148 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be7e2b6-9c6e-4d2b-8b30-8e93968de345 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:38.794687 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be7e2b6-9c6e-4d2b-8b30-8e93968de345 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:38.803816 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fc1fea-dd96-4842-8339-9cbb917e09c5 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:38.814812 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 360/734] 10.222.0.49 () {56 vars in 1135 bytes} [Sun Aug 28 00:45:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:38.816326 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf3d1b-d4f2-4d70-8b9c-0677ae41141d None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:38.816744 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf3d1b-d4f2-4d70-8b9c-0677ae41141d None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:38.817107 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cf3d1b-d4f2-4d70-8b9c-0677ae41141d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:38.836730 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-82cf3d1b-d4f2-4d70-8b9c-0677ae41141d None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:38.838167 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-82cf3d1b-d4f2-4d70-8b9c-0677ae41141d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:38.849707 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35760a25-e624-4ccf-a1fc-9699d462ab93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:38.851003 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35760a25-e624-4ccf-a1fc-9699d462ab93 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:38.851567 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35760a25-e624-4ccf-a1fc-9699d462ab93 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:38.852107 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35760a25-e624-4ccf-a1fc-9699d462ab93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:38.858264 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:38.868666 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35760a25-e624-4ccf-a1fc-9699d462ab93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:38.871096 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35760a25-e624-4ccf-a1fc-9699d462ab93 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:38.891363 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-35760a25-e624-4ccf-a1fc-9699d462ab93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:38.891363 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:38.891363 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:38.891363 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:38.891363 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:38.891363 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:38.891363 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:38.891363 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:38.891363 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:38.891363 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:38.891363 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:38.891363 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:38.891363 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:45:38.891363 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:45:38.891363 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:45:38.891363 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:45:38.892472 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:38.892472 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:38.892472 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:38.892472 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:38.892472 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:38.892472 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:38.892472 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:38.892472 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:38.892472 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:38.892472 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:38.892472 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:38.892472 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:38.892472 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:38.892472 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:38.892472 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:38.892472 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:38.892472 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:45:38.893388 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:45:38.893388 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:38.893388 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:38.893388 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 375/735] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:38.893388 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35760a25-e624-4ccf-a1fc-9699d462ab93 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:38.919573 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 361/736] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:45:38.920466 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cf3d1b-d4f2-4d70-8b9c-0677ae41141d None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:39.008326 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35760a25-e624-4ccf-a1fc-9699d462ab93 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:39.036298 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:39.045992 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b96b15-1ac1-40e1-ae20-699c53de5b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:39.047019 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b96b15-1ac1-40e1-ae20-699c53de5b56 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:39.047386 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b96b15-1ac1-40e1-ae20-699c53de5b56 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:39.047775 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b96b15-1ac1-40e1-ae20-699c53de5b56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:39.064342 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cf3d1b-d4f2-4d70-8b9c-0677ae41141d None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:39.111982 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c5ce8b-d014-4562-b78a-73a41f56f7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:39.113154 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5ce8b-d014-4562-b78a-73a41f56f7fc None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:39.113610 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5ce8b-d014-4562-b78a-73a41f56f7fc None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:39.114389 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5ce8b-d014-4562-b78a-73a41f56f7fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:39.121429 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b96b15-1ac1-40e1-ae20-699c53de5b56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:39.123447 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b96b15-1ac1-40e1-ae20-699c53de5b56 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:39.129337 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c5ce8b-d014-4562-b78a-73a41f56f7fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:45:39.135426 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-20c5ce8b-d014-4562-b78a-73a41f56f7fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:45:39.135426 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:39.135426 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:39.135426 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:39.135426 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:39.135426 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:39.135426 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:39.135426 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:39.135426 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:39.135426 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:39.135426 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:39.135426 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:39.135426 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:45:39.135426 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:45:39.135426 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:45:39.135426 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:45:39.136578 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:45:39.136578 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:45:39.136578 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:45:39.136578 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:45:39.136578 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:39.136578 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:39.136578 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:39.136578 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:39.136578 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:39.136578 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:39.136578 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:39.136578 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:39.136578 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:39.136578 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:39.136578 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:39.136578 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:39.137627 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:39.137627 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:39.137627 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:39.137627 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:39.137627 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:45:39.137627 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:45:39.137627 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:45:39.137627 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:45:39.137627 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:45:39.137627 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:45:39.137627 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:45:39.137627 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:39.145236 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 362/737] 10.222.0.49 () {56 vars in 1096 bytes} [Sun Aug 28 00:45:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:39.145236 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c5ce8b-d014-4562-b78a-73a41f56f7fc None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:39.161458 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:39.251856 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 376/738] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 28 00:45:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 28 00:45:39.252713 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b96b15-1ac1-40e1-ae20-699c53de5b56 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:39.253860 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c5ce8b-d014-4562-b78a-73a41f56f7fc None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:39.279373 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:39.287560 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a3ec0-6e9c-47bf-a68b-8841d5bd85cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:39.288285 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a3ec0-6e9c-47bf-a68b-8841d5bd85cb None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:39.288594 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a3ec0-6e9c-47bf-a68b-8841d5bd85cb None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:39.288858 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a3ec0-6e9c-47bf-a68b-8841d5bd85cb None admin] PATH_INFO: `/v3/domains` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:39.289501 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40a3ec0-6e9c-47bf-a68b-8841d5bd85cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:39.289799 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40a3ec0-6e9c-47bf-a68b-8841d5bd85cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:39.291167 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40a3ec0-6e9c-47bf-a68b-8841d5bd85cb None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:39.303052 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 363/739] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:45:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:39.304316 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b59dd-7c51-4609-a14e-0d33339e0e2c None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:39.304600 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b59dd-7c51-4609-a14e-0d33339e0e2c None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:39.304989 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911b59dd-7c51-4609-a14e-0d33339e0e2c None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:39.310079 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 364/740] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:45:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:39.310079 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b59dd-7c51-4609-a14e-0d33339e0e2c None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:39.359197 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b96b15-1ac1-40e1-ae20-699c53de5b56 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:39.382999 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:39.403146 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0034bd-9034-4245-808e-8ffef397f73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:39.403787 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0034bd-9034-4245-808e-8ffef397f73b None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:39.404069 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0034bd-9034-4245-808e-8ffef397f73b None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:39.404341 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0034bd-9034-4245-808e-8ffef397f73b None admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:39.405003 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0034bd-9034-4245-808e-8ffef397f73b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:39.405323 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0034bd-9034-4245-808e-8ffef397f73b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:39.406704 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0034bd-9034-4245-808e-8ffef397f73b None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:39.409232 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911b59dd-7c51-4609-a14e-0d33339e0e2c None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:39.415092 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 377/741] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 28 00:45:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:39.415946 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0034bd-9034-4245-808e-8ffef397f73b None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:39.444147 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e704e89e-f14e-496e-84c4-a31fb27842b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:39.444751 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e704e89e-f14e-496e-84c4-a31fb27842b0 None admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:39.445044 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e704e89e-f14e-496e-84c4-a31fb27842b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:39.445309 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e704e89e-f14e-496e-84c4-a31fb27842b0 None admin] PATH_INFO: `/v3/services` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:39.445963 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e704e89e-f14e-496e-84c4-a31fb27842b0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:39.447335 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e704e89e-f14e-496e-84c4-a31fb27842b0 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:39.464780 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 365/742] 10.222.0.49 () {60 vars in 1141 bytes} [Sun Aug 28 00:45:39 2022] POST /identity/v3/services => generated 251 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:45:39.465979 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e704e89e-f14e-496e-84c4-a31fb27842b0 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:39.523360 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:39.539838 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0034bd-9034-4245-808e-8ffef397f73b None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:39.589443 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a66e0-124c-441f-860a-928f7b618418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:39.590097 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a66e0-124c-441f-860a-928f7b618418 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:39.590373 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a66e0-124c-441f-860a-928f7b618418 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:39.590640 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a66e0-124c-441f-860a-928f7b618418 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:39.599471 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e704e89e-f14e-496e-84c4-a31fb27842b0 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:39.603603 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5a66e0-124c-441f-860a-928f7b618418 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:39.605149 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5a66e0-124c-441f-860a-928f7b618418 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:39.621838 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-2a5a66e0-124c-441f-860a-928f7b618418 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:39.621838 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:39.621838 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:39.621838 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:39.621838 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:39.621838 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:39.621838 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:39.621838 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:39.621838 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:39.621838 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:39.621838 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:39.621838 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:39.621838 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:45:39.621838 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:45:39.621838 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:45:39.621838 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:45:39.623013 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:39.623013 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:39.623013 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:39.623013 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:39.623013 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:39.623013 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:39.623013 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:39.623013 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:39.623013 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:39.623013 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:39.623013 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:39.623013 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:39.623013 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:39.623013 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:39.623013 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:39.623013 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:39.623013 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:45:39.624137 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:45:39.624137 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:39.624137 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:39.624137 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 378/743] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:39.624630 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb7ddb-e9be-4062-898f-0a9582adb71e None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:39.624912 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb7ddb-e9be-4062-898f-0a9582adb71e None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:39.625175 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb7ddb-e9be-4062-898f-0a9582adb71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:39.633983 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:39.642876 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413f5fb3-bbd4-4366-a60a-e3f2fdb0090e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:39.643533 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f5fb3-bbd4-4366-a60a-e3f2fdb0090e None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:39.643859 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f5fb3-bbd4-4366-a60a-e3f2fdb0090e None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:39.644131 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f5fb3-bbd4-4366-a60a-e3f2fdb0090e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:39.645410 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-f7fb7ddb-e9be-4062-898f-0a9582adb71e None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:39.646654 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-f7fb7ddb-e9be-4062-898f-0a9582adb71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:39.653408 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413f5fb3-bbd4-4366-a60a-e3f2fdb0090e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:39.655596 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413f5fb3-bbd4-4366-a60a-e3f2fdb0090e None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:39.671261 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-413f5fb3-bbd4-4366-a60a-e3f2fdb0090e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 00:45:39.671261 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:39.671261 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:39.671261 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:39.671261 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:39.671261 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:39.671261 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:39.671261 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:39.671261 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:39.671261 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:39.671261 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:39.671261 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:39.671261 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:45:39.671261 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:45:39.671261 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:45:39.671261 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:45:39.672454 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:39.672454 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:39.672454 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:45:39.672454 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:45:39.672454 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:45:39.672454 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:45:39.672454 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:39.672454 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:39.672454 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:39.672454 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:39.672454 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:39.672454 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:39.672454 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:39.672454 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:39.672454 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:39.672454 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:39.672454 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:39.672454 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:39.673633 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:39.673633 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:39.673633 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:45:39.673633 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:45:39.673633 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:45:39.673633 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:45:39.673633 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:45:39.673633 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:45:39.673633 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 00:45:39.673633 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:39.675933 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 366/744] 10.222.0.49 () {56 vars in 1117 bytes} [Sun Aug 28 00:45:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:39.676930 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413f5fb3-bbd4-4366-a60a-e3f2fdb0090e None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:39.723310 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 379/745] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:39 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 28 00:45:39.724471 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fb7ddb-e9be-4062-898f-0a9582adb71e None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:39.804066 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413f5fb3-bbd4-4366-a60a-e3f2fdb0090e None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:39.811529 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:39.851971 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf4470-3216-4a40-a891-423e4574fca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:39.852972 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf4470-3216-4a40-a891-423e4574fca0 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:39.853320 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf4470-3216-4a40-a891-423e4574fca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:39.853698 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bf4470-3216-4a40-a891-423e4574fca0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:39.855136 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fb7ddb-e9be-4062-898f-0a9582adb71e None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:39.866726 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bf4470-3216-4a40-a891-423e4574fca0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:39.869071 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bf4470-3216-4a40-a891-423e4574fca0 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:39.890887 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-96bf4470-3216-4a40-a891-423e4574fca0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:39.890887 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:39.890887 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:39.890887 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:39.890887 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:39.890887 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:39.890887 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:39.890887 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:39.890887 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:39.890887 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:39.890887 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:39.890887 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:39.890887 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:45:39.890887 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:45:39.890887 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:45:39.890887 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:45:39.891941 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:39.891941 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:39.891941 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:39.891941 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:39.891941 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:39.891941 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:39.891941 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:39.891941 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:39.891941 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:39.891941 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:39.891941 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:39.891941 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:39.891941 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:39.891941 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:39.891941 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:39.891941 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:39.891941 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:45:39.892933 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:45:39.892933 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:39.892933 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:39.896750 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 367/746] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:39.897686 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf4470-3216-4a40-a891-423e4574fca0 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:39.898960 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2683fbb-475b-45e2-b862-489b8ec3280d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:39.899899 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2683fbb-475b-45e2-b862-489b8ec3280d None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:39.900372 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2683fbb-475b-45e2-b862-489b8ec3280d None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:39.900962 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2683fbb-475b-45e2-b862-489b8ec3280d None admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:39.901845 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2683fbb-475b-45e2-b862-489b8ec3280d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:39.902343 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2683fbb-475b-45e2-b862-489b8ec3280d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:39.903973 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2683fbb-475b-45e2-b862-489b8ec3280d None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:39.917562 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 380/747] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:45:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:39.918789 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2683fbb-475b-45e2-b862-489b8ec3280d None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:39.948144 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:40.008398 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bf4470-3216-4a40-a891-423e4574fca0 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:40.037146 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2683fbb-475b-45e2-b862-489b8ec3280d None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:40.044041 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a702e5-ebe9-4f71-a212-81a06d97bc3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:40.044590 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a702e5-ebe9-4f71-a212-81a06d97bc3a None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:40.044869 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a702e5-ebe9-4f71-a212-81a06d97bc3a None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:40.045141 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a702e5-ebe9-4f71-a212-81a06d97bc3a None admin] PATH_INFO: `/v3/users` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:40.045926 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a702e5-ebe9-4f71-a212-81a06d97bc3a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:40.046711 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a702e5-ebe9-4f71-a212-81a06d97bc3a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:40.048611 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a702e5-ebe9-4f71-a212-81a06d97bc3a None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:40.070780 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:40.075123 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 368/748] 10.222.0.49 () {56 vars in 1149 bytes} [Sun Aug 28 00:45:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:40.076022 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a702e5-ebe9-4f71-a212-81a06d97bc3a None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:40.085838 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82020b13-f981-40ed-a744-c85f53d08f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:40.086588 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82020b13-f981-40ed-a744-c85f53d08f57 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:40.086822 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82020b13-f981-40ed-a744-c85f53d08f57 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:40.087103 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82020b13-f981-40ed-a744-c85f53d08f57 None admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:40.087795 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82020b13-f981-40ed-a744-c85f53d08f57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:40.088101 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82020b13-f981-40ed-a744-c85f53d08f57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:40.089529 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82020b13-f981-40ed-a744-c85f53d08f57 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:40.103188 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 381/749] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:45:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:40.104014 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82020b13-f981-40ed-a744-c85f53d08f57 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:40.190387 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:40.193770 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a702e5-ebe9-4f71-a212-81a06d97bc3a None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:40.228898 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82020b13-f981-40ed-a744-c85f53d08f57 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:40.236016 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea2fa6b-90cd-4a87-87d7-e8b44a80b79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:40.236691 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2fa6b-90cd-4a87-87d7-e8b44a80b79a None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:40.236957 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2fa6b-90cd-4a87-87d7-e8b44a80b79a None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:40.237870 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2fa6b-90cd-4a87-87d7-e8b44a80b79a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:40.246862 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea2fa6b-90cd-4a87-87d7-e8b44a80b79a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:40.248423 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea2fa6b-90cd-4a87-87d7-e8b44a80b79a None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:40.260891 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-cea2fa6b-90cd-4a87-87d7-e8b44a80b79a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:45:40.260891 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:40.260891 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:40.260891 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:40.260891 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:40.260891 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:40.260891 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:40.260891 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:40.260891 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:40.260891 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:40.260891 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:40.260891 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:40.260891 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:45:40.260891 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:45:40.260891 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:45:40.261912 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:45:40.261912 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:40.261912 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:40.261912 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:40.261912 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:40.261912 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:40.261912 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:40.261912 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:40.261912 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:40.261912 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:40.261912 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:40.261912 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:40.261912 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:40.261912 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:40.261912 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:40.261912 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:40.261912 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:40.262812 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:45:40.262812 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:45:40.262812 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:45:40.262812 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:45:40.262812 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:45:40.262812 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:45:40.262812 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:45:40.262812 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:40.262812 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 369/750] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 28 00:45:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:40.264049 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea2fa6b-90cd-4a87-87d7-e8b44a80b79a None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:40.274449 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6557bcd-0915-48fc-9c16-1c70fb266f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:40.275079 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6557bcd-0915-48fc-9c16-1c70fb266f0d None admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:40.275352 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6557bcd-0915-48fc-9c16-1c70fb266f0d None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:40.275617 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6557bcd-0915-48fc-9c16-1c70fb266f0d None admin] PATH_INFO: `/v3/services` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:40.276788 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6557bcd-0915-48fc-9c16-1c70fb266f0d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:40.277825 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6557bcd-0915-48fc-9c16-1c70fb266f0d None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:40.299728 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 382/751] 10.222.0.49 () {60 vars in 1141 bytes} [Sun Aug 28 00:45:40 2022] POST /identity/v3/services => generated 240 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:45:40.299728 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6557bcd-0915-48fc-9c16-1c70fb266f0d None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:40.374588 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:40.390592 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea2fa6b-90cd-4a87-87d7-e8b44a80b79a None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:40.449685 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d1c74a-b5bd-4ec9-a115-033b9cfa6244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:40.451129 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1c74a-b5bd-4ec9-a115-033b9cfa6244 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:40.451410 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1c74a-b5bd-4ec9-a115-033b9cfa6244 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:40.451895 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1c74a-b5bd-4ec9-a115-033b9cfa6244 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:40.458895 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6557bcd-0915-48fc-9c16-1c70fb266f0d None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:40.499410 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:40.523217 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e55fc-812b-49dd-9140-70eab41a74d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:40.523897 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e55fc-812b-49dd-9140-70eab41a74d3 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:40.524175 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e55fc-812b-49dd-9140-70eab41a74d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:40.524443 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e55fc-812b-49dd-9140-70eab41a74d3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:40.532435 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049e55fc-812b-49dd-9140-70eab41a74d3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:40.533928 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049e55fc-812b-49dd-9140-70eab41a74d3 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:40.547978 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-049e55fc-812b-49dd-9140-70eab41a74d3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 28 00:45:40.547978 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:40.547978 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:40.547978 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:40.547978 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:40.547978 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:40.547978 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:40.547978 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:40.547978 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:40.547978 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:40.547978 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:40.547978 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:40.547978 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:45:40.547978 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:45:40.547978 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:45:40.547978 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:45:40.549244 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:40.549244 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:40.549244 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:45:40.549244 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:45:40.549244 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:45:40.549244 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:45:40.549244 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:40.549244 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:40.549244 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:40.549244 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:40.549244 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:40.549244 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:40.549244 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:40.549244 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:40.549244 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:40.549244 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:40.549244 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:40.549244 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:40.551886 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:40.551886 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:40.551886 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:45:40.551886 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:45:40.551886 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:45:40.551886 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:45:40.551886 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:45:40.551886 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:45:40.551886 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 28 00:45:40.551886 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:40.551886 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 383/752] 10.222.0.49 () {56 vars in 1093 bytes} [Sun Aug 28 00:45:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:40.551886 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e55fc-812b-49dd-9140-70eab41a74d3 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:40.570748 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d1c74a-b5bd-4ec9-a115-033b9cfa6244 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:40.573072 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d1c74a-b5bd-4ec9-a115-033b9cfa6244 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:40.672272 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e55fc-812b-49dd-9140-70eab41a74d3 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:40.685045 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:40.708905 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 370/753] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 28 00:45:40 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:45:40.709890 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d1c74a-b5bd-4ec9-a115-033b9cfa6244 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:40.722469 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a871b108-e7e2-4f20-b330-27d28f3662bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:40.723219 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a871b108-e7e2-4f20-b330-27d28f3662bd None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:40.723596 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a871b108-e7e2-4f20-b330-27d28f3662bd None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:40.724011 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a871b108-e7e2-4f20-b330-27d28f3662bd None admin] PATH_INFO: `/v3/projects` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:40.727312 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a871b108-e7e2-4f20-b330-27d28f3662bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:40.727312 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a871b108-e7e2-4f20-b330-27d28f3662bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:40.730279 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a871b108-e7e2-4f20-b330-27d28f3662bd None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:40.751029 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 384/754] 10.222.0.49 () {56 vars in 1148 bytes} [Sun Aug 28 00:45:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:40.751029 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a871b108-e7e2-4f20-b330-27d28f3662bd None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:40.795353 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:40.852142 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d1c74a-b5bd-4ec9-a115-033b9cfa6244 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:40.879072 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a871b108-e7e2-4f20-b330-27d28f3662bd None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:40.904150 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6560432-c832-452f-9737-631f1cdffe28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:40.905065 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6560432-c832-452f-9737-631f1cdffe28 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:40.905485 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6560432-c832-452f-9737-631f1cdffe28 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:40.905894 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6560432-c832-452f-9737-631f1cdffe28 None admin] PATH_INFO: `/v3/users` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:40.906838 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6560432-c832-452f-9737-631f1cdffe28 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:40.907299 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6560432-c832-452f-9737-631f1cdffe28 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:40.908986 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6560432-c832-452f-9737-631f1cdffe28 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:40.924193 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471217c5-2fad-4218-81e6-d3254c6870c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:40.924935 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471217c5-2fad-4218-81e6-d3254c6870c5 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:40.925315 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471217c5-2fad-4218-81e6-d3254c6870c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:40.925684 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471217c5-2fad-4218-81e6-d3254c6870c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:40.930437 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 371/755] 10.222.0.49 () {56 vars in 1133 bytes} [Sun Aug 28 00:45:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:40.931549 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6560432-c832-452f-9737-631f1cdffe28 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:40.942349 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471217c5-2fad-4218-81e6-d3254c6870c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:40.944028 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471217c5-2fad-4218-81e6-d3254c6870c5 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:40.960992 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-471217c5-2fad-4218-81e6-d3254c6870c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:40.960992 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:40.960992 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:40.960992 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:40.960992 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:40.960992 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:40.960992 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:40.960992 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:40.960992 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:40.960992 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:40.960992 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:40.960992 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:40.960992 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:45:40.960992 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:45:40.960992 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:45:40.960992 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:45:40.962238 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:40.962238 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:40.962238 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:40.962238 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:40.962238 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:40.962238 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:40.962238 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:40.962238 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:40.962238 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:40.962238 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:40.962238 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:40.962238 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:40.962238 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:40.962238 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:40.962238 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:40.962238 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:40.962238 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:45:40.963409 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:45:40.963409 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:40.963409 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:40.967698 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 385/756] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:40.967698 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471217c5-2fad-4218-81e6-d3254c6870c5 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:40.989636 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:41.049592 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6560432-c832-452f-9737-631f1cdffe28 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:41.065676 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:41.076414 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471217c5-2fad-4218-81e6-d3254c6870c5 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:41.089907 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b47b84-3039-4b85-8155-9f317a1593a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:41.090923 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b47b84-3039-4b85-8155-9f317a1593a5 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:41.091405 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b47b84-3039-4b85-8155-9f317a1593a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:41.091976 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b47b84-3039-4b85-8155-9f317a1593a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:41.092924 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b47b84-3039-4b85-8155-9f317a1593a5 None admin] RBAC: Adding query filter params (role.id=2e4889bb71f9434392c0baba59f2534e, scope.project.id=6d6e897c6391486e9c44e9277a3ee823, user.id=4ce463b940db4f83a6df7e0561a88567) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:41.093408 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b47b84-3039-4b85-8155-9f317a1593a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:41.095130 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b47b84-3039-4b85-8155-9f317a1593a5 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:41.102100 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 372/757] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 28 00:45:40 2022] GET /identity/v3/role_assignments?user.id=4ce463b940db4f83a6df7e0561a88567&scope.project.id=6d6e897c6391486e9c44e9277a3ee823&role.id=2e4889bb71f9434392c0baba59f2534e => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:41.103260 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b47b84-3039-4b85-8155-9f317a1593a5 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:41.114751 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d58ae-70cc-461e-9ab5-df17f1fea159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:41.115517 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d58ae-70cc-461e-9ab5-df17f1fea159 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:41.115904 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d58ae-70cc-461e-9ab5-df17f1fea159 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:41.116245 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d58ae-70cc-461e-9ab5-df17f1fea159 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:41.128736 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082d58ae-70cc-461e-9ab5-df17f1fea159 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:41.130349 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082d58ae-70cc-461e-9ab5-df17f1fea159 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:41.146678 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-082d58ae-70cc-461e-9ab5-df17f1fea159 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:41.146678 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:41.146678 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:41.146678 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:41.146678 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:41.146678 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:41.146678 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:41.146678 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:41.146678 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:41.146678 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:41.146678 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:41.146678 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:41.146678 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:45:41.146678 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:45:41.146678 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:45:41.146678 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:45:41.147902 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:41.147902 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:41.147902 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:41.147902 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:41.147902 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:41.147902 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:41.147902 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:41.147902 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:41.147902 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:41.147902 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:41.147902 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:41.147902 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:41.147902 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:41.147902 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:41.147902 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:41.147902 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:41.147902 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:45:41.148839 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:45:41.148839 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:41.148839 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:41.152927 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 386/758] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:41.154195 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d58ae-70cc-461e-9ab5-df17f1fea159 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:41.234440 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:41.244711 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b47b84-3039-4b85-8155-9f317a1593a5 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:41.269550 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d58ae-70cc-461e-9ab5-df17f1fea159 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:41.286418 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ae0d39-762b-41d9-a66e-6587e1cd458d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:41.287522 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae0d39-762b-41d9-a66e-6587e1cd458d None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:41.288076 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae0d39-762b-41d9-a66e-6587e1cd458d None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:41.288595 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae0d39-762b-41d9-a66e-6587e1cd458d None admin] PATH_INFO: `/v3/domains` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:41.289583 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ae0d39-762b-41d9-a66e-6587e1cd458d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:41.290092 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ae0d39-762b-41d9-a66e-6587e1cd458d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:41.291785 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ae0d39-762b-41d9-a66e-6587e1cd458d None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:41.306578 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 373/759] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:45:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:41.311463 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a463a8-72ad-4c8a-b1d5-be5d0765959d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:41.311463 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a463a8-72ad-4c8a-b1d5-be5d0765959d None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:41.311463 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a463a8-72ad-4c8a-b1d5-be5d0765959d None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:41.311463 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a463a8-72ad-4c8a-b1d5-be5d0765959d None admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:41.311890 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a463a8-72ad-4c8a-b1d5-be5d0765959d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:41.311890 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a463a8-72ad-4c8a-b1d5-be5d0765959d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:41.311890 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a463a8-72ad-4c8a-b1d5-be5d0765959d None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:41.313443 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ae0d39-762b-41d9-a66e-6587e1cd458d None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:41.331067 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 387/760] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:45:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:45:41.332389 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a463a8-72ad-4c8a-b1d5-be5d0765959d None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:41.362145 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:41.439514 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ae0d39-762b-41d9-a66e-6587e1cd458d None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:41.453845 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a463a8-72ad-4c8a-b1d5-be5d0765959d None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:41.484293 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57d63ac-3b0f-48ca-a0f5-56bfb1a5d925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:41.486597 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d63ac-3b0f-48ca-a0f5-56bfb1a5d925 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:41.487109 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d63ac-3b0f-48ca-a0f5-56bfb1a5d925 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:41.487721 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d63ac-3b0f-48ca-a0f5-56bfb1a5d925 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:41.498001 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57d63ac-3b0f-48ca-a0f5-56bfb1a5d925 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:41.500527 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:41.501953 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57d63ac-3b0f-48ca-a0f5-56bfb1a5d925 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:41.508060 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbea643-36e2-4c5c-a036-82cf754afffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:41.508750 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbea643-36e2-4c5c-a036-82cf754afffd None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:41.509033 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbea643-36e2-4c5c-a036-82cf754afffd None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:41.509373 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbea643-36e2-4c5c-a036-82cf754afffd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:41.519542 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbea643-36e2-4c5c-a036-82cf754afffd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:41.520284 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-d57d63ac-3b0f-48ca-a0f5-56bfb1a5d925 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:45:41.520284 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:41.520284 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:41.520284 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:41.520284 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:41.520284 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:41.520284 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:41.520284 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:41.520284 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:41.520284 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:41.520284 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:41.520284 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:41.520284 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:45:41.520284 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:45:41.520284 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:45:41.521214 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:45:41.521214 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:41.521214 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:41.521214 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:41.521214 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:41.521214 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:41.521214 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:41.521214 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:41.521214 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:41.521214 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:41.521214 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:41.521214 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:41.521214 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:41.521214 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:41.521214 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:41.521214 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:41.521214 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:41.522114 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:45:41.522114 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:45:41.522114 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:45:41.522114 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:45:41.522114 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:45:41.522114 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:45:41.522114 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:45:41.522114 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:41.522665 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbea643-36e2-4c5c-a036-82cf754afffd None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:41.530392 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 374/761] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 28 00:45:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:41.532604 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad9875-87ed-4a45-959f-aaf0006e228a None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:41.533112 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad9875-87ed-4a45-959f-aaf0006e228a None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:41.533584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad9875-87ed-4a45-959f-aaf0006e228a None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:41.535546 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 375/762] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:45:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:41.536576 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ad9875-87ed-4a45-959f-aaf0006e228a None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:41.537493 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-cbbea643-36e2-4c5c-a036-82cf754afffd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:45:41.537493 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:41.537493 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:41.537493 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:41.537493 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:41.537493 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:41.537493 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:41.537493 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:41.537493 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:41.537493 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:41.537493 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:41.537493 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:41.537493 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:45:41.537493 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:45:41.537493 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:45:41.538358 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:45:41.538358 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:41.538358 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:41.538358 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:41.538358 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:41.538358 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:41.538358 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:41.538358 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:41.538358 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:41.538358 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:41.538358 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:41.538358 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:41.538358 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:41.538358 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:41.538358 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:41.538358 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:41.538358 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:41.539278 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:45:41.539278 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:45:41.539278 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:45:41.539278 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:45:41.539278 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:45:41.539278 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:45:41.539278 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:45:41.539278 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:41.539278 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 388/763] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 28 00:45:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:45:41.545632 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb1c4d9-6ba9-422c-b69e-ed86e1dc3bd2 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:41.545934 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb1c4d9-6ba9-422c-b69e-ed86e1dc3bd2 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:41.546191 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb1c4d9-6ba9-422c-b69e-ed86e1dc3bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:41.566516 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-feb1c4d9-6ba9-422c-b69e-ed86e1dc3bd2 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:41.567860 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-feb1c4d9-6ba9-422c-b69e-ed86e1dc3bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:41.648865 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 389/764] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:45:41.649863 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb1c4d9-6ba9-422c-b69e-ed86e1dc3bd2 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:41.655059 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:41.661080 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ad9875-87ed-4a45-959f-aaf0006e228a None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:41.764560 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4627b007-665e-464e-b6da-552883296d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:41.765125 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627b007-665e-464e-b6da-552883296d7c None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:41.765405 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627b007-665e-464e-b6da-552883296d7c None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:41.765674 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627b007-665e-464e-b6da-552883296d7c None admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:41.766399 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4627b007-665e-464e-b6da-552883296d7c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:41.766708 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4627b007-665e-464e-b6da-552883296d7c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:41.767713 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb1c4d9-6ba9-422c-b69e-ed86e1dc3bd2 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:41.768258 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4627b007-665e-464e-b6da-552883296d7c None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:41.793987 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:41.796026 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 376/765] 10.222.0.49 () {56 vars in 1148 bytes} [Sun Aug 28 00:45:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:41.802187 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4627b007-665e-464e-b6da-552883296d7c None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:41.808774 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf7690-3ee1-45bb-8e52-1c8004a6f7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:41.809398 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf7690-3ee1-45bb-8e52-1c8004a6f7a8 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:41.809679 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf7690-3ee1-45bb-8e52-1c8004a6f7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:41.809952 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf7690-3ee1-45bb-8e52-1c8004a6f7a8 None admin] PATH_INFO: `/v3/projects` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:41.810780 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cf7690-3ee1-45bb-8e52-1c8004a6f7a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:41.811088 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cf7690-3ee1-45bb-8e52-1c8004a6f7a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:41.812572 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cf7690-3ee1-45bb-8e52-1c8004a6f7a8 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:41.826133 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 390/766] 10.222.0.49 () {56 vars in 1148 bytes} [Sun Aug 28 00:45:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:41.836989 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf7690-3ee1-45bb-8e52-1c8004a6f7a8 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:41.975376 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4627b007-665e-464e-b6da-552883296d7c None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:42.014431 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d68580-cef2-454a-8d54-8538d27b99ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:42.015110 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d68580-cef2-454a-8d54-8538d27b99ec None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:42.015695 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d68580-cef2-454a-8d54-8538d27b99ec None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:42.016142 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d68580-cef2-454a-8d54-8538d27b99ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:42.016898 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d68580-cef2-454a-8d54-8538d27b99ec None admin] RBAC: Adding query filter params (role.id=ab658a45d85b49319c5add69c508b564, scope.project.id=6d6e897c6391486e9c44e9277a3ee823, user.id=cbe0653ed0c04a9080b5c337392de8ad) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:42.017208 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d68580-cef2-454a-8d54-8538d27b99ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:42.018642 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d68580-cef2-454a-8d54-8538d27b99ec None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:42.019083 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf7690-3ee1-45bb-8e52-1c8004a6f7a8 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:42.026481 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 377/767] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 28 00:45:41 2022] GET /identity/v3/role_assignments?user.id=cbe0653ed0c04a9080b5c337392de8ad&scope.project.id=6d6e897c6391486e9c44e9277a3ee823&role.id=ab658a45d85b49319c5add69c508b564 => generated 259 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:42.069760 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0200fdc-212f-433a-8369-7ed5ef0e3825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:42.070513 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0200fdc-212f-433a-8369-7ed5ef0e3825 None admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:42.070791 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0200fdc-212f-433a-8369-7ed5ef0e3825 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:42.071117 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0200fdc-212f-433a-8369-7ed5ef0e3825 None admin] PATH_INFO: `/v3/projects/6d6e897c6391486e9c44e9277a3ee823/users/3dc0655c8156457a8fcb006c9fe85eb9/roles/2e4889bb71f9434392c0baba59f2534e` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:42.073354 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0200fdc-212f-433a-8369-7ed5ef0e3825 None admin] RBAC: Authorizing `identity:create_grant(project_id=6d6e897c6391486e9c44e9277a3ee823, user_id=3dc0655c8156457a8fcb006c9fe85eb9, role_id=2e4889bb71f9434392c0baba59f2534e)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:42.074995 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0200fdc-212f-433a-8369-7ed5ef0e3825 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:42.091462 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 391/768] 10.222.0.49 () {58 vars in 1439 bytes} [Sun Aug 28 00:45:41 2022] PUT /identity/v3/projects/6d6e897c6391486e9c44e9277a3ee823/users/3dc0655c8156457a8fcb006c9fe85eb9/roles/2e4889bb71f9434392c0baba59f2534e => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:45:42.121025 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d68580-cef2-454a-8d54-8538d27b99ec None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:42.161765 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:42.281666 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d68580-cef2-454a-8d54-8538d27b99ec None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:42.334291 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28867b9d-2baf-45f4-9090-8bf7c8c89799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:42.334941 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28867b9d-2baf-45f4-9090-8bf7c8c89799 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:42.335218 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28867b9d-2baf-45f4-9090-8bf7c8c89799 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:42.335492 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28867b9d-2baf-45f4-9090-8bf7c8c89799 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:42.336121 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28867b9d-2baf-45f4-9090-8bf7c8c89799 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:42.337503 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28867b9d-2baf-45f4-9090-8bf7c8c89799 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:42.352437 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-28867b9d-2baf-45f4-9090-8bf7c8c89799 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 28 00:45:42.352437 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:42.352437 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:45:42.352437 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:45:42.352437 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:45:42.352437 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:45:42.352437 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:45:42.352437 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:45:42.352437 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 28 00:45:42.352437 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:42.352437 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:45:42.352437 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:42.352437 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:42.352437 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:42.352437 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:42.352437 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:42.352437 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:42.353482 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:42.353482 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:42.353482 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:42.353482 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:42.353482 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:42.353482 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:42.353482 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:45:42.353482 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:45:42.353482 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:45:42.353482 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:45:42.353482 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:42.353482 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:42.353482 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:42.353482 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:42.353482 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:42.353482 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:42.354388 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:42.354388 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:42.354388 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:42.354388 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:42.354388 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:42.354388 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:42.354388 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:42.354388 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:42.354388 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:42.354388 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:42.354388 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:45:42.354388 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:45:42.354388 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 28 00:45:42.354388 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:42.354388 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 378/769] 10.222.0.49 () {56 vars in 1129 bytes} [Sun Aug 28 00:45:42 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:42.360896 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0200fdc-212f-433a-8369-7ed5ef0e3825 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:42.451328 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:42.561813 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0200fdc-212f-433a-8369-7ed5ef0e3825 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:42.629199 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77d2f3c-9485-4ae7-a00e-88c224a513d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:42.630220 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d2f3c-9485-4ae7-a00e-88c224a513d7 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:42.630699 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d2f3c-9485-4ae7-a00e-88c224a513d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:42.631175 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77d2f3c-9485-4ae7-a00e-88c224a513d7 None admin] PATH_INFO: `/v3/services` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:42.632306 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77d2f3c-9485-4ae7-a00e-88c224a513d7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:42.632806 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77d2f3c-9485-4ae7-a00e-88c224a513d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:42.635728 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77d2f3c-9485-4ae7-a00e-88c224a513d7 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:42.657172 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 392/770] 10.222.0.49 () {56 vars in 1124 bytes} [Sun Aug 28 00:45:42 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:45:42.666627 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28867b9d-2baf-45f4-9090-8bf7c8c89799 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:42.823156 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a98df0-666f-4712-85a7-5814aa054e06 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:42.823545 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a98df0-666f-4712-85a7-5814aa054e06 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:42.824050 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a98df0-666f-4712-85a7-5814aa054e06 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:42.826729 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 393/771] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:45:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:42.835895 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472b862-913f-4e19-870c-50b8d6bec655 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:42.836382 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472b862-913f-4e19-870c-50b8d6bec655 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:42.836853 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f472b862-913f-4e19-870c-50b8d6bec655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:42.866760 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-f472b862-913f-4e19-870c-50b8d6bec655 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:42.868793 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-f472b862-913f-4e19-870c-50b8d6bec655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:42.933015 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:42.969955 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28867b9d-2baf-45f4-9090-8bf7c8c89799 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:42.990747 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 394/772] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:45:43.037829 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7085096-a936-4a35-8c21-3065b14c7b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:43.038827 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7085096-a936-4a35-8c21-3065b14c7b74 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:43.039286 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7085096-a936-4a35-8c21-3065b14c7b74 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:43.039779 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7085096-a936-4a35-8c21-3065b14c7b74 None admin] PATH_INFO: `/v3/services` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:43.040619 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7085096-a936-4a35-8c21-3065b14c7b74 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:43.041095 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7085096-a936-4a35-8c21-3065b14c7b74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:43.042762 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7085096-a936-4a35-8c21-3065b14c7b74 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:43.053102 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 379/773] 10.222.0.49 () {56 vars in 1124 bytes} [Sun Aug 28 00:45:42 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:43.060257 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f472b862-913f-4e19-870c-50b8d6bec655 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:43.151943 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:43.232247 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f472b862-913f-4e19-870c-50b8d6bec655 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:43.273989 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c95b0-1c8f-43a6-b824-1d27f29d06d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:43.274614 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c95b0-1c8f-43a6-b824-1d27f29d06d6 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:43.274889 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c95b0-1c8f-43a6-b824-1d27f29d06d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:43.275160 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c95b0-1c8f-43a6-b824-1d27f29d06d6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:43.275973 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96c95b0-1c8f-43a6-b824-1d27f29d06d6 None admin] RBAC: Adding query filter params (interface=public, service_id=04977f3549f64c519438b7cbe882f8ba, region_id=RegionOne) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:43.276278 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96c95b0-1c8f-43a6-b824-1d27f29d06d6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:43.277731 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96c95b0-1c8f-43a6-b824-1d27f29d06d6 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:43.292227 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 395/774] 10.222.0.49 () {56 vars in 1251 bytes} [Sun Aug 28 00:45:43 2022] GET /identity/v3/endpoints?service_id=04977f3549f64c519438b7cbe882f8ba&interface=public®ion_id=RegionOne => generated 194 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:43.305045 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7085096-a936-4a35-8c21-3065b14c7b74 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:43.458140 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7085096-a936-4a35-8c21-3065b14c7b74 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:43.494622 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddc24da-cd4b-4e4a-9ca2-37512e6a65e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:43.495241 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc24da-cd4b-4e4a-9ca2-37512e6a65e4 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:43.495564 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc24da-cd4b-4e4a-9ca2-37512e6a65e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:43.495827 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddc24da-cd4b-4e4a-9ca2-37512e6a65e4 None admin] PATH_INFO: `/v3/services` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:43.496421 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddc24da-cd4b-4e4a-9ca2-37512e6a65e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:43.497795 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddc24da-cd4b-4e4a-9ca2-37512e6a65e4 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:43.503719 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 380/775] 10.222.0.49 () {56 vars in 1087 bytes} [Sun Aug 28 00:45:43 2022] GET /identity/v3/services => generated 772 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:43.705172 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c95b0-1c8f-43a6-b824-1d27f29d06d6 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:43.831345 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:43.836066 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c95b0-1c8f-43a6-b824-1d27f29d06d6 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:43.836493 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d42cf-99e5-4ed0-aa23-00cb894dba0a None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:43.836940 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d42cf-99e5-4ed0-aa23-00cb894dba0a None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:43.837305 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d42cf-99e5-4ed0-aa23-00cb894dba0a None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:43.839754 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 381/776] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:45:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:45:43.847152 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e87684a-70c1-4f8a-88b6-fb6de8aa02cc None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:43.847497 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e87684a-70c1-4f8a-88b6-fb6de8aa02cc None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:43.847767 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e87684a-70c1-4f8a-88b6-fb6de8aa02cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:43.869941 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-5e87684a-70c1-4f8a-88b6-fb6de8aa02cc None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:43.871482 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-5e87684a-70c1-4f8a-88b6-fb6de8aa02cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:43.881053 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f0fc8-3d27-40c8-9785-99cb4baffcad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:43.881701 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f0fc8-3d27-40c8-9785-99cb4baffcad None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:43.881980 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f0fc8-3d27-40c8-9785-99cb4baffcad None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:43.882251 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f0fc8-3d27-40c8-9785-99cb4baffcad None admin] PATH_INFO: `/v3/services/network` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:43.882855 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2f0fc8-3d27-40c8-9785-99cb4baffcad None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:43.884336 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2f0fc8-3d27-40c8-9785-99cb4baffcad None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:43.887640 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:43.897645 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-1d2f0fc8-3d27-40c8-9785-99cb4baffcad None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 28 00:45:43.897645 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:43.897645 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:45:43.897645 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:45:43.897645 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:45:43.897645 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:45:43.897645 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:45:43.897645 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:45:43.897645 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 28 00:45:43.897645 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:43.897645 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:45:43.897645 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:43.897645 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:43.897645 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:43.897645 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:43.897645 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:43.897645 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:43.898713 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:43.898713 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:43.898713 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:43.898713 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:43.898713 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:43.898713 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:43.898713 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:45:43.898713 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:45:43.898713 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:45:43.898713 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:45:43.898713 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:43.898713 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:43.898713 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:43.898713 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:43.898713 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:43.898713 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:43.899557 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:43.899557 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:43.899557 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:43.899557 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:43.899557 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:43.899557 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:43.899557 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:43.899557 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:43.899557 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:43.899557 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:43.899557 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:45:43.899557 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:45:43.899557 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 28 00:45:43.899557 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:43.899557 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 396/777] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 28 00:45:43 2022] GET /identity/v3/services/network => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:43.904837 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f0fc8-3d27-40c8-9785-99cb4baffcad None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:44.009854 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 382/778] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:45:44.020017 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f0fc8-3d27-40c8-9785-99cb4baffcad None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:44.056121 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce308ff0-8fe0-4b09-a39e-9543debfcf9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:44.056844 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce308ff0-8fe0-4b09-a39e-9543debfcf9d None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:44.057188 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce308ff0-8fe0-4b09-a39e-9543debfcf9d None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:44.057462 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce308ff0-8fe0-4b09-a39e-9543debfcf9d None admin] PATH_INFO: `/v3/services` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:44.058114 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce308ff0-8fe0-4b09-a39e-9543debfcf9d None admin] RBAC: Adding query filter params (name=network) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:44.058414 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce308ff0-8fe0-4b09-a39e-9543debfcf9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:44.059835 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce308ff0-8fe0-4b09-a39e-9543debfcf9d None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:44.065319 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 397/779] 10.222.0.49 () {56 vars in 1112 bytes} [Sun Aug 28 00:45:43 2022] GET /identity/v3/services?name=network => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:45:44.071243 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e87684a-70c1-4f8a-88b6-fb6de8aa02cc None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:44.198197 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e87684a-70c1-4f8a-88b6-fb6de8aa02cc None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:44.248156 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048fd939-890e-4846-904e-6aea8b92d778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:44.248858 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048fd939-890e-4846-904e-6aea8b92d778 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:44.249142 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048fd939-890e-4846-904e-6aea8b92d778 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:44.249398 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048fd939-890e-4846-904e-6aea8b92d778 None admin] PATH_INFO: `/v3/services` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:44.250090 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048fd939-890e-4846-904e-6aea8b92d778 None admin] RBAC: Adding query filter params (type=network) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:44.250389 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048fd939-890e-4846-904e-6aea8b92d778 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:44.251901 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048fd939-890e-4846-904e-6aea8b92d778 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:44.261304 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 383/780] 10.222.0.49 () {56 vars in 1112 bytes} [Sun Aug 28 00:45:44 2022] GET /identity/v3/services?type=network => generated 350 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:44.267390 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce308ff0-8fe0-4b09-a39e-9543debfcf9d None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:44.303370 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:44.329805 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39289b75-4b32-4828-ab49-5116ec495078 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:44.330542 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39289b75-4b32-4828-ab49-5116ec495078 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:44.330878 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39289b75-4b32-4828-ab49-5116ec495078 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:44.332946 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 384/781] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:45:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:44.347303 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e560f-2142-4fe7-b302-de021376eff1 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:44.348051 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e560f-2142-4fe7-b302-de021376eff1 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:44.348750 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e560f-2142-4fe7-b302-de021376eff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:44.371201 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-db3e560f-2142-4fe7-b302-de021376eff1 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:44.372944 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-db3e560f-2142-4fe7-b302-de021376eff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:44.375360 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:44.454176 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 385/782] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:45:44.462924 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce308ff0-8fe0-4b09-a39e-9543debfcf9d None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:44.477877 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3e560f-2142-4fe7-b302-de021376eff1 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:44.554644 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f807b5-59f2-4aee-a822-6e19278ff0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:44.555191 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f807b5-59f2-4aee-a822-6e19278ff0d8 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:44.555561 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f807b5-59f2-4aee-a822-6e19278ff0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:44.555760 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f807b5-59f2-4aee-a822-6e19278ff0d8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:44.556469 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f807b5-59f2-4aee-a822-6e19278ff0d8 None admin] RBAC: Adding query filter params (interface=public, service_id=e47d47a2440942188a42c73a21fc7055, region_id=RegionOne) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:44.556773 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f807b5-59f2-4aee-a822-6e19278ff0d8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:44.558258 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f807b5-59f2-4aee-a822-6e19278ff0d8 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:44.574123 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 398/783] 10.222.0.49 () {56 vars in 1251 bytes} [Sun Aug 28 00:45:44 2022] GET /identity/v3/endpoints?service_id=e47d47a2440942188a42c73a21fc7055&interface=public®ion_id=RegionOne => generated 194 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:44.579855 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f807b5-59f2-4aee-a822-6e19278ff0d8 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:44.594057 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3e560f-2142-4fe7-b302-de021376eff1 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:44.638823 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d8b40-b227-478b-8b8d-1f84a870af99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:44.640498 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d8b40-b227-478b-8b8d-1f84a870af99 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:44.641296 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d8b40-b227-478b-8b8d-1f84a870af99 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:44.642120 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d8b40-b227-478b-8b8d-1f84a870af99 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:44.651795 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:44.659140 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802d8b40-b227-478b-8b8d-1f84a870af99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:45:44.664586 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-802d8b40-b227-478b-8b8d-1f84a870af99 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:45:44.664586 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:44.664586 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:44.664586 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:44.664586 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:44.664586 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:44.664586 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:44.664586 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:44.664586 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:44.664586 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:44.664586 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:44.664586 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:44.664586 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:45:44.664586 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:45:44.664586 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:45:44.664586 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:45:44.665579 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:45:44.665579 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:45:44.665579 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:45:44.665579 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:45:44.665579 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:44.665579 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:44.665579 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:44.665579 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:44.665579 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:44.665579 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:44.665579 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:44.665579 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:44.665579 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:44.665579 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:44.665579 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:44.665579 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:44.666484 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:44.666484 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:44.666484 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:44.666484 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:44.666484 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:45:44.666484 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:45:44.666484 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:45:44.666484 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:45:44.666484 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:45:44.666484 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:45:44.666484 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:45:44.666484 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:44.670540 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 386/784] 10.222.0.49 () {56 vars in 1096 bytes} [Sun Aug 28 00:45:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:44.677953 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d8b40-b227-478b-8b8d-1f84a870af99 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:44.789575 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d8b40-b227-478b-8b8d-1f84a870af99 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:44.816170 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:44.829434 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f828c29-e3d3-4a2f-9bbf-0f66f4efb4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:44.830773 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f828c29-e3d3-4a2f-9bbf-0f66f4efb4e5 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:44.831328 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f828c29-e3d3-4a2f-9bbf-0f66f4efb4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:44.831868 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f828c29-e3d3-4a2f-9bbf-0f66f4efb4e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:44.833260 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f828c29-e3d3-4a2f-9bbf-0f66f4efb4e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:44.834069 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f828c29-e3d3-4a2f-9bbf-0f66f4efb4e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:44.835702 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f828c29-e3d3-4a2f-9bbf-0f66f4efb4e5 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:44.835893 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f807b5-59f2-4aee-a822-6e19278ff0d8 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:44.848020 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 387/785] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 28 00:45:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:44.848814 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f828c29-e3d3-4a2f-9bbf-0f66f4efb4e5 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:44.879784 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b009bd-de4e-4bfa-b962-6b9810fb84e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:44.880707 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b009bd-de4e-4bfa-b962-6b9810fb84e8 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:44.880997 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b009bd-de4e-4bfa-b962-6b9810fb84e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:44.881649 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b009bd-de4e-4bfa-b962-6b9810fb84e8 None admin] PATH_INFO: `/v3/services` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:44.882314 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b009bd-de4e-4bfa-b962-6b9810fb84e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:44.883773 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b009bd-de4e-4bfa-b962-6b9810fb84e8 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:44.894903 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 399/786] 10.222.0.49 () {56 vars in 1087 bytes} [Sun Aug 28 00:45:44 2022] GET /identity/v3/services => generated 772 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:45:44.894903 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8fe66-f2a8-44aa-87e3-1089b5662571 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:44.894903 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8fe66-f2a8-44aa-87e3-1089b5662571 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:44.894903 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8fe66-f2a8-44aa-87e3-1089b5662571 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:44.894903 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 400/787] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:45:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:44.894903 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e8fe66-f2a8-44aa-87e3-1089b5662571 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:44.936530 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:44.991488 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f828c29-e3d3-4a2f-9bbf-0f66f4efb4e5 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:45.039848 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e8fe66-f2a8-44aa-87e3-1089b5662571 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:45.046166 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6e3457-573b-4dd7-9715-e8c9d0a5ff74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:45.047235 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e3457-573b-4dd7-9715-e8c9d0a5ff74 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:45.047758 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e3457-573b-4dd7-9715-e8c9d0a5ff74 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:45.048240 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e3457-573b-4dd7-9715-e8c9d0a5ff74 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:45.061822 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6e3457-573b-4dd7-9715-e8c9d0a5ff74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:45:45.068556 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-5e6e3457-573b-4dd7-9715-e8c9d0a5ff74 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:45:45.068556 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:45.068556 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:45.068556 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:45.068556 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:45.068556 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:45.068556 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:45.068556 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:45.068556 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:45.068556 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:45.068556 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:45.068556 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:45.068556 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:45:45.068556 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:45:45.068556 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:45:45.068556 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:45:45.069542 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:45:45.069542 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:45:45.069542 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:45:45.069542 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:45:45.069542 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:45.069542 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:45.069542 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:45.069542 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:45.069542 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:45.069542 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:45.069542 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:45.069542 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:45.069542 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:45.069542 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:45.069542 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:45.069542 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:45.070404 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:45.070404 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:45.070404 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:45.070404 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:45.070404 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:45:45.070404 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:45:45.070404 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:45:45.070404 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:45:45.070404 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:45:45.070404 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:45:45.070404 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:45:45.070404 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:45.072381 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 388/788] 10.222.0.49 () {56 vars in 1102 bytes} [Sun Aug 28 00:45:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:45.073936 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48bf1b0-e91e-461f-8f97-8605bdaffdde None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:45.074209 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48bf1b0-e91e-461f-8f97-8605bdaffdde None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:45.074563 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48bf1b0-e91e-461f-8f97-8605bdaffdde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:45.092228 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f7009-5438-4b5c-8709-400ee5fb70bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:45.092928 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f7009-5438-4b5c-8709-400ee5fb70bf None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:45.093756 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f7009-5438-4b5c-8709-400ee5fb70bf None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:45.093756 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f7009-5438-4b5c-8709-400ee5fb70bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:45.094710 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-c48bf1b0-e91e-461f-8f97-8605bdaffdde None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:45.095960 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-c48bf1b0-e91e-461f-8f97-8605bdaffdde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:45.108071 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8f7009-5438-4b5c-8709-400ee5fb70bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:45.109664 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8f7009-5438-4b5c-8709-400ee5fb70bf None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:45.126135 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-7a8f7009-5438-4b5c-8709-400ee5fb70bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:45.126135 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:45.126135 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:45.126135 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:45.126135 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:45.126135 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:45.126135 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:45.126135 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:45.126135 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:45.126135 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:45.126135 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:45.126135 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:45.126135 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:45:45.126135 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:45:45.126135 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:45:45.126135 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:45:45.127142 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:45.127142 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:45.127142 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:45.127142 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:45.127142 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:45.127142 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:45.127142 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:45.127142 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:45.127142 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:45.127142 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:45.127142 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:45.127142 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:45.127142 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:45.127142 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:45.127142 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:45.127142 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:45.127142 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:45:45.128099 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:45:45.128099 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:45.128099 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:45.128099 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 401/789] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:45.132843 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f7009-5438-4b5c-8709-400ee5fb70bf None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:45.146591 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:45.184804 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 389/790] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:45:45.186137 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48bf1b0-e91e-461f-8f97-8605bdaffdde None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:45.246266 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:45.254532 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f7009-5438-4b5c-8709-400ee5fb70bf None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:45.296901 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dacc8e1-d995-4234-9e04-688acbf020a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:45.297237 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dacc8e1-d995-4234-9e04-688acbf020a8 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:45.297635 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dacc8e1-d995-4234-9e04-688acbf020a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:45.297980 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dacc8e1-d995-4234-9e04-688acbf020a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:45.298810 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dacc8e1-d995-4234-9e04-688acbf020a8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:45.299124 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dacc8e1-d995-4234-9e04-688acbf020a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:45.300677 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dacc8e1-d995-4234-9e04-688acbf020a8 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:45.310597 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 402/791] 10.222.0.49 () {56 vars in 1103 bytes} [Sun Aug 28 00:45:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:45.316463 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dacc8e1-d995-4234-9e04-688acbf020a8 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:45.323779 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48bf1b0-e91e-461f-8f97-8605bdaffdde None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:45.393736 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59355a5-0fed-480a-add8-e4406bef1c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:45.394372 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59355a5-0fed-480a-add8-e4406bef1c31 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:45.394650 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59355a5-0fed-480a-add8-e4406bef1c31 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:45.394920 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59355a5-0fed-480a-add8-e4406bef1c31 None admin] PATH_INFO: `/v3/domains` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:45.395681 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59355a5-0fed-480a-add8-e4406bef1c31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:45.396051 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59355a5-0fed-480a-add8-e4406bef1c31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:45.398063 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59355a5-0fed-480a-add8-e4406bef1c31 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:45.419953 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 390/792] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:45:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:45.426777 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59355a5-0fed-480a-add8-e4406bef1c31 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:45.473168 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:45.547144 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dacc8e1-d995-4234-9e04-688acbf020a8 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:45.576218 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59355a5-0fed-480a-add8-e4406bef1c31 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:45.589437 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:45.604821 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b989e-da07-47f7-8127-e294365f154b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:45.606640 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b989e-da07-47f7-8127-e294365f154b None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:45.607142 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b989e-da07-47f7-8127-e294365f154b None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:45.607788 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b989e-da07-47f7-8127-e294365f154b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:45.619060 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dba3af-e7ee-462b-a8f1-9b7c7b1580f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:45.619918 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dba3af-e7ee-462b-a8f1-9b7c7b1580f2 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:45.620259 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dba3af-e7ee-462b-a8f1-9b7c7b1580f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:45.620595 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dba3af-e7ee-462b-a8f1-9b7c7b1580f2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:45.625127 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678b989e-da07-47f7-8127-e294365f154b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:45.627082 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678b989e-da07-47f7-8127-e294365f154b None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:45.630006 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dba3af-e7ee-462b-a8f1-9b7c7b1580f2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:45.632084 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dba3af-e7ee-462b-a8f1-9b7c7b1580f2 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:45.645246 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-74dba3af-e7ee-462b-a8f1-9b7c7b1580f2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 28 00:45:45.645246 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:45.645246 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:45.645246 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:45.645246 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:45.645246 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:45.645246 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:45.645246 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:45.645246 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:45.645246 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:45.645246 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:45.645246 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:45.645246 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:45:45.645246 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:45:45.645246 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:45:45.645246 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:45:45.646272 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:45.646272 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:45.646272 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:45:45.646272 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:45:45.646272 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:45:45.646272 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:45:45.646272 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:45.646272 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:45.646272 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:45.646272 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:45.646272 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:45.646272 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:45.646272 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:45.646272 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:45.646272 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:45.646272 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:45.646272 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:45.646272 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:45.647204 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:45.647204 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:45.647204 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:45:45.647204 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:45:45.647204 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:45:45.647204 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:45:45.647204 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:45:45.647204 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:45:45.647204 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 28 00:45:45.647204 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:45.649269 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-678b989e-da07-47f7-8127-e294365f154b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:45.649269 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:45.649269 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:45.649269 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:45.649269 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:45.649269 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:45.649269 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:45.649269 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:45.649269 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:45.649269 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:45.649269 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:45.649269 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:45.649269 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:45:45.649269 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:45:45.649269 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:45:45.649269 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:45:45.650193 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:45.650193 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:45.650193 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:45.650193 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:45.650193 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:45.650193 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:45.650193 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:45.650193 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:45.650193 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:45.650193 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:45.650193 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:45.650193 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:45.650193 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:45.650193 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:45.650193 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:45.650193 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:45.650193 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:45:45.651163 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:45:45.651163 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:45.651163 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:45.651973 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 391/793] 10.222.0.49 () {56 vars in 1096 bytes} [Sun Aug 28 00:45:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:45.653074 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dba3af-e7ee-462b-a8f1-9b7c7b1580f2 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:45.653587 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 403/794] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:45:45.659180 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b989e-da07-47f7-8127-e294365f154b None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:45.794884 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b989e-da07-47f7-8127-e294365f154b None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:45.798141 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dba3af-e7ee-462b-a8f1-9b7c7b1580f2 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:45.819078 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:45.832964 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dfa0e1-5c73-47f5-a68d-d0d8a1776e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:45.833516 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dfa0e1-5c73-47f5-a68d-d0d8a1776e93 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:45.833858 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dfa0e1-5c73-47f5-a68d-d0d8a1776e93 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:45.834229 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dfa0e1-5c73-47f5-a68d-d0d8a1776e93 None admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:45.835218 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dfa0e1-5c73-47f5-a68d-d0d8a1776e93 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:45.835526 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dfa0e1-5c73-47f5-a68d-d0d8a1776e93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:45.837038 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dfa0e1-5c73-47f5-a68d-d0d8a1776e93 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:45.839232 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f3cf5e-fc74-4f08-a8ee-9efd1dcbdf34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:45.840303 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f3cf5e-fc74-4f08-a8ee-9efd1dcbdf34 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:45.840792 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f3cf5e-fc74-4f08-a8ee-9efd1dcbdf34 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:45.841379 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f3cf5e-fc74-4f08-a8ee-9efd1dcbdf34 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:45.853628 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f3cf5e-fc74-4f08-a8ee-9efd1dcbdf34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:45:45.860098 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-36f3cf5e-fc74-4f08-a8ee-9efd1dcbdf34 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:45:45.860098 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:45.860098 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:45.860098 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:45.860098 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:45.860098 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:45.860098 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:45.860098 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:45.860098 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:45.860098 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:45.860098 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:45.860098 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:45.860098 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:45:45.860098 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:45:45.860098 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:45:45.860098 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:45:45.861160 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:45:45.861160 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:45:45.861160 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:45:45.861160 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:45:45.861160 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:45.861160 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:45.861160 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:45.861160 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:45.861160 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:45.861160 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:45.861160 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:45.861160 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:45.861160 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:45.861160 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:45.861160 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:45.861160 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:45.861991 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:45.861991 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:45.861991 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:45.861991 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:45.861991 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:45:45.861991 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:45:45.861991 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:45:45.861991 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:45:45.861991 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:45:45.861991 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:45:45.861991 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:45:45.861991 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:45.863183 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 404/795] 10.222.0.49 () {56 vars in 1135 bytes} [Sun Aug 28 00:45:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:45.864140 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dfa0e1-5c73-47f5-a68d-d0d8a1776e93 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:45.865168 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 392/796] 10.222.0.49 () {56 vars in 1096 bytes} [Sun Aug 28 00:45:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:45.866396 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f3cf5e-fc74-4f08-a8ee-9efd1dcbdf34 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:45.904139 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:45.989820 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dfa0e1-5c73-47f5-a68d-d0d8a1776e93 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:45.995925 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f3cf5e-fc74-4f08-a8ee-9efd1dcbdf34 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:46.035756 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62deae38-1450-4990-8a6b-1c6a00903ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:46.036504 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62deae38-1450-4990-8a6b-1c6a00903ca5 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:46.036783 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62deae38-1450-4990-8a6b-1c6a00903ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:46.037167 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62deae38-1450-4990-8a6b-1c6a00903ca5 None admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:46.037861 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62deae38-1450-4990-8a6b-1c6a00903ca5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:46.038164 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62deae38-1450-4990-8a6b-1c6a00903ca5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:46.039799 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62deae38-1450-4990-8a6b-1c6a00903ca5 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:46.040153 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db17c44-51ef-47a5-a4ef-03e57063c7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:46.041048 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db17c44-51ef-47a5-a4ef-03e57063c7f1 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:46.041696 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db17c44-51ef-47a5-a4ef-03e57063c7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:46.042182 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db17c44-51ef-47a5-a4ef-03e57063c7f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:46.055246 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db17c44-51ef-47a5-a4ef-03e57063c7f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:46.061422 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 405/797] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:45:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:46.061422 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62deae38-1450-4990-8a6b-1c6a00903ca5 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:46.062714 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db17c44-51ef-47a5-a4ef-03e57063c7f1 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:46.081506 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-6db17c44-51ef-47a5-a4ef-03e57063c7f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:46.081506 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:46.081506 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:46.081506 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:46.081506 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:46.081506 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:46.081506 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:46.081506 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:46.081506 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:46.081506 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:46.081506 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:46.081506 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:46.081506 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:45:46.081506 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:45:46.081506 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:45:46.081506 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:45:46.082657 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:46.082657 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:46.082657 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:46.082657 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:46.082657 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:46.082657 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:46.082657 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:46.082657 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:46.082657 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:46.082657 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:46.082657 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:46.082657 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:46.082657 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:46.082657 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:46.082657 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:46.082657 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:46.082657 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:45:46.083764 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:45:46.083764 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:46.083764 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:46.085998 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 393/798] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:46.087175 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db17c44-51ef-47a5-a4ef-03e57063c7f1 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:46.120150 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:46.196100 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:46.219278 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62deae38-1450-4990-8a6b-1c6a00903ca5 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:46.220977 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db17c44-51ef-47a5-a4ef-03e57063c7f1 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:46.264910 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0064612-f76b-4a13-a164-6c24cb81e8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:46.265534 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b3e156-971c-40cf-b8b6-8912516221fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:46.265748 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0064612-f76b-4a13-a164-6c24cb81e8d5 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:46.266197 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3e156-971c-40cf-b8b6-8912516221fa None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:46.266357 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0064612-f76b-4a13-a164-6c24cb81e8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:46.266529 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3e156-971c-40cf-b8b6-8912516221fa None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:46.266698 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0064612-f76b-4a13-a164-6c24cb81e8d5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:46.266979 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3e156-971c-40cf-b8b6-8912516221fa None admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:46.267375 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b3e156-971c-40cf-b8b6-8912516221fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:46.267705 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b3e156-971c-40cf-b8b6-8912516221fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:46.269093 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b3e156-971c-40cf-b8b6-8912516221fa None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:46.278333 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0064612-f76b-4a13-a164-6c24cb81e8d5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:46.285548 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 406/799] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 28 00:45:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:46.285548 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b3e156-971c-40cf-b8b6-8912516221fa None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:46.285793 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0064612-f76b-4a13-a164-6c24cb81e8d5 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:46.299445 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-f0064612-f76b-4a13-a164-6c24cb81e8d5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 00:45:46.299445 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:46.299445 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:46.299445 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:46.299445 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:46.299445 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:46.299445 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:46.299445 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:46.299445 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:46.299445 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:46.299445 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:46.299445 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:46.299445 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:45:46.299445 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:45:46.299445 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:45:46.299445 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:45:46.300843 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:46.300843 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:46.300843 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:45:46.300843 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:45:46.300843 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:45:46.300843 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:45:46.300843 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:46.300843 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:46.300843 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:46.300843 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:46.300843 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:46.300843 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:46.300843 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:46.300843 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:46.300843 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:46.300843 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:46.300843 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:46.300843 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:46.302137 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:46.302137 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:46.302137 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:45:46.302137 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:45:46.302137 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:45:46.302137 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:45:46.302137 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:45:46.302137 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:45:46.302137 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 00:45:46.302137 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:46.302137 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 394/800] 10.222.0.49 () {56 vars in 1117 bytes} [Sun Aug 28 00:45:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:46.302137 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a06e5-7409-4e1d-8b3f-a2def0ce5e67 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:46.302137 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a06e5-7409-4e1d-8b3f-a2def0ce5e67 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:46.302978 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a06e5-7409-4e1d-8b3f-a2def0ce5e67 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:46.308025 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 395/801] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:45:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:46.310059 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a06e5-7409-4e1d-8b3f-a2def0ce5e67 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:46.426679 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b3e156-971c-40cf-b8b6-8912516221fa None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:46.428575 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:46.456138 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a06e5-7409-4e1d-8b3f-a2def0ce5e67 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:46.479153 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bf841d-07ac-4549-a5ee-96c65c4c3afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:46.479836 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf841d-07ac-4549-a5ee-96c65c4c3afe None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:46.480150 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf841d-07ac-4549-a5ee-96c65c4c3afe None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:46.480526 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bf841d-07ac-4549-a5ee-96c65c4c3afe None admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:46.481231 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bf841d-07ac-4549-a5ee-96c65c4c3afe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:46.481568 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bf841d-07ac-4549-a5ee-96c65c4c3afe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:46.483026 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bf841d-07ac-4549-a5ee-96c65c4c3afe None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:46.502127 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 407/802] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:45:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:46.503423 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bf841d-07ac-4549-a5ee-96c65c4c3afe None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:46.509685 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63729fa2-2f6a-43b1-b49b-404beb8a30a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:46.510797 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63729fa2-2f6a-43b1-b49b-404beb8a30a8 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:46.511548 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63729fa2-2f6a-43b1-b49b-404beb8a30a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:46.512253 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63729fa2-2f6a-43b1-b49b-404beb8a30a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:46.532674 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63729fa2-2f6a-43b1-b49b-404beb8a30a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:46.535431 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63729fa2-2f6a-43b1-b49b-404beb8a30a8 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:46.538046 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:46.556553 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-63729fa2-2f6a-43b1-b49b-404beb8a30a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:46.556553 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:46.556553 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:46.556553 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:46.556553 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:46.556553 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:46.556553 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:46.556553 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:46.556553 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:46.556553 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:46.556553 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:46.556553 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:46.556553 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:45:46.556553 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:45:46.556553 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:45:46.556553 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:45:46.558059 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:46.558059 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:46.558059 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:46.558059 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:46.558059 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:46.558059 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:46.558059 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:46.558059 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:46.558059 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:46.558059 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:46.558059 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:46.558059 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:46.558059 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:46.558059 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:46.558059 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:46.558059 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:46.558059 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:45:46.559162 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:45:46.559162 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:46.559162 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:46.559162 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 396/803] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:46.559959 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9edeca-9cca-400f-839e-03b72a168bf2 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:46.559959 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9edeca-9cca-400f-839e-03b72a168bf2 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:46.560230 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9edeca-9cca-400f-839e-03b72a168bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:46.585892 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-9f9edeca-9cca-400f-839e-03b72a168bf2 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:46.587401 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-9f9edeca-9cca-400f-839e-03b72a168bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:46.648188 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bf841d-07ac-4549-a5ee-96c65c4c3afe None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:46.691722 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 397/804] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:45:46.692497 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9edeca-9cca-400f-839e-03b72a168bf2 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:46.711060 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f732db-6cd0-49e9-a72d-81110fcb1e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:46.711815 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f732db-6cd0-49e9-a72d-81110fcb1e11 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:46.712097 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f732db-6cd0-49e9-a72d-81110fcb1e11 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:46.712465 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f732db-6cd0-49e9-a72d-81110fcb1e11 None admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:46.713186 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f732db-6cd0-49e9-a72d-81110fcb1e11 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:46.713590 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f732db-6cd0-49e9-a72d-81110fcb1e11 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:46.715144 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f732db-6cd0-49e9-a72d-81110fcb1e11 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:46.742494 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 408/805] 10.222.0.49 () {56 vars in 1149 bytes} [Sun Aug 28 00:45:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:46.743778 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f732db-6cd0-49e9-a72d-81110fcb1e11 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:46.772210 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:46.879266 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9edeca-9cca-400f-839e-03b72a168bf2 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:46.906710 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:46.908826 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f732db-6cd0-49e9-a72d-81110fcb1e11 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:46.919915 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c9bc0-bb9a-47f8-b63d-65b435bb3c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:46.920926 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c9bc0-bb9a-47f8-b63d-65b435bb3c05 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:46.921404 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c9bc0-bb9a-47f8-b63d-65b435bb3c05 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:46.921871 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c9bc0-bb9a-47f8-b63d-65b435bb3c05 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:46.929787 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57c9bc0-bb9a-47f8-b63d-65b435bb3c05 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:46.931593 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57c9bc0-bb9a-47f8-b63d-65b435bb3c05 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:46.946137 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-d57c9bc0-bb9a-47f8-b63d-65b435bb3c05 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:45:46.946137 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:46.946137 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:46.946137 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:46.946137 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:46.946137 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:46.946137 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:46.946137 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:46.946137 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:46.946137 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:46.946137 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:46.946137 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:46.946137 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:45:46.946137 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:45:46.946137 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:45:46.947085 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:45:46.947085 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:46.947085 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:46.947085 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:46.947085 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:46.947085 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:46.947085 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:46.947085 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:46.947085 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:46.947085 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:46.947085 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:46.947085 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:46.947085 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:46.947085 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:46.947085 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:46.947085 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:46.947085 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:46.948444 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:45:46.948444 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:45:46.948444 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:45:46.948444 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:45:46.948444 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:45:46.948444 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:45:46.948444 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:45:46.948444 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:46.948890 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272ce600-7e7c-468c-b86c-9b3dfbcff4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:46.948890 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ce600-7e7c-468c-b86c-9b3dfbcff4f1 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:46.948890 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ce600-7e7c-468c-b86c-9b3dfbcff4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:46.948890 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ce600-7e7c-468c-b86c-9b3dfbcff4f1 None admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:46.949159 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272ce600-7e7c-468c-b86c-9b3dfbcff4f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:46.949480 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272ce600-7e7c-468c-b86c-9b3dfbcff4f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:46.950935 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272ce600-7e7c-468c-b86c-9b3dfbcff4f1 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:46.951415 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 398/806] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 28 00:45:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:46.952470 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c9bc0-bb9a-47f8-b63d-65b435bb3c05 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:46.972983 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 409/807] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:45:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:46.974193 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272ce600-7e7c-468c-b86c-9b3dfbcff4f1 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:47.088520 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:47.097697 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c9bc0-bb9a-47f8-b63d-65b435bb3c05 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:47.112525 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272ce600-7e7c-468c-b86c-9b3dfbcff4f1 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:47.135977 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f581e34-4501-4d10-bfe9-ac772a25faf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:47.136626 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f581e34-4501-4d10-bfe9-ac772a25faf1 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:47.136908 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f581e34-4501-4d10-bfe9-ac772a25faf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:47.137177 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f581e34-4501-4d10-bfe9-ac772a25faf1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:47.149375 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f581e34-4501-4d10-bfe9-ac772a25faf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:47.151158 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f581e34-4501-4d10-bfe9-ac772a25faf1 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:47.153086 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f979933-feb4-4823-8062-26120f2aaa03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:47.153839 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f979933-feb4-4823-8062-26120f2aaa03 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:47.154204 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f979933-feb4-4823-8062-26120f2aaa03 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:47.154562 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f979933-feb4-4823-8062-26120f2aaa03 None admin] PATH_INFO: `/v3/projects` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:47.155353 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f979933-feb4-4823-8062-26120f2aaa03 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:47.155692 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f979933-feb4-4823-8062-26120f2aaa03 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:47.157364 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f979933-feb4-4823-8062-26120f2aaa03 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:47.168297 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-9f581e34-4501-4d10-bfe9-ac772a25faf1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:47.168297 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:47.168297 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:47.168297 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:47.168297 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:47.168297 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:47.168297 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:47.168297 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:47.168297 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:47.168297 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:47.168297 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:47.168297 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:47.168297 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:45:47.168297 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:45:47.168297 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:45:47.168297 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:45:47.169584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:47.169584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:47.169584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:47.169584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:47.169584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:47.169584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:47.169584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:47.169584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:47.169584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:47.169584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:47.169584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:47.169584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:47.169584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:47.169584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:47.169584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:47.169584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:47.169584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:45:47.172351 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:45:47.172351 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:47.172351 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:47.172351 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 399/808] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:47.172351 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f581e34-4501-4d10-bfe9-ac772a25faf1 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:47.173134 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 410/809] 10.222.0.49 () {56 vars in 1148 bytes} [Sun Aug 28 00:45:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:47.173134 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f979933-feb4-4823-8062-26120f2aaa03 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:47.219181 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:47.297045 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f581e34-4501-4d10-bfe9-ac772a25faf1 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:47.308053 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f979933-feb4-4823-8062-26120f2aaa03 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:47.339401 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda4d969-eef2-4bc6-bb01-791a960fbc1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:47.340486 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda4d969-eef2-4bc6-bb01-791a960fbc1c None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:47.340971 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda4d969-eef2-4bc6-bb01-791a960fbc1c None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:47.341443 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda4d969-eef2-4bc6-bb01-791a960fbc1c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:47.345506 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2363bc18-36fb-46b1-b983-0abf7f5f139c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:47.346425 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363bc18-36fb-46b1-b983-0abf7f5f139c None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:47.346835 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363bc18-36fb-46b1-b983-0abf7f5f139c None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:47.347234 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363bc18-36fb-46b1-b983-0abf7f5f139c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:47.348179 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2363bc18-36fb-46b1-b983-0abf7f5f139c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:47.350380 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2363bc18-36fb-46b1-b983-0abf7f5f139c None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:47.355383 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda4d969-eef2-4bc6-bb01-791a960fbc1c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:47.358206 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda4d969-eef2-4bc6-bb01-791a960fbc1c None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:47.364243 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-2363bc18-36fb-46b1-b983-0abf7f5f139c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 28 00:45:47.364243 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:47.364243 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:45:47.364243 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:45:47.364243 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:45:47.364243 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:45:47.364243 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:45:47.364243 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:45:47.364243 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 28 00:45:47.364243 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:47.364243 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:45:47.364243 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:47.364243 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:47.364243 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:47.364243 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:47.364243 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:47.364243 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:47.365227 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:47.365227 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:47.365227 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:47.365227 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:47.365227 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:47.365227 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:47.365227 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:45:47.365227 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:45:47.365227 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:45:47.365227 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:45:47.365227 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:47.365227 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:47.365227 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:47.365227 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:47.365227 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:47.365227 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:47.366108 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:47.366108 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:47.366108 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:47.366108 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:47.366108 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:47.366108 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:47.366108 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:47.366108 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:47.366108 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:47.366108 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:47.366108 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:45:47.366108 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:45:47.366108 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 28 00:45:47.366108 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:47.366847 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 411/810] 10.222.0.49 () {56 vars in 1129 bytes} [Sun Aug 28 00:45:47 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:47.368212 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f89b76-7696-42d4-b375-ea39762c6373 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:47.368715 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f89b76-7696-42d4-b375-ea39762c6373 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:47.369236 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f89b76-7696-42d4-b375-ea39762c6373 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:47.372024 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 412/811] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:45:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:47.373385 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f89b76-7696-42d4-b375-ea39762c6373 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:47.377397 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-cda4d969-eef2-4bc6-bb01-791a960fbc1c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 28 00:45:47.377397 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:47.377397 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:47.377397 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:47.377397 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:47.377397 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:47.377397 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:47.377397 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:47.377397 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:47.377397 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:47.377397 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:47.377397 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:47.377397 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:45:47.377397 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:45:47.377397 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:45:47.377397 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:45:47.379461 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:47.379461 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:47.379461 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:45:47.379461 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:45:47.379461 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:45:47.379461 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:45:47.379461 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:47.379461 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:47.379461 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:47.379461 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:47.379461 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:47.379461 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:47.379461 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:47.379461 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:47.379461 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:47.379461 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:47.379461 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:47.379461 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:47.382712 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:47.382712 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:47.382712 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:45:47.382712 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:45:47.382712 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:45:47.382712 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:45:47.382712 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:45:47.382712 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:45:47.382712 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 28 00:45:47.382712 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:47.382712 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 400/812] 10.222.0.49 () {56 vars in 1093 bytes} [Sun Aug 28 00:45:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:47.382712 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda4d969-eef2-4bc6-bb01-791a960fbc1c None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:47.384093 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:47.505213 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:47.512065 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda4d969-eef2-4bc6-bb01-791a960fbc1c None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:47.512894 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f89b76-7696-42d4-b375-ea39762c6373 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:47.559027 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e900e-d548-48a3-9d20-8fe060b82b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:47.559910 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e900e-d548-48a3-9d20-8fe060b82b97 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:47.560239 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e900e-d548-48a3-9d20-8fe060b82b97 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:47.560563 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e900e-d548-48a3-9d20-8fe060b82b97 None admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:47.561288 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be6d05c-6a11-4dff-9d84-0056722f2600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:47.561599 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385e900e-d548-48a3-9d20-8fe060b82b97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:47.562003 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6d05c-6a11-4dff-9d84-0056722f2600 None admin] REQUEST_METHOD: `PUT` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:47.562104 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385e900e-d548-48a3-9d20-8fe060b82b97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:47.562340 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6d05c-6a11-4dff-9d84-0056722f2600 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:47.562639 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be6d05c-6a11-4dff-9d84-0056722f2600 None admin] PATH_INFO: `/v3/projects/6d6e897c6391486e9c44e9277a3ee823/users/4ce463b940db4f83a6df7e0561a88567/roles/2e4889bb71f9434392c0baba59f2534e` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:47.564606 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385e900e-d548-48a3-9d20-8fe060b82b97 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:47.564904 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be6d05c-6a11-4dff-9d84-0056722f2600 None admin] RBAC: Authorizing `identity:create_grant(project_id=6d6e897c6391486e9c44e9277a3ee823, user_id=4ce463b940db4f83a6df7e0561a88567, role_id=2e4889bb71f9434392c0baba59f2534e)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:47.566329 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be6d05c-6a11-4dff-9d84-0056722f2600 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:47.581378 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 413/813] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:45:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:47.587935 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 401/814] 10.222.0.49 () {58 vars in 1439 bytes} [Sun Aug 28 00:45:47 2022] PUT /identity/v3/projects/6d6e897c6391486e9c44e9277a3ee823/users/4ce463b940db4f83a6df7e0561a88567/roles/2e4889bb71f9434392c0baba59f2534e => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:45:47.588257 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e900e-d548-48a3-9d20-8fe060b82b97 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:47.588348 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30d808-f3d4-4455-8f15-b8899a29617c None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:47.588348 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30d808-f3d4-4455-8f15-b8899a29617c None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:47.588348 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30d808-f3d4-4455-8f15-b8899a29617c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:47.613925 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-4f30d808-f3d4-4455-8f15-b8899a29617c None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:47.615343 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-4f30d808-f3d4-4455-8f15-b8899a29617c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:47.696068 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:47.746467 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 402/815] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:45:47.749407 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f30d808-f3d4-4455-8f15-b8899a29617c None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:47.766903 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e900e-d548-48a3-9d20-8fe060b82b97 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:47.821294 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ced945-085f-49d8-8896-d04bc1f83a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:47.822861 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ced945-085f-49d8-8896-d04bc1f83a27 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:47.823142 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ced945-085f-49d8-8896-d04bc1f83a27 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:47.823439 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ced945-085f-49d8-8896-d04bc1f83a27 None admin] PATH_INFO: `/v3/services` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:47.824564 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ced945-085f-49d8-8896-d04bc1f83a27 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:47.824978 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ced945-085f-49d8-8896-d04bc1f83a27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:47.827326 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ced945-085f-49d8-8896-d04bc1f83a27 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:47.835790 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 414/816] 10.222.0.49 () {56 vars in 1124 bytes} [Sun Aug 28 00:45:47 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:47.841283 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ced945-085f-49d8-8896-d04bc1f83a27 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:47.877465 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:47.898395 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f30d808-f3d4-4455-8f15-b8899a29617c None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:47.943620 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b99245f-1fd2-4592-b325-290429a8b522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:47.944341 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99245f-1fd2-4592-b325-290429a8b522 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:47.944626 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99245f-1fd2-4592-b325-290429a8b522 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:47.944922 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99245f-1fd2-4592-b325-290429a8b522 None admin] PATH_INFO: `/v3/users` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:47.946207 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b99245f-1fd2-4592-b325-290429a8b522 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:47.946521 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b99245f-1fd2-4592-b325-290429a8b522 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:47.948661 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b99245f-1fd2-4592-b325-290429a8b522 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:47.978749 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 403/817] 10.222.0.49 () {56 vars in 1133 bytes} [Sun Aug 28 00:45:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:47.980117 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b99245f-1fd2-4592-b325-290429a8b522 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:47.989687 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ced945-085f-49d8-8896-d04bc1f83a27 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:48.030020 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:48.042829 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01fc8b4-2e25-4b03-8da9-3550427b879b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:48.043690 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01fc8b4-2e25-4b03-8da9-3550427b879b None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:48.043963 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01fc8b4-2e25-4b03-8da9-3550427b879b None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:48.044322 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01fc8b4-2e25-4b03-8da9-3550427b879b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:48.053500 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01fc8b4-2e25-4b03-8da9-3550427b879b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:48.055595 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01fc8b4-2e25-4b03-8da9-3550427b879b None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:48.071690 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-d01fc8b4-2e25-4b03-8da9-3550427b879b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:45:48.071690 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:48.071690 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:48.071690 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:48.071690 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:48.071690 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:48.071690 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:48.071690 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:48.071690 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:48.071690 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:48.071690 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:48.071690 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:48.071690 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:45:48.071690 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:45:48.071690 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:45:48.072890 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:45:48.072890 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:48.072890 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:48.072890 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:48.072890 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:48.072890 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:48.072890 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:48.072890 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:48.072890 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:48.072890 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:48.072890 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:48.072890 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:48.072890 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:48.072890 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:48.072890 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:48.072890 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:48.072890 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:48.074072 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:45:48.074072 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:45:48.074072 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:45:48.074072 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:45:48.074072 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:45:48.074072 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:45:48.074072 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:45:48.074072 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:48.074072 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 415/818] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 28 00:45:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:48.074720 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01fc8b4-2e25-4b03-8da9-3550427b879b None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:48.128778 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b99245f-1fd2-4592-b325-290429a8b522 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:48.185454 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde9e7e-572a-4eb7-9353-82b9c9239a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:48.186084 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde9e7e-572a-4eb7-9353-82b9c9239a61 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:48.186364 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde9e7e-572a-4eb7-9353-82b9c9239a61 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:48.186633 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde9e7e-572a-4eb7-9353-82b9c9239a61 None admin] PATH_INFO: `/v3/services` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:48.187367 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bde9e7e-572a-4eb7-9353-82b9c9239a61 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:48.187715 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bde9e7e-572a-4eb7-9353-82b9c9239a61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:48.189239 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bde9e7e-572a-4eb7-9353-82b9c9239a61 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:48.195241 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 404/819] 10.222.0.49 () {56 vars in 1124 bytes} [Sun Aug 28 00:45:47 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:48.196121 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde9e7e-572a-4eb7-9353-82b9c9239a61 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:48.215506 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01fc8b4-2e25-4b03-8da9-3550427b879b None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:48.216097 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:48.259547 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca07154-3d86-4826-80ab-30c33435266f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:48.261339 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca07154-3d86-4826-80ab-30c33435266f None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:48.261653 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca07154-3d86-4826-80ab-30c33435266f None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:48.261925 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca07154-3d86-4826-80ab-30c33435266f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:48.341256 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde9e7e-572a-4eb7-9353-82b9c9239a61 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:48.360090 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:48.377812 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca07154-3d86-4826-80ab-30c33435266f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:48.379503 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca07154-3d86-4826-80ab-30c33435266f None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:48.390926 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b2749-8683-45fa-adcc-f33a8dc68396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:48.391768 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b2749-8683-45fa-adcc-f33a8dc68396 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:48.392102 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b2749-8683-45fa-adcc-f33a8dc68396 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:48.392423 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b2749-8683-45fa-adcc-f33a8dc68396 None admin] PATH_INFO: `/v3/services/network` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:48.393099 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3b2749-8683-45fa-adcc-f33a8dc68396 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:48.394876 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3b2749-8683-45fa-adcc-f33a8dc68396 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:48.405812 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-6d3b2749-8683-45fa-adcc-f33a8dc68396 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 28 00:45:48.405812 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:48.405812 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:45:48.405812 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:45:48.405812 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:45:48.405812 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:45:48.405812 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:45:48.405812 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:45:48.405812 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 28 00:45:48.405812 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:48.405812 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:45:48.405812 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:48.405812 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:48.405812 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:48.405812 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:48.405812 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:48.405812 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:48.407166 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:48.407166 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:48.407166 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:48.407166 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:48.407166 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:48.407166 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:48.407166 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:45:48.407166 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:45:48.407166 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:45:48.407166 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:45:48.407166 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:48.407166 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:48.407166 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:48.407166 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:48.407166 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:48.407166 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:48.408587 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:48.408587 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:48.408587 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:48.408587 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:48.408587 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:48.408587 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:48.408587 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:48.408587 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:48.408587 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:48.408587 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:48.408587 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:45:48.408587 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:45:48.408587 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 28 00:45:48.408587 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:48.408587 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 405/820] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 28 00:45:48 2022] GET /identity/v3/services/network => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:48.409639 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b2749-8683-45fa-adcc-f33a8dc68396 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:48.496968 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:48.527923 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 416/821] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 28 00:45:48 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:45:48.528929 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca07154-3d86-4826-80ab-30c33435266f None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:48.544917 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b2749-8683-45fa-adcc-f33a8dc68396 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:48.583083 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a749abd-2d47-4837-b8cb-d6b580fce0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:48.583711 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a749abd-2d47-4837-b8cb-d6b580fce0aa None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:48.583990 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a749abd-2d47-4837-b8cb-d6b580fce0aa None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:48.584257 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a749abd-2d47-4837-b8cb-d6b580fce0aa None admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:48.584962 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a749abd-2d47-4837-b8cb-d6b580fce0aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:48.585262 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a749abd-2d47-4837-b8cb-d6b580fce0aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:48.586717 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a749abd-2d47-4837-b8cb-d6b580fce0aa None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:48.600936 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 406/822] 10.222.0.49 () {56 vars in 1148 bytes} [Sun Aug 28 00:45:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:48.601709 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a749abd-2d47-4837-b8cb-d6b580fce0aa None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:48.652342 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:48.669206 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca07154-3d86-4826-80ab-30c33435266f None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:48.730839 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749974fc-ec2d-4dca-8028-622fb3268053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:48.731952 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749974fc-ec2d-4dca-8028-622fb3268053 None admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:48.732422 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749974fc-ec2d-4dca-8028-622fb3268053 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:48.732896 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749974fc-ec2d-4dca-8028-622fb3268053 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:48.734072 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749974fc-ec2d-4dca-8028-622fb3268053 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:48.735980 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749974fc-ec2d-4dca-8028-622fb3268053 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:48.767157 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a749abd-2d47-4837-b8cb-d6b580fce0aa None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:48.769683 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 417/823] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 00:45:48 2022] POST /identity/v3/endpoints => generated 346 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:45:48.770688 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749974fc-ec2d-4dca-8028-622fb3268053 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:48.828614 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:48.846718 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21fbc28-d04e-4a2b-9519-75de9fde4c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:48.847641 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21fbc28-d04e-4a2b-9519-75de9fde4c27 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:48.848968 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21fbc28-d04e-4a2b-9519-75de9fde4c27 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:48.849416 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21fbc28-d04e-4a2b-9519-75de9fde4c27 None admin] PATH_INFO: `/v3/services` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:48.850313 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21fbc28-d04e-4a2b-9519-75de9fde4c27 None admin] RBAC: Adding query filter params (name=network) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:48.851181 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21fbc28-d04e-4a2b-9519-75de9fde4c27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:48.853747 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21fbc28-d04e-4a2b-9519-75de9fde4c27 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:48.863947 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 407/824] 10.222.0.49 () {56 vars in 1112 bytes} [Sun Aug 28 00:45:48 2022] GET /identity/v3/services?name=network => generated 124 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:48.865942 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21fbc28-d04e-4a2b-9519-75de9fde4c27 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:48.925722 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749974fc-ec2d-4dca-8028-622fb3268053 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:48.969865 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51459ba7-5f98-4e69-b912-05253e96e015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:48.971064 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51459ba7-5f98-4e69-b912-05253e96e015 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:48.971697 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51459ba7-5f98-4e69-b912-05253e96e015 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:48.972158 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51459ba7-5f98-4e69-b912-05253e96e015 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:48.989592 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51459ba7-5f98-4e69-b912-05253e96e015 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:48.991508 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51459ba7-5f98-4e69-b912-05253e96e015 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:48.995460 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:49.012814 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-51459ba7-5f98-4e69-b912-05253e96e015 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:49.012814 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:49.012814 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:49.012814 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:49.012814 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:49.012814 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:49.012814 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:49.012814 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:49.012814 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:49.012814 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:49.012814 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:49.012814 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:49.012814 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:45:49.012814 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:45:49.012814 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:45:49.012814 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:45:49.013922 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:49.013922 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:49.013922 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:49.013922 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:49.013922 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:49.013922 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:49.013922 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:49.013922 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:49.013922 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:49.013922 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:49.013922 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:49.013922 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:49.013922 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:49.013922 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:49.013922 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:49.013922 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:49.013922 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:45:49.015067 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:45:49.015067 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:49.015067 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:49.022356 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 418/825] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:49.023769 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51459ba7-5f98-4e69-b912-05253e96e015 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:49.039493 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21fbc28-d04e-4a2b-9519-75de9fde4c27 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:49.092108 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4863794f-dd8d-405c-b305-5cc770dd434a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:49.092865 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4863794f-dd8d-405c-b305-5cc770dd434a None admin] REQUEST_METHOD: `PUT` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:49.093263 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4863794f-dd8d-405c-b305-5cc770dd434a None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:49.093538 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4863794f-dd8d-405c-b305-5cc770dd434a None admin] PATH_INFO: `/v3/projects/6d6e897c6391486e9c44e9277a3ee823/users/cbe0653ed0c04a9080b5c337392de8ad/roles/ab658a45d85b49319c5add69c508b564` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:49.118002 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4863794f-dd8d-405c-b305-5cc770dd434a None admin] RBAC: Authorizing `identity:create_grant(project_id=6d6e897c6391486e9c44e9277a3ee823, user_id=cbe0653ed0c04a9080b5c337392de8ad, role_id=ab658a45d85b49319c5add69c508b564)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:49.120751 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4863794f-dd8d-405c-b305-5cc770dd434a None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:49.142296 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 408/826] 10.222.0.49 () {58 vars in 1439 bytes} [Sun Aug 28 00:45:48 2022] PUT /identity/v3/projects/6d6e897c6391486e9c44e9277a3ee823/users/cbe0653ed0c04a9080b5c337392de8ad/roles/ab658a45d85b49319c5add69c508b564 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:45:49.143588 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4863794f-dd8d-405c-b305-5cc770dd434a None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:49.169832 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51459ba7-5f98-4e69-b912-05253e96e015 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:49.244467 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:49.247541 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf344a38-086b-4269-95bf-3a4170089fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:49.248662 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf344a38-086b-4269-95bf-3a4170089fc8 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:49.249085 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf344a38-086b-4269-95bf-3a4170089fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:49.249531 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf344a38-086b-4269-95bf-3a4170089fc8 None admin] PATH_INFO: `/v3/services` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:49.250546 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf344a38-086b-4269-95bf-3a4170089fc8 None admin] RBAC: Adding query filter params (type=network) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:49.250854 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf344a38-086b-4269-95bf-3a4170089fc8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:49.252843 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf344a38-086b-4269-95bf-3a4170089fc8 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:49.262442 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 419/827] 10.222.0.49 () {56 vars in 1112 bytes} [Sun Aug 28 00:45:49 2022] GET /identity/v3/services?type=network => generated 350 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:49.270217 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf344a38-086b-4269-95bf-3a4170089fc8 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:49.404335 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:49.406403 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4863794f-dd8d-405c-b305-5cc770dd434a None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:49.490247 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f4e2b4-0ca1-420b-a55c-70c4ac36f377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:49.491290 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4e2b4-0ca1-420b-a55c-70c4ac36f377 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:49.491813 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4e2b4-0ca1-420b-a55c-70c4ac36f377 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:49.492287 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f4e2b4-0ca1-420b-a55c-70c4ac36f377 None admin] PATH_INFO: `/v3/domains` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:49.493189 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f4e2b4-0ca1-420b-a55c-70c4ac36f377 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:49.493690 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f4e2b4-0ca1-420b-a55c-70c4ac36f377 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:49.495352 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f4e2b4-0ca1-420b-a55c-70c4ac36f377 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:49.499705 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf344a38-086b-4269-95bf-3a4170089fc8 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:49.527251 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 409/828] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:45:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:49.533602 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f4e2b4-0ca1-420b-a55c-70c4ac36f377 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:49.568216 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57418b5-0714-4a43-845a-c4dba01ce13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:49.570155 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57418b5-0714-4a43-845a-c4dba01ce13e None admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:49.570749 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57418b5-0714-4a43-845a-c4dba01ce13e None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:49.571220 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57418b5-0714-4a43-845a-c4dba01ce13e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:49.573168 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57418b5-0714-4a43-845a-c4dba01ce13e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:49.576450 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57418b5-0714-4a43-845a-c4dba01ce13e None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:49.622606 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 420/829] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 00:45:49 2022] POST /identity/v3/endpoints => generated 337 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:45:49.742886 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f4e2b4-0ca1-420b-a55c-70c4ac36f377 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:49.745303 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:49.815306 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35492669-edaa-42dc-bfca-7be4feb64ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:49.816044 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35492669-edaa-42dc-bfca-7be4feb64ec2 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:49.816326 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35492669-edaa-42dc-bfca-7be4feb64ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:49.816600 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35492669-edaa-42dc-bfca-7be4feb64ec2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:49.827857 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35492669-edaa-42dc-bfca-7be4feb64ec2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:49.829339 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35492669-edaa-42dc-bfca-7be4feb64ec2 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:49.846735 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-35492669-edaa-42dc-bfca-7be4feb64ec2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:45:49.846735 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:49.846735 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:49.846735 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:49.846735 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:49.846735 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:49.846735 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:49.846735 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:49.846735 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:49.846735 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:49.846735 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:49.846735 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:49.846735 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:45:49.846735 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:45:49.846735 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:45:49.847975 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:45:49.847975 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:49.847975 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:49.847975 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:49.847975 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:49.847975 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:49.847975 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:49.847975 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:49.847975 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:49.847975 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:49.847975 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:49.847975 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:49.847975 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:49.847975 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:49.847975 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:49.847975 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:49.847975 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:49.849160 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:45:49.849160 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:45:49.849160 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:45:49.849160 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:45:49.849160 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:45:49.849160 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:45:49.849160 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:45:49.849160 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:49.849160 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 410/830] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 28 00:45:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:49.856748 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57418b5-0714-4a43-845a-c4dba01ce13e None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:50.028892 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57418b5-0714-4a43-845a-c4dba01ce13e None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:50.052554 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:50.078097 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f29ec8-6619-4ff2-8bcf-24d2f43acd18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:50.079075 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f29ec8-6619-4ff2-8bcf-24d2f43acd18 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:50.079290 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f29ec8-6619-4ff2-8bcf-24d2f43acd18 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:50.079567 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f29ec8-6619-4ff2-8bcf-24d2f43acd18 None admin] PATH_INFO: `/v3/projects` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:50.080629 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f29ec8-6619-4ff2-8bcf-24d2f43acd18 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:50.080940 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f29ec8-6619-4ff2-8bcf-24d2f43acd18 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:50.082800 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f29ec8-6619-4ff2-8bcf-24d2f43acd18 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:50.096261 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6209b-ba10-415b-8241-4e8aa1585fc0 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:50.096914 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6209b-ba10-415b-8241-4e8aa1585fc0 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:50.096914 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6209b-ba10-415b-8241-4e8aa1585fc0 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:50.098264 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 421/832] 10.222.0.49 () {56 vars in 1148 bytes} [Sun Aug 28 00:45:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:50.098476 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 411/832] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:45:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:45:50.105274 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a6209b-ba10-415b-8241-4e8aa1585fc0 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:50.105578 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804ad96-8a88-4cf7-8d8d-8aa5e5a4121c None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:50.105578 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804ad96-8a88-4cf7-8d8d-8aa5e5a4121c None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:50.105957 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3804ad96-8a88-4cf7-8d8d-8aa5e5a4121c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:50.126223 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-3804ad96-8a88-4cf7-8d8d-8aa5e5a4121c None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:50.127815 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-3804ad96-8a88-4cf7-8d8d-8aa5e5a4121c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:50.233443 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 422/833] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:50 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:45:50.254597 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a6209b-ba10-415b-8241-4e8aa1585fc0 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:50.298609 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802928d7-5b5d-4bc8-bc4a-44df47b7f179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:50.299615 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802928d7-5b5d-4bc8-bc4a-44df47b7f179 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:50.300224 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802928d7-5b5d-4bc8-bc4a-44df47b7f179 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:50.300720 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802928d7-5b5d-4bc8-bc4a-44df47b7f179 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:50.301728 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802928d7-5b5d-4bc8-bc4a-44df47b7f179 None admin] RBAC: Adding query filter params (role.id=2e4889bb71f9434392c0baba59f2534e, scope.project.id=6d6e897c6391486e9c44e9277a3ee823, user.id=3dc0655c8156457a8fcb006c9fe85eb9) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:50.302378 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802928d7-5b5d-4bc8-bc4a-44df47b7f179 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:50.304233 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802928d7-5b5d-4bc8-bc4a-44df47b7f179 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:50.315846 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 412/834] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 28 00:45:50 2022] GET /identity/v3/role_assignments?user.id=3dc0655c8156457a8fcb006c9fe85eb9&scope.project.id=6d6e897c6391486e9c44e9277a3ee823&role.id=2e4889bb71f9434392c0baba59f2534e => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:45:50.519115 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3804ad96-8a88-4cf7-8d8d-8aa5e5a4121c None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:50.634007 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3804ad96-8a88-4cf7-8d8d-8aa5e5a4121c None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:50.650347 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:50.672820 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d8131-bf1e-45ac-a02f-93a6b8e669d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:50.673482 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d8131-bf1e-45ac-a02f-93a6b8e669d4 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:50.673766 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d8131-bf1e-45ac-a02f-93a6b8e669d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:50.674030 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d8131-bf1e-45ac-a02f-93a6b8e669d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:50.686565 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d8131-bf1e-45ac-a02f-93a6b8e669d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:45:50.691582 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-323d8131-bf1e-45ac-a02f-93a6b8e669d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:45:50.691582 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:50.691582 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:50.691582 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:50.691582 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:50.691582 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:50.691582 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:50.691582 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:50.691582 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:50.691582 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:50.691582 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:50.691582 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:50.691582 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:45:50.691582 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:45:50.691582 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:45:50.691582 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:45:50.693437 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:45:50.693437 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:45:50.693437 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:45:50.693437 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:45:50.693437 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:50.693437 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:50.693437 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:50.693437 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:50.693437 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:50.693437 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:50.693437 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:50.693437 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:50.693437 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:50.693437 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:50.693437 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:50.693437 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:50.695113 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:50.695113 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:50.695113 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:50.695113 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:50.695113 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:45:50.695113 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:45:50.695113 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:45:50.695113 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:45:50.695113 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:45:50.695113 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:45:50.695113 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:45:50.695113 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:50.695113 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 423/835] 10.222.0.49 () {56 vars in 1096 bytes} [Sun Aug 28 00:45:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:50.707205 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802928d7-5b5d-4bc8-bc4a-44df47b7f179 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:50.748148 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:50.831893 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802928d7-5b5d-4bc8-bc4a-44df47b7f179 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:50.867778 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d2ec32-bcd7-46b3-a228-3ee7c56e44f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:50.868399 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2ec32-bcd7-46b3-a228-3ee7c56e44f0 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:50.868679 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2ec32-bcd7-46b3-a228-3ee7c56e44f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:50.868951 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2ec32-bcd7-46b3-a228-3ee7c56e44f0 None admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:50.869693 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d2ec32-bcd7-46b3-a228-3ee7c56e44f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:50.869998 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d2ec32-bcd7-46b3-a228-3ee7c56e44f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:50.871412 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d2ec32-bcd7-46b3-a228-3ee7c56e44f0 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:50.881095 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 413/836] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 28 00:45:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:50.890383 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d8131-bf1e-45ac-a02f-93a6b8e669d4 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:51.050639 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d8131-bf1e-45ac-a02f-93a6b8e669d4 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:51.093740 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544ff921-c8d0-481a-9e6f-1a83f45a0cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:51.094418 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ff921-c8d0-481a-9e6f-1a83f45a0cbc None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:51.094692 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ff921-c8d0-481a-9e6f-1a83f45a0cbc None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:51.094956 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ff921-c8d0-481a-9e6f-1a83f45a0cbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:51.106568 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544ff921-c8d0-481a-9e6f-1a83f45a0cbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:51.108166 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544ff921-c8d0-481a-9e6f-1a83f45a0cbc None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:51.124825 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-544ff921-c8d0-481a-9e6f-1a83f45a0cbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:51.124825 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:51.124825 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:51.124825 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:51.124825 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:51.124825 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:51.124825 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:51.124825 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:51.124825 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:51.124825 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:51.124825 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:51.124825 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:51.124825 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:45:51.124825 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:45:51.124825 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:45:51.124825 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:45:51.125851 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:51.125851 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:51.125851 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:51.125851 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:51.125851 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:51.125851 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:51.125851 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:51.125851 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:51.125851 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:51.125851 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:51.125851 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:51.125851 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:51.125851 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:51.125851 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:51.125851 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:51.125851 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:51.125851 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:45:51.126741 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:45:51.126741 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:51.126741 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:51.126741 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 424/837] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:45:51.133215 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d2ec32-bcd7-46b3-a228-3ee7c56e44f0 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:51.233093 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:51.254198 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d2ec32-bcd7-46b3-a228-3ee7c56e44f0 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:51.304789 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b55700-209f-4e77-9e77-10defea75e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:51.305896 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b55700-209f-4e77-9e77-10defea75e07 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:51.306458 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b55700-209f-4e77-9e77-10defea75e07 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:51.306951 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b55700-209f-4e77-9e77-10defea75e07 None admin] PATH_INFO: `/v3/domains` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:51.308319 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b55700-209f-4e77-9e77-10defea75e07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:51.308842 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b55700-209f-4e77-9e77-10defea75e07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:51.311708 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b55700-209f-4e77-9e77-10defea75e07 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:51.345246 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 414/838] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:45:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:51.353048 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544ff921-c8d0-481a-9e6f-1a83f45a0cbc None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:51.374685 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:51.471284 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4fd5f3-814e-417e-8cd2-3ca1821cd349 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:51.471616 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4fd5f3-814e-417e-8cd2-3ca1821cd349 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:51.471919 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4fd5f3-814e-417e-8cd2-3ca1821cd349 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:51.473583 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 415/839] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:45:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:51.477077 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544ff921-c8d0-481a-9e6f-1a83f45a0cbc None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:51.482302 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a3cec-7aa8-4467-9eea-1f521f61ab12 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:51.482907 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a3cec-7aa8-4467-9eea-1f521f61ab12 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:51.483468 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a3cec-7aa8-4467-9eea-1f521f61ab12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:51.511557 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-313a3cec-7aa8-4467-9eea-1f521f61ab12 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:51.513880 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-313a3cec-7aa8-4467-9eea-1f521f61ab12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:51.521165 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a625551-3673-47c8-bb11-80cd7e108003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:51.521885 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a625551-3673-47c8-bb11-80cd7e108003 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:51.522172 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a625551-3673-47c8-bb11-80cd7e108003 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:51.522447 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a625551-3673-47c8-bb11-80cd7e108003 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:51.533488 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a625551-3673-47c8-bb11-80cd7e108003 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:51.535948 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a625551-3673-47c8-bb11-80cd7e108003 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:51.553208 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-6a625551-3673-47c8-bb11-80cd7e108003 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 28 00:45:51.553208 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:51.553208 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:51.553208 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:51.553208 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:51.553208 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:51.553208 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:51.553208 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:51.553208 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:51.553208 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:51.553208 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:51.553208 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:51.553208 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:45:51.553208 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:45:51.553208 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:45:51.553208 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:45:51.555015 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:51.555015 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:51.555015 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:45:51.555015 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:45:51.555015 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:45:51.555015 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:45:51.555015 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:51.555015 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:51.555015 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:51.555015 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:51.555015 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:51.555015 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:51.555015 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:51.555015 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:51.555015 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:51.555015 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:51.555015 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:51.555015 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:51.556982 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:51.556982 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:51.556982 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:45:51.556982 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:45:51.556982 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:45:51.556982 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:45:51.556982 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:45:51.556982 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:45:51.556982 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 28 00:45:51.556982 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:51.556982 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 425/840] 10.222.0.49 () {56 vars in 1096 bytes} [Sun Aug 28 00:45:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:51.560433 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a625551-3673-47c8-bb11-80cd7e108003 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:51.648447 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 416/841] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:51 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:45:51.676229 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:51.713556 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a625551-3673-47c8-bb11-80cd7e108003 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:51.724882 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92edf1-04f6-4175-915b-9c27a51a5d23 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:51.725640 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92edf1-04f6-4175-915b-9c27a51a5d23 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:51.726323 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92edf1-04f6-4175-915b-9c27a51a5d23 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:51.730041 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 417/842] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:45:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:51.742945 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bfe6c8-1511-46c9-9ce7-b405b0acf3b8 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:51.743891 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bfe6c8-1511-46c9-9ce7-b405b0acf3b8 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:51.744203 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bfe6c8-1511-46c9-9ce7-b405b0acf3b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:51.768248 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-81bfe6c8-1511-46c9-9ce7-b405b0acf3b8 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:51.769818 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-81bfe6c8-1511-46c9-9ce7-b405b0acf3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:51.784666 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fecaf3-8b0b-4f72-a86a-3fbd677ca064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:51.786579 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fecaf3-8b0b-4f72-a86a-3fbd677ca064 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:51.787279 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fecaf3-8b0b-4f72-a86a-3fbd677ca064 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:51.787909 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fecaf3-8b0b-4f72-a86a-3fbd677ca064 None admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:51.790064 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fecaf3-8b0b-4f72-a86a-3fbd677ca064 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:51.791028 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fecaf3-8b0b-4f72-a86a-3fbd677ca064 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:51.794785 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fecaf3-8b0b-4f72-a86a-3fbd677ca064 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:51.824430 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 426/843] 10.222.0.49 () {56 vars in 1135 bytes} [Sun Aug 28 00:45:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:51.831639 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fecaf3-8b0b-4f72-a86a-3fbd677ca064 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:51.875228 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 418/844] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:51 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:45:51.941383 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bfe6c8-1511-46c9-9ce7-b405b0acf3b8 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:51.946846 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:52.004263 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fecaf3-8b0b-4f72-a86a-3fbd677ca064 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:52.064077 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b22dcfb-56dd-4e12-a58b-5153bca04b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:52.065181 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22dcfb-56dd-4e12-a58b-5153bca04b4e None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:52.065747 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22dcfb-56dd-4e12-a58b-5153bca04b4e None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:52.066206 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22dcfb-56dd-4e12-a58b-5153bca04b4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:52.068713 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bfe6c8-1511-46c9-9ce7-b405b0acf3b8 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:52.071687 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:52.113577 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445b8789-03f1-4a6d-9526-1c73a0ca6c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:52.114388 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b8789-03f1-4a6d-9526-1c73a0ca6c6f None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:52.114677 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b8789-03f1-4a6d-9526-1c73a0ca6c6f None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:52.115117 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b8789-03f1-4a6d-9526-1c73a0ca6c6f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:52.115710 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445b8789-03f1-4a6d-9526-1c73a0ca6c6f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:52.117448 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445b8789-03f1-4a6d-9526-1c73a0ca6c6f None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:52.129071 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-445b8789-03f1-4a6d-9526-1c73a0ca6c6f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 28 00:45:52.129071 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:52.129071 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:45:52.129071 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:45:52.129071 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:45:52.129071 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:45:52.129071 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:45:52.129071 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:45:52.129071 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 28 00:45:52.129071 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:52.129071 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:45:52.129071 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:52.129071 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:52.129071 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:52.129071 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:52.129071 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:52.129071 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:52.131978 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:52.131978 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:52.131978 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:52.131978 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:52.131978 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:52.131978 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:52.131978 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:45:52.131978 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:45:52.131978 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:45:52.131978 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:45:52.131978 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:52.131978 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:52.131978 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:52.131978 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:52.131978 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:52.131978 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:52.132896 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:52.132896 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:52.132896 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:52.132896 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:52.132896 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:52.132896 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:52.132896 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:52.132896 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:52.132896 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:52.132896 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:52.132896 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:45:52.132896 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:45:52.132896 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 28 00:45:52.132896 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:52.132896 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 419/845] 10.222.0.49 () {56 vars in 1114 bytes} [Sun Aug 28 00:45:51 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:52.140329 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445b8789-03f1-4a6d-9526-1c73a0ca6c6f None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:52.201998 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b22dcfb-56dd-4e12-a58b-5153bca04b4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:52.203702 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b22dcfb-56dd-4e12-a58b-5153bca04b4e None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:52.240050 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:52.294835 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445b8789-03f1-4a6d-9526-1c73a0ca6c6f None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:52.344762 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad2e777-5e1a-4308-af66-e175b5fb4065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:52.345493 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2e777-5e1a-4308-af66-e175b5fb4065 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:52.345772 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2e777-5e1a-4308-af66-e175b5fb4065 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:52.346106 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2e777-5e1a-4308-af66-e175b5fb4065 None admin] PATH_INFO: `/v3/services` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:52.347126 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad2e777-5e1a-4308-af66-e175b5fb4065 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:52.347415 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad2e777-5e1a-4308-af66-e175b5fb4065 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:52.349065 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad2e777-5e1a-4308-af66-e175b5fb4065 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:52.361756 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 420/846] 10.222.0.49 () {56 vars in 1114 bytes} [Sun Aug 28 00:45:52 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:52.362005 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 427/847] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 28 00:45:51 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 28 00:45:52.362125 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad2e777-5e1a-4308-af66-e175b5fb4065 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:52.362309 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b22dcfb-56dd-4e12-a58b-5153bca04b4e None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:52.417666 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:52.488930 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad2e777-5e1a-4308-af66-e175b5fb4065 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:52.511151 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b22dcfb-56dd-4e12-a58b-5153bca04b4e None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:52.535366 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:52.544621 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beedc76-171b-455f-9fdf-6be28f0ae6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:52.545505 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beedc76-171b-455f-9fdf-6be28f0ae6ea None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:52.545741 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beedc76-171b-455f-9fdf-6be28f0ae6ea None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:52.546269 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beedc76-171b-455f-9fdf-6be28f0ae6ea None admin] PATH_INFO: `/v3/roles/service` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:52.554111 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7fb0a-63bd-4694-a6e4-b5541f05d081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:52.555505 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7fb0a-63bd-4694-a6e4-b5541f05d081 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:52.556131 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7fb0a-63bd-4694-a6e4-b5541f05d081 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:52.556597 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c7fb0a-63bd-4694-a6e4-b5541f05d081 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:52.563885 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beedc76-171b-455f-9fdf-6be28f0ae6ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:45:52.569414 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c7fb0a-63bd-4694-a6e4-b5541f05d081 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:52.571321 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c7fb0a-63bd-4694-a6e4-b5541f05d081 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:52.572041 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-2beedc76-171b-455f-9fdf-6be28f0ae6ea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:45:52.572041 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:52.572041 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:52.572041 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:52.572041 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:52.572041 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:52.572041 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:52.572041 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:52.572041 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:52.572041 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:52.572041 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:52.572041 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:52.572041 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:45:52.572041 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:45:52.572041 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:45:52.572041 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:45:52.573069 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:45:52.573069 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:45:52.573069 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:45:52.573069 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:45:52.573069 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:52.573069 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:52.573069 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:52.573069 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:52.573069 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:52.573069 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:52.573069 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:52.573069 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:52.573069 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:52.573069 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:52.573069 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:52.573069 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:52.573936 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:52.573936 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:52.573936 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:52.573936 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:52.573936 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:45:52.573936 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:45:52.573936 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:45:52.573936 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:45:52.573936 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:45:52.573936 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:45:52.573936 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:45:52.573936 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:52.573936 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 421/848] 10.222.0.49 () {56 vars in 1102 bytes} [Sun Aug 28 00:45:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:52.574737 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beedc76-171b-455f-9fdf-6be28f0ae6ea None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:52.595382 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-39c7fb0a-63bd-4694-a6e4-b5541f05d081 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:52.595382 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:52.595382 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:52.595382 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:52.595382 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:52.595382 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:52.595382 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:52.595382 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:52.595382 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:52.595382 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:52.595382 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:52.595382 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:52.595382 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:45:52.595382 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:45:52.595382 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:45:52.595382 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:45:52.596501 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:52.596501 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:52.596501 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:52.596501 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:52.596501 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:52.596501 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:52.596501 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:52.596501 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:52.596501 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:52.596501 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:52.596501 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:52.596501 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:52.596501 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:52.596501 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:52.596501 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:52.596501 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:52.596501 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:45:52.597522 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:45:52.597522 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:52.597522 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:52.597522 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 428/849] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:52.598350 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7fb0a-63bd-4694-a6e4-b5541f05d081 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:52.712583 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:52.723777 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beedc76-171b-455f-9fdf-6be28f0ae6ea None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:52.730554 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c7fb0a-63bd-4694-a6e4-b5541f05d081 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:52.765658 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22f09c5-0449-46d8-91f0-e6cff66c2a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:52.766268 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f09c5-0449-46d8-91f0-e6cff66c2a60 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:52.766543 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f09c5-0449-46d8-91f0-e6cff66c2a60 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:52.766809 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22f09c5-0449-46d8-91f0-e6cff66c2a60 None admin] PATH_INFO: `/v3/services` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:52.767444 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22f09c5-0449-46d8-91f0-e6cff66c2a60 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:52.767778 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22f09c5-0449-46d8-91f0-e6cff66c2a60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:52.769177 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22f09c5-0449-46d8-91f0-e6cff66c2a60 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:52.773929 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 422/850] 10.222.0.49 () {56 vars in 1114 bytes} [Sun Aug 28 00:45:52 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:52.774818 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22f09c5-0449-46d8-91f0-e6cff66c2a60 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:52.775019 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1abdac-6514-4d29-898b-bae3b2a67d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:52.776106 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1abdac-6514-4d29-898b-bae3b2a67d67 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:52.776596 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1abdac-6514-4d29-898b-bae3b2a67d67 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:52.776994 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1abdac-6514-4d29-898b-bae3b2a67d67 None admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:52.777956 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1abdac-6514-4d29-898b-bae3b2a67d67 None admin] RBAC: Adding query filter params (name=service) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:52.778439 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1abdac-6514-4d29-898b-bae3b2a67d67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:52.780208 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1abdac-6514-4d29-898b-bae3b2a67d67 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:52.794917 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 429/851] 10.222.0.49 () {56 vars in 1103 bytes} [Sun Aug 28 00:45:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:52.796796 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a92481-4513-4c4d-9ed3-0dd863cf291e None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:52.797082 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a92481-4513-4c4d-9ed3-0dd863cf291e None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:52.797300 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a92481-4513-4c4d-9ed3-0dd863cf291e None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:52.799001 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 430/852] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:45:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:52.802280 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a92481-4513-4c4d-9ed3-0dd863cf291e None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:52.874106 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:52.947271 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22f09c5-0449-46d8-91f0-e6cff66c2a60 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:52.948750 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a92481-4513-4c4d-9ed3-0dd863cf291e None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:52.996226 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735631fe-5961-46df-94fe-96936a27b3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:52.996893 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735631fe-5961-46df-94fe-96936a27b3b3 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:52.997212 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735631fe-5961-46df-94fe-96936a27b3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:52.997491 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735631fe-5961-46df-94fe-96936a27b3b3 None admin] PATH_INFO: `/v3/domains` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:52.998225 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735631fe-5961-46df-94fe-96936a27b3b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:52.998529 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735631fe-5961-46df-94fe-96936a27b3b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:53.000091 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735631fe-5961-46df-94fe-96936a27b3b3 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:53.005545 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf1ab0d-1d09-4901-a1d6-c224162e9c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:53.006410 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1ab0d-1d09-4901-a1d6-c224162e9c0c None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:53.006713 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1ab0d-1d09-4901-a1d6-c224162e9c0c None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:53.006973 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf1ab0d-1d09-4901-a1d6-c224162e9c0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:53.019851 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 423/853] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:45:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:53.019851 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c118d-8207-4888-9e25-3ffcc79365e1 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:53.019851 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c118d-8207-4888-9e25-3ffcc79365e1 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:53.019851 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c118d-8207-4888-9e25-3ffcc79365e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:53.027947 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf1ab0d-1d09-4901-a1d6-c224162e9c0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:53.030791 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf1ab0d-1d09-4901-a1d6-c224162e9c0c None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:53.040620 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-c41c118d-8207-4888-9e25-3ffcc79365e1 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:53.042611 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-c41c118d-8207-4888-9e25-3ffcc79365e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:53.053348 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-caf1ab0d-1d09-4901-a1d6-c224162e9c0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:53.053348 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:53.053348 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:53.053348 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:53.053348 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:53.053348 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:53.053348 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:53.053348 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:53.053348 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:53.053348 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:53.053348 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:53.053348 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:53.053348 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:45:53.053348 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:45:53.053348 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:45:53.053348 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:45:53.054907 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:53.054907 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:53.054907 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:53.054907 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:53.054907 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:53.054907 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:53.054907 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:53.054907 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:53.054907 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:53.054907 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:53.054907 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:53.054907 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:53.054907 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:53.054907 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:53.054907 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:53.054907 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:53.054907 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:45:53.055977 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:45:53.055977 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:53.055977 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:53.055977 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 431/854] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:45:53.059050 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf1ab0d-1d09-4901-a1d6-c224162e9c0c None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:53.061699 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:53.150803 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 424/855] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:53 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:45:53.152348 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c118d-8207-4888-9e25-3ffcc79365e1 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:53.226666 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf1ab0d-1d09-4901-a1d6-c224162e9c0c None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:53.234022 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:53.274955 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307439a1-374d-43c5-884c-0f261480ca04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:53.276234 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307439a1-374d-43c5-884c-0f261480ca04 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:53.276773 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307439a1-374d-43c5-884c-0f261480ca04 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:53.277324 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307439a1-374d-43c5-884c-0f261480ca04 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:53.288608 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307439a1-374d-43c5-884c-0f261480ca04 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:53.292106 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307439a1-374d-43c5-884c-0f261480ca04 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:53.314914 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-307439a1-374d-43c5-884c-0f261480ca04 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:45:53.314914 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:53.314914 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:53.314914 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:53.314914 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:53.314914 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:53.314914 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:53.314914 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:53.314914 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:53.314914 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:53.314914 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:53.314914 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:53.314914 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:45:53.314914 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:45:53.314914 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:45:53.316638 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:45:53.316638 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:53.316638 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:53.316638 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:53.316638 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:53.316638 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:53.316638 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:53.316638 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:53.316638 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:53.316638 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:53.316638 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:53.316638 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:53.316638 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:53.316638 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:53.316638 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:53.316638 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:53.316638 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:53.317918 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:45:53.317918 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:45:53.317918 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:45:53.317918 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:45:53.317918 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:45:53.317918 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:45:53.317918 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:45:53.317918 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:53.324255 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 432/856] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 28 00:45:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:53.326309 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307439a1-374d-43c5-884c-0f261480ca04 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:53.331879 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c118d-8207-4888-9e25-3ffcc79365e1 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:53.403341 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c88d6c-f35a-4b52-a5c5-0f03e76d9ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:53.404967 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c88d6c-f35a-4b52-a5c5-0f03e76d9ab6 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:53.406578 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c88d6c-f35a-4b52-a5c5-0f03e76d9ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:53.407522 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c88d6c-f35a-4b52-a5c5-0f03e76d9ab6 None admin] PATH_INFO: `/v3/domains` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:53.409581 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c88d6c-f35a-4b52-a5c5-0f03e76d9ab6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:53.410955 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c88d6c-f35a-4b52-a5c5-0f03e76d9ab6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:53.415502 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c88d6c-f35a-4b52-a5c5-0f03e76d9ab6 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:53.417174 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:53.447706 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 425/857] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:45:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:53.456098 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c88d6c-f35a-4b52-a5c5-0f03e76d9ab6 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:53.489307 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307439a1-374d-43c5-884c-0f261480ca04 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:53.556724 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f7cfd4-96e9-4aff-ae7a-7e422914b0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:53.557781 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7cfd4-96e9-4aff-ae7a-7e422914b0d8 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:53.558204 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7cfd4-96e9-4aff-ae7a-7e422914b0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:53.558669 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7cfd4-96e9-4aff-ae7a-7e422914b0d8 None admin] PATH_INFO: `/v3/projects` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:53.560156 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f7cfd4-96e9-4aff-ae7a-7e422914b0d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:53.560586 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f7cfd4-96e9-4aff-ae7a-7e422914b0d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:53.563341 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f7cfd4-96e9-4aff-ae7a-7e422914b0d8 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:53.569550 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c88d6c-f35a-4b52-a5c5-0f03e76d9ab6 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:53.578197 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:53.591723 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 433/858] 10.222.0.49 () {56 vars in 1148 bytes} [Sun Aug 28 00:45:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:53.591723 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f7cfd4-96e9-4aff-ae7a-7e422914b0d8 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:53.621825 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbc64cb-f30e-48ba-81ff-fc965cf43ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:53.622814 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc64cb-f30e-48ba-81ff-fc965cf43ab3 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:53.623375 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc64cb-f30e-48ba-81ff-fc965cf43ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:53.623872 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc64cb-f30e-48ba-81ff-fc965cf43ab3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:53.633267 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbc64cb-f30e-48ba-81ff-fc965cf43ab3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:53.634951 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbc64cb-f30e-48ba-81ff-fc965cf43ab3 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:53.649589 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-fbbc64cb-f30e-48ba-81ff-fc965cf43ab3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 00:45:53.649589 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:53.649589 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:53.649589 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:53.649589 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:53.649589 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:53.649589 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:53.649589 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:53.649589 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:53.649589 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:53.649589 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:53.649589 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:53.649589 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:45:53.649589 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:45:53.649589 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:45:53.649589 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:45:53.650749 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:53.650749 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:53.650749 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:45:53.650749 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:45:53.650749 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:45:53.650749 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:45:53.650749 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:53.650749 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:53.650749 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:53.650749 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:53.650749 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:53.650749 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:53.650749 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:53.650749 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:53.650749 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:53.650749 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:53.650749 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:53.650749 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:53.651860 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:53.651860 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:53.651860 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:45:53.651860 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:45:53.651860 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:45:53.651860 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:45:53.651860 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:45:53.651860 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:45:53.651860 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 00:45:53.651860 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:53.656051 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 426/859] 10.222.0.49 () {56 vars in 1117 bytes} [Sun Aug 28 00:45:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:53.656970 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbc64cb-f30e-48ba-81ff-fc965cf43ab3 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:53.722758 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f7cfd4-96e9-4aff-ae7a-7e422914b0d8 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:53.751863 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:53.768312 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38bc4c7-45d9-4bad-83e7-a2b219d27467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:53.768604 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38bc4c7-45d9-4bad-83e7-a2b219d27467 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:53.768743 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38bc4c7-45d9-4bad-83e7-a2b219d27467 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:53.768947 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38bc4c7-45d9-4bad-83e7-a2b219d27467 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:53.769595 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38bc4c7-45d9-4bad-83e7-a2b219d27467 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:53.771025 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38bc4c7-45d9-4bad-83e7-a2b219d27467 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:53.783108 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-f38bc4c7-45d9-4bad-83e7-a2b219d27467 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 28 00:45:53.783108 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:53.783108 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:45:53.783108 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:45:53.783108 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:45:53.783108 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:45:53.783108 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:45:53.783108 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:45:53.783108 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 28 00:45:53.783108 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:53.783108 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:45:53.783108 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:53.783108 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:53.783108 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:53.783108 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:53.783108 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:53.784303 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:53.784303 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:53.784303 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:53.784303 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:53.784303 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:53.784303 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:53.784303 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:53.784303 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:45:53.784303 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:45:53.784303 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:45:53.784303 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:45:53.784303 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:53.784303 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:53.784303 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:53.784303 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:53.784303 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:53.784303 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:53.785716 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:53.785716 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:53.785716 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:53.785716 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:53.785716 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:53.785716 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:53.785716 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:53.785716 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:53.785716 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:53.785716 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:53.785716 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:45:53.785716 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:45:53.785716 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 28 00:45:53.785716 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:53.785716 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 434/860] 10.222.0.49 () {56 vars in 1132 bytes} [Sun Aug 28 00:45:53 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:53.787117 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38bc4c7-45d9-4bad-83e7-a2b219d27467 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:53.807947 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbc64cb-f30e-48ba-81ff-fc965cf43ab3 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:53.847364 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfda25f-fa29-4051-95c5-ac2d14e0298f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:53.848225 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfda25f-fa29-4051-95c5-ac2d14e0298f None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:53.848664 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfda25f-fa29-4051-95c5-ac2d14e0298f None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:53.849033 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfda25f-fa29-4051-95c5-ac2d14e0298f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:53.850058 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfda25f-fa29-4051-95c5-ac2d14e0298f None admin] RBAC: Adding query filter params (role.id=2e4889bb71f9434392c0baba59f2534e, scope.project.id=6d6e897c6391486e9c44e9277a3ee823, user.id=4ce463b940db4f83a6df7e0561a88567) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:53.850435 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfda25f-fa29-4051-95c5-ac2d14e0298f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:53.852694 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfda25f-fa29-4051-95c5-ac2d14e0298f None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:53.872026 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 427/861] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 28 00:45:53 2022] GET /identity/v3/role_assignments?user.id=4ce463b940db4f83a6df7e0561a88567&scope.project.id=6d6e897c6391486e9c44e9277a3ee823&role.id=2e4889bb71f9434392c0baba59f2534e => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:53.872026 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfda25f-fa29-4051-95c5-ac2d14e0298f None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:53.944752 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:53.961228 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38bc4c7-45d9-4bad-83e7-a2b219d27467 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:54.018869 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb0c891-ba47-4ead-a4dd-ee7fc35386fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:54.019980 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0c891-ba47-4ead-a4dd-ee7fc35386fd None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:54.020459 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0c891-ba47-4ead-a4dd-ee7fc35386fd None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:54.020954 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0c891-ba47-4ead-a4dd-ee7fc35386fd None admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:54.022344 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb0c891-ba47-4ead-a4dd-ee7fc35386fd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:54.022893 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb0c891-ba47-4ead-a4dd-ee7fc35386fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:54.025893 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb0c891-ba47-4ead-a4dd-ee7fc35386fd None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:54.053485 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfda25f-fa29-4051-95c5-ac2d14e0298f None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:54.057615 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 435/862] 10.222.0.49 () {56 vars in 1149 bytes} [Sun Aug 28 00:45:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:54.063309 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb0c891-ba47-4ead-a4dd-ee7fc35386fd None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:54.130614 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23761be-f07e-4a09-ad2e-ea0a29ab6396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:54.131573 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23761be-f07e-4a09-ad2e-ea0a29ab6396 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:54.132434 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:54.132901 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23761be-f07e-4a09-ad2e-ea0a29ab6396 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:54.133354 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23761be-f07e-4a09-ad2e-ea0a29ab6396 None admin] PATH_INFO: `/v3/services` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:54.135539 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23761be-f07e-4a09-ad2e-ea0a29ab6396 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:54.136659 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23761be-f07e-4a09-ad2e-ea0a29ab6396 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:54.139656 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23761be-f07e-4a09-ad2e-ea0a29ab6396 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:54.148114 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 428/863] 10.222.0.49 () {56 vars in 1126 bytes} [Sun Aug 28 00:45:53 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:54.155732 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23761be-f07e-4a09-ad2e-ea0a29ab6396 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:54.209164 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb0c891-ba47-4ead-a4dd-ee7fc35386fd None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:54.248047 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9877b170-b159-4343-b805-416dfae321fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:54.248963 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877b170-b159-4343-b805-416dfae321fb None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:54.249426 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877b170-b159-4343-b805-416dfae321fb None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:54.249854 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877b170-b159-4343-b805-416dfae321fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:54.329162 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:54.332494 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9877b170-b159-4343-b805-416dfae321fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:54.334133 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9877b170-b159-4343-b805-416dfae321fb None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:54.346228 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23761be-f07e-4a09-ad2e-ea0a29ab6396 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:54.426628 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c563cdfe-6f87-4342-abc9-bc99295d4716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:54.427250 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563cdfe-6f87-4342-abc9-bc99295d4716 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:54.427535 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563cdfe-6f87-4342-abc9-bc99295d4716 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:54.427897 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563cdfe-6f87-4342-abc9-bc99295d4716 None admin] PATH_INFO: `/v3/services` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:54.429036 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c563cdfe-6f87-4342-abc9-bc99295d4716 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:54.429365 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c563cdfe-6f87-4342-abc9-bc99295d4716 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:54.429912 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:54.431735 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c563cdfe-6f87-4342-abc9-bc99295d4716 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:54.447735 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 429/864] 10.222.0.49 () {56 vars in 1126 bytes} [Sun Aug 28 00:45:54 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:45:54.550741 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 436/865] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 28 00:45:54 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 28 00:45:54.557026 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c563cdfe-6f87-4342-abc9-bc99295d4716 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:54.711629 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c563cdfe-6f87-4342-abc9-bc99295d4716 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:54.761801 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e1031a-fced-4b38-862b-1e2fd6098b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:54.762460 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e1031a-fced-4b38-862b-1e2fd6098b8a None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:54.762737 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e1031a-fced-4b38-862b-1e2fd6098b8a None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:54.763001 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e1031a-fced-4b38-862b-1e2fd6098b8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:54.776275 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e1031a-fced-4b38-862b-1e2fd6098b8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:54.777786 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e1031a-fced-4b38-862b-1e2fd6098b8a None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:54.794741 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-20e1031a-fced-4b38-862b-1e2fd6098b8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:54.794741 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:54.794741 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:54.794741 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:54.794741 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:54.794741 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:54.794741 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:54.794741 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:54.794741 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:54.794741 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:54.794741 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:54.794741 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:54.794741 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:45:54.794741 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:45:54.794741 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:45:54.794741 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:45:54.795887 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:54.795887 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:54.795887 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:54.795887 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:54.795887 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:54.795887 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:54.795887 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:54.795887 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:54.795887 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:54.795887 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:54.795887 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:54.795887 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:54.795887 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:54.795887 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:54.795887 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:54.795887 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:54.795887 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:45:54.796834 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:45:54.796834 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:54.796834 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:45:54.796834 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 430/866] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:54.805307 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9877b170-b159-4343-b805-416dfae321fb None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:54.895441 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa3e04-5816-49c4-addd-c4c971a94760 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:54.895759 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa3e04-5816-49c4-addd-c4c971a94760 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:54.896037 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa3e04-5816-49c4-addd-c4c971a94760 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:54.897513 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 431/867] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:45:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:45:54.905017 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3e148-5bc4-4fa5-86f7-2ea3399b857d None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:54.905393 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3e148-5bc4-4fa5-86f7-2ea3399b857d None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:54.905557 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3e148-5bc4-4fa5-86f7-2ea3399b857d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:54.925537 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-0ed3e148-5bc4-4fa5-86f7-2ea3399b857d None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:54.926761 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-0ed3e148-5bc4-4fa5-86f7-2ea3399b857d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:54.935047 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:54.966374 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9877b170-b159-4343-b805-416dfae321fb None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:55.013320 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72943470-b0ac-4b57-8cd3-ae9bdeb1dd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:55.013946 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72943470-b0ac-4b57-8cd3-ae9bdeb1dd75 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:55.014223 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72943470-b0ac-4b57-8cd3-ae9bdeb1dd75 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:55.014497 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72943470-b0ac-4b57-8cd3-ae9bdeb1dd75 None admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:55.015145 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72943470-b0ac-4b57-8cd3-ae9bdeb1dd75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:55.015505 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72943470-b0ac-4b57-8cd3-ae9bdeb1dd75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:55.017042 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72943470-b0ac-4b57-8cd3-ae9bdeb1dd75 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:55.032939 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 437/868] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:45:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:55.039927 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72943470-b0ac-4b57-8cd3-ae9bdeb1dd75 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:55.047207 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:55.069117 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 432/869] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:54 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:45:55.199943 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72943470-b0ac-4b57-8cd3-ae9bdeb1dd75 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:55.238042 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dd9a1a-e13b-4145-a308-aa450b23f876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:55.239058 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dd9a1a-e13b-4145-a308-aa450b23f876 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:55.239534 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dd9a1a-e13b-4145-a308-aa450b23f876 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:55.240025 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dd9a1a-e13b-4145-a308-aa450b23f876 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:55.247881 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dd9a1a-e13b-4145-a308-aa450b23f876 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:55.249683 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dd9a1a-e13b-4145-a308-aa450b23f876 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:55.262429 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-f2dd9a1a-e13b-4145-a308-aa450b23f876 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:45:55.262429 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:55.262429 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:55.262429 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:55.262429 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:55.262429 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:55.262429 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:55.262429 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:55.262429 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:55.262429 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:55.262429 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:55.262429 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:55.262429 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:45:55.262429 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:45:55.262429 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:45:55.263403 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:45:55.263403 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:55.263403 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:55.263403 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:55.263403 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:55.263403 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:55.263403 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:55.263403 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:55.263403 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:55.263403 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:55.263403 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:55.263403 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:55.263403 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:55.263403 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:55.263403 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:55.263403 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:55.263403 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:55.264336 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:45:55.264336 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:45:55.264336 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:45:55.264336 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:45:55.264336 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:45:55.264336 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:45:55.264336 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:45:55.264336 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:55.266873 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 438/870] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 28 00:45:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:55.272803 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3e148-5bc4-4fa5-86f7-2ea3399b857d None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:55.402060 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dd9a1a-e13b-4145-a308-aa450b23f876 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:55.403615 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3e148-5bc4-4fa5-86f7-2ea3399b857d None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:55.455797 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40840fca-90dc-499d-a8ca-13004cccf820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:55.456546 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40840fca-90dc-499d-a8ca-13004cccf820 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:55.456822 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40840fca-90dc-499d-a8ca-13004cccf820 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:55.457137 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40840fca-90dc-499d-a8ca-13004cccf820 None admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:55.457897 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40840fca-90dc-499d-a8ca-13004cccf820 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:55.458189 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40840fca-90dc-499d-a8ca-13004cccf820 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:55.460134 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40840fca-90dc-499d-a8ca-13004cccf820 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:55.470854 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:55.473236 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:55.477030 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 433/871] 10.222.0.49 () {56 vars in 1148 bytes} [Sun Aug 28 00:45:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:55.482974 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40840fca-90dc-499d-a8ca-13004cccf820 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:55.515113 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dd9a1a-e13b-4145-a308-aa450b23f876 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:55.554222 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e12188a-abbc-411e-8419-4fb56da940c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:55.555534 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12188a-abbc-411e-8419-4fb56da940c3 None admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:55.556079 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12188a-abbc-411e-8419-4fb56da940c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:55.556549 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12188a-abbc-411e-8419-4fb56da940c3 None admin] PATH_INFO: `/v3/services` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:55.557477 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e12188a-abbc-411e-8419-4fb56da940c3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:55.559144 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e12188a-abbc-411e-8419-4fb56da940c3 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:55.578227 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 439/872] 10.222.0.49 () {60 vars in 1141 bytes} [Sun Aug 28 00:45:55 2022] POST /identity/v3/services => generated 251 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:45:55.627522 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40840fca-90dc-499d-a8ca-13004cccf820 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:55.684717 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d3eb1f-c79c-4994-87a3-8ab87e71f6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:55.685434 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d3eb1f-c79c-4994-87a3-8ab87e71f6ee None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:55.685713 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d3eb1f-c79c-4994-87a3-8ab87e71f6ee None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:55.686014 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d3eb1f-c79c-4994-87a3-8ab87e71f6ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:55.686923 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d3eb1f-c79c-4994-87a3-8ab87e71f6ee None admin] RBAC: Adding query filter params (role.id=ab658a45d85b49319c5add69c508b564, scope.project.id=6d6e897c6391486e9c44e9277a3ee823, user.id=cbe0653ed0c04a9080b5c337392de8ad) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:55.687276 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d3eb1f-c79c-4994-87a3-8ab87e71f6ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:55.689202 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d3eb1f-c79c-4994-87a3-8ab87e71f6ee None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:55.697614 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 434/873] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 28 00:45:55 2022] GET /identity/v3/role_assignments?user.id=cbe0653ed0c04a9080b5c337392de8ad&scope.project.id=6d6e897c6391486e9c44e9277a3ee823&role.id=ab658a45d85b49319c5add69c508b564 => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:56.095841 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12b628-a767-432a-925a-6f39c0db4e8d None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:56.096382 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12b628-a767-432a-925a-6f39c0db4e8d None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:56.096681 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12b628-a767-432a-925a-6f39c0db4e8d None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:56.098511 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 440/874] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:45:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:56.105312 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde2c1b-49a1-4e41-8067-b3a2d0f3a184 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:56.105735 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde2c1b-49a1-4e41-8067-b3a2d0f3a184 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:56.106015 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde2c1b-49a1-4e41-8067-b3a2d0f3a184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:56.129083 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-5fde2c1b-49a1-4e41-8067-b3a2d0f3a184 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:56.130520 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-5fde2c1b-49a1-4e41-8067-b3a2d0f3a184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:56.200623 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:56.216697 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 435/875] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:56 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:45:56.507376 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f12b628-a767-432a-925a-6f39c0db4e8d None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:56.655449 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f12b628-a767-432a-925a-6f39c0db4e8d None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:56.688468 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:56.693766 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d1e52-d9fe-45be-9ad5-1194a8ca5235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:56.694814 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d1e52-d9fe-45be-9ad5-1194a8ca5235 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:56.695739 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d1e52-d9fe-45be-9ad5-1194a8ca5235 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:56.695962 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d1e52-d9fe-45be-9ad5-1194a8ca5235 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:56.696831 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7d1e52-d9fe-45be-9ad5-1194a8ca5235 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:56.698306 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7d1e52-d9fe-45be-9ad5-1194a8ca5235 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:56.708727 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-3b7d1e52-d9fe-45be-9ad5-1194a8ca5235 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 00:45:56.708727 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:56.708727 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:45:56.708727 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:45:56.708727 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:45:56.708727 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:45:56.708727 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:45:56.708727 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:45:56.708727 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 00:45:56.708727 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:56.708727 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:45:56.708727 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:56.708727 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:56.708727 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:56.708727 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:56.708727 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:56.708727 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:56.709807 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:56.709807 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:56.709807 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:56.709807 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:56.709807 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:56.709807 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:56.709807 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:45:56.709807 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:45:56.709807 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:45:56.709807 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:45:56.709807 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:56.709807 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:56.709807 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:56.709807 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:56.709807 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:56.709807 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:56.710684 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:56.710684 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:56.710684 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:56.710684 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:56.710684 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:56.710684 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:56.710684 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:56.710684 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:56.710684 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:56.710684 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:56.710684 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:45:56.710684 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:45:56.710684 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 00:45:56.710684 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:56.710684 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 441/876] 10.222.0.49 () {56 vars in 1126 bytes} [Sun Aug 28 00:45:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:56.723472 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde2c1b-49a1-4e41-8067-b3a2d0f3a184 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:56.873731 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde2c1b-49a1-4e41-8067-b3a2d0f3a184 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:56.912232 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b887f31-4fd9-470d-a141-ee0b8ac12612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:56.912891 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b887f31-4fd9-470d-a141-ee0b8ac12612 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:56.913199 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b887f31-4fd9-470d-a141-ee0b8ac12612 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:56.913465 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b887f31-4fd9-470d-a141-ee0b8ac12612 None admin] PATH_INFO: `/v3/services` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:56.914108 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b887f31-4fd9-470d-a141-ee0b8ac12612 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:56.914401 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b887f31-4fd9-470d-a141-ee0b8ac12612 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:56.915887 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b887f31-4fd9-470d-a141-ee0b8ac12612 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:56.921646 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 436/877] 10.222.0.49 () {56 vars in 1122 bytes} [Sun Aug 28 00:45:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:56.927464 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d1e52-d9fe-45be-9ad5-1194a8ca5235 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:56.961242 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b7ec6-905d-43d3-ac1e-c3211a0af4a9 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:56.961595 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b7ec6-905d-43d3-ac1e-c3211a0af4a9 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:56.961820 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b7ec6-905d-43d3-ac1e-c3211a0af4a9 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:56.967755 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 437/878] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:45:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:45:56.969829 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ceb10-3553-42bb-97a9-63b937ef69fb None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:56.970120 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ceb10-3553-42bb-97a9-63b937ef69fb None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:56.970391 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ceb10-3553-42bb-97a9-63b937ef69fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:56.992686 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-452ceb10-3553-42bb-97a9-63b937ef69fb None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:56.994076 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-452ceb10-3553-42bb-97a9-63b937ef69fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:57.066063 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:57.078957 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d1e52-d9fe-45be-9ad5-1194a8ca5235 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:57.089459 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 438/879] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:56 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:45:57.122257 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c045e5-33ad-4c64-b7db-9580fc9ad39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:57.123586 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c045e5-33ad-4c64-b7db-9580fc9ad39d None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:57.124090 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c045e5-33ad-4c64-b7db-9580fc9ad39d None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:57.124511 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c045e5-33ad-4c64-b7db-9580fc9ad39d None admin] PATH_INFO: `/v3/services` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:57.125334 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c045e5-33ad-4c64-b7db-9580fc9ad39d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:57.125844 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c045e5-33ad-4c64-b7db-9580fc9ad39d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:57.127404 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c045e5-33ad-4c64-b7db-9580fc9ad39d None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:57.133475 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 442/880] 10.222.0.49 () {56 vars in 1122 bytes} [Sun Aug 28 00:45:56 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:57.365724 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ceb10-3553-42bb-97a9-63b937ef69fb None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:57.485385 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ceb10-3553-42bb-97a9-63b937ef69fb None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:57.523589 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a3de2-cf12-4913-b487-be5765973f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:57.524656 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a3de2-cf12-4913-b487-be5765973f04 None admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:57.525163 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a3de2-cf12-4913-b487-be5765973f04 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:57.525720 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a3de2-cf12-4913-b487-be5765973f04 None admin] PATH_INFO: `/v3/services` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:57.526656 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377a3de2-cf12-4913-b487-be5765973f04 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:57.528279 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377a3de2-cf12-4913-b487-be5765973f04 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:57.546211 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 439/881] 10.222.0.49 () {60 vars in 1141 bytes} [Sun Aug 28 00:45:57 2022] POST /identity/v3/services => generated 269 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:45:57.663517 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5e6c7-ecfd-4aff-8269-ece13088c72b None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:57.663906 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5e6c7-ecfd-4aff-8269-ece13088c72b None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:57.664116 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5e6c7-ecfd-4aff-8269-ece13088c72b None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:57.665858 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 443/882] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:45:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:57.672003 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f5f893-db78-46e3-b276-4ad6cf9ea55a None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:57.672331 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f5f893-db78-46e3-b276-4ad6cf9ea55a None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:57.672551 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f5f893-db78-46e3-b276-4ad6cf9ea55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:57.692662 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-80f5f893-db78-46e3-b276-4ad6cf9ea55a None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:57.693879 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-80f5f893-db78-46e3-b276-4ad6cf9ea55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:57.746556 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:57.780469 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 440/883] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:57 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:45:57.938329 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e57a49-7a59-43bb-b832-9e707ca5dd4e None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:57.938660 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e57a49-7a59-43bb-b832-9e707ca5dd4e None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:57.938884 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e57a49-7a59-43bb-b832-9e707ca5dd4e None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:57.940497 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 444/884] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:45:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:57.945984 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993bfa29-c144-4569-805c-ca73f85cb949 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:57.946275 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993bfa29-c144-4569-805c-ca73f85cb949 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:57.946554 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993bfa29-c144-4569-805c-ca73f85cb949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:57.965373 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-993bfa29-c144-4569-805c-ca73f85cb949 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:57.966569 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-993bfa29-c144-4569-805c-ca73f85cb949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:58.034224 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 441/885] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:57 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:45:58.057924 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e57a49-7a59-43bb-b832-9e707ca5dd4e None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:58.120223 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:58.170897 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e57a49-7a59-43bb-b832-9e707ca5dd4e None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:58.206668 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf2998c-519b-43ba-a57e-c9b5a4633e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:58.207303 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2998c-519b-43ba-a57e-c9b5a4633e00 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:58.207626 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2998c-519b-43ba-a57e-c9b5a4633e00 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:58.207920 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2998c-519b-43ba-a57e-c9b5a4633e00 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:58.208504 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf2998c-519b-43ba-a57e-c9b5a4633e00 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:58.209864 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf2998c-519b-43ba-a57e-c9b5a4633e00 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:58.219003 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-3cf2998c-519b-43ba-a57e-c9b5a4633e00 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 28 00:45:58.219003 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:58.219003 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:45:58.219003 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:45:58.219003 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:45:58.219003 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:45:58.219003 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:45:58.219003 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:45:58.219003 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 28 00:45:58.219003 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:58.219003 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:45:58.219003 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:58.219003 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:58.219003 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:58.219003 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:58.219003 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:58.219003 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:58.220185 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:58.220185 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:58.220185 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:58.220185 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:58.220185 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:58.220185 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:58.220185 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:45:58.220185 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:45:58.220185 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:45:58.220185 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:45:58.220185 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:58.220185 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:58.220185 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:58.220185 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:58.220185 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:58.220185 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:58.221556 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:58.221556 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:58.221556 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:58.221556 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:58.221556 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:58.221556 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:58.221556 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:58.221556 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:58.221556 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:58.221556 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:58.221556 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:45:58.221556 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:45:58.221556 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 28 00:45:58.221556 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:58.221556 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 445/886] 10.222.0.49 () {56 vars in 1114 bytes} [Sun Aug 28 00:45:58 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:58.228733 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993bfa29-c144-4569-805c-ca73f85cb949 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:58.303938 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf2998c-519b-43ba-a57e-c9b5a4633e00 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:58.331404 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:58.334718 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993bfa29-c144-4569-805c-ca73f85cb949 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:58.378006 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080375db-1447-4666-ae0f-ac6d4cd6164f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:58.379285 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080375db-1447-4666-ae0f-ac6d4cd6164f None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:58.380083 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080375db-1447-4666-ae0f-ac6d4cd6164f None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:58.380510 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080375db-1447-4666-ae0f-ac6d4cd6164f None admin] PATH_INFO: `/v3/services` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:58.381538 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080375db-1447-4666-ae0f-ac6d4cd6164f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:58.382380 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080375db-1447-4666-ae0f-ac6d4cd6164f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:58.384230 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080375db-1447-4666-ae0f-ac6d4cd6164f None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:58.391628 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 442/887] 10.222.0.49 () {56 vars in 1114 bytes} [Sun Aug 28 00:45:58 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:58.401680 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080375db-1447-4666-ae0f-ac6d4cd6164f None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:58.427782 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf2998c-519b-43ba-a57e-c9b5a4633e00 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:58.445231 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:58.466222 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc54114-2b4c-4b1f-8d6a-f1ed29e891f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:58.467405 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc54114-2b4c-4b1f-8d6a-f1ed29e891f8 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:58.467405 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc54114-2b4c-4b1f-8d6a-f1ed29e891f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:58.467771 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc54114-2b4c-4b1f-8d6a-f1ed29e891f8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:58.479994 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc54114-2b4c-4b1f-8d6a-f1ed29e891f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:45:58.485695 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-ebc54114-2b4c-4b1f-8d6a-f1ed29e891f8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 00:45:58.485695 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:58.485695 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:58.485695 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:58.485695 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:58.485695 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:58.485695 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:58.485695 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:58.485695 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:58.485695 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:58.485695 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:58.485695 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:58.485695 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:45:58.485695 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:45:58.485695 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:45:58.485695 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:45:58.486961 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:45:58.486961 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:45:58.486961 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:45:58.486961 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:45:58.486961 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:58.486961 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:58.486961 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:58.486961 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:58.486961 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:58.486961 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:58.486961 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:58.486961 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:58.486961 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:58.486961 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:58.486961 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:58.486961 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:58.488031 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:58.488031 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:58.488031 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:58.488031 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:58.488031 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:45:58.488031 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:45:58.488031 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:45:58.488031 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:45:58.488031 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:45:58.488031 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:45:58.488031 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 00:45:58.488031 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:58.491713 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 446/888] 10.222.0.49 () {56 vars in 1120 bytes} [Sun Aug 28 00:45:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:45:58.496158 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc54114-2b4c-4b1f-8d6a-f1ed29e891f8 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:58.544853 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080375db-1447-4666-ae0f-ac6d4cd6164f None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:58.603456 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528cf47-5719-4ede-95f9-e9b87a4524c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:58.604469 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528cf47-5719-4ede-95f9-e9b87a4524c1 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:58.604992 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528cf47-5719-4ede-95f9-e9b87a4524c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:58.606003 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528cf47-5719-4ede-95f9-e9b87a4524c1 None admin] PATH_INFO: `/v3/services` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:58.606857 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a528cf47-5719-4ede-95f9-e9b87a4524c1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:58.607418 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a528cf47-5719-4ede-95f9-e9b87a4524c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:58.608895 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a528cf47-5719-4ede-95f9-e9b87a4524c1 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:58.614530 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 443/889] 10.222.0.49 () {56 vars in 1114 bytes} [Sun Aug 28 00:45:58 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:45:58.620409 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc54114-2b4c-4b1f-8d6a-f1ed29e891f8 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:58.620653 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528cf47-5719-4ede-95f9-e9b87a4524c1 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:58.653920 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:58.663580 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc744f5-d599-470c-b295-870af83890c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:58.664479 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc744f5-d599-470c-b295-870af83890c4 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:58.664910 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc744f5-d599-470c-b295-870af83890c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:58.665328 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc744f5-d599-470c-b295-870af83890c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:58.666196 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc744f5-d599-470c-b295-870af83890c4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:58.666754 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc744f5-d599-470c-b295-870af83890c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:58.668363 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc744f5-d599-470c-b295-870af83890c4 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:58.678421 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 447/890] 10.222.0.49 () {56 vars in 1115 bytes} [Sun Aug 28 00:45:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:45:58.687707 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc744f5-d599-470c-b295-870af83890c4 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:58.744573 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528cf47-5719-4ede-95f9-e9b87a4524c1 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:58.758018 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:58.782835 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de80368-6cbb-428a-b847-76bb17a1eb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:58.783540 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de80368-6cbb-428a-b847-76bb17a1eb96 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:58.783740 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de80368-6cbb-428a-b847-76bb17a1eb96 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:58.784010 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de80368-6cbb-428a-b847-76bb17a1eb96 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:58.784780 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de80368-6cbb-428a-b847-76bb17a1eb96 None admin] RBAC: Adding query filter params (interface=public, service_id=bad6dae0c78d44fd9ebd90715909c3f7, region_id=RegionOne) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:58.785082 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de80368-6cbb-428a-b847-76bb17a1eb96 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:58.786605 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de80368-6cbb-428a-b847-76bb17a1eb96 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:58.799233 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 444/891] 10.222.0.49 () {56 vars in 1251 bytes} [Sun Aug 28 00:45:58 2022] GET /identity/v3/endpoints?service_id=bad6dae0c78d44fd9ebd90715909c3f7&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:58.800720 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de80368-6cbb-428a-b847-76bb17a1eb96 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:58.839910 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc744f5-d599-470c-b295-870af83890c4 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:58.878942 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949d81a-e2ec-46e1-89e6-fbf32a8e1d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:58.879491 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949d81a-e2ec-46e1-89e6-fbf32a8e1d4e None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:58.879796 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949d81a-e2ec-46e1-89e6-fbf32a8e1d4e None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:58.880494 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949d81a-e2ec-46e1-89e6-fbf32a8e1d4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:58.891149 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949d81a-e2ec-46e1-89e6-fbf32a8e1d4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:58.892863 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949d81a-e2ec-46e1-89e6-fbf32a8e1d4e None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:58.910055 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:58.914331 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-5949d81a-e2ec-46e1-89e6-fbf32a8e1d4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:58.914331 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:58.914331 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:58.914331 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:58.914331 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:58.914331 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:58.914331 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:58.914331 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:58.914331 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:58.914331 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:58.914331 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:58.914331 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:58.914331 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:45:58.914331 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:45:58.914331 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:45:58.914331 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:45:58.915466 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:58.915466 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:58.915466 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:58.915466 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:58.915466 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:58.915466 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:58.915466 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:58.915466 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:58.915466 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:58.915466 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:58.915466 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:58.915466 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:58.915466 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:58.915466 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:58.915466 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:58.915466 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:58.915466 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:45:58.916655 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:45:58.916655 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:45:58.916655 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:58.923227 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 448/892] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:45:58.924778 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949d81a-e2ec-46e1-89e6-fbf32a8e1d4e None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:58.927080 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de80368-6cbb-428a-b847-76bb17a1eb96 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:58.963934 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbef1a41-b98c-43a0-8f31-c8a3e3ef9ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:58.964617 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef1a41-b98c-43a0-8f31-c8a3e3ef9ebc None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:58.964896 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef1a41-b98c-43a0-8f31-c8a3e3ef9ebc None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:58.965166 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef1a41-b98c-43a0-8f31-c8a3e3ef9ebc None admin] PATH_INFO: `/v3/services` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:58.965989 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbef1a41-b98c-43a0-8f31-c8a3e3ef9ebc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:58.967199 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbef1a41-b98c-43a0-8f31-c8a3e3ef9ebc None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:58.979921 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 445/893] 10.222.0.49 () {56 vars in 1087 bytes} [Sun Aug 28 00:45:58 2022] GET /identity/v3/services => generated 1268 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:45:59.037578 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:59.049440 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949d81a-e2ec-46e1-89e6-fbf32a8e1d4e None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:59.088009 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e3efc-0e1b-4e30-83f5-5ab97b12e0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:59.089026 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e3efc-0e1b-4e30-83f5-5ab97b12e0fa None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:59.089545 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e3efc-0e1b-4e30-83f5-5ab97b12e0fa None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:59.090007 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e3efc-0e1b-4e30-83f5-5ab97b12e0fa None admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:59.090873 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554e3efc-0e1b-4e30-83f5-5ab97b12e0fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:59.091413 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554e3efc-0e1b-4e30-83f5-5ab97b12e0fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:59.093056 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554e3efc-0e1b-4e30-83f5-5ab97b12e0fa None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:59.100020 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e84f5c-a9cf-4e51-bac1-ec3eddf0dcfc None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:59.100362 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e84f5c-a9cf-4e51-bac1-ec3eddf0dcfc None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:59.100569 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e84f5c-a9cf-4e51-bac1-ec3eddf0dcfc None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:59.102564 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 446/894] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:45:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:45:59.108066 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b75eb-856c-4437-b8b0-9a6a6a2f79d0 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:59.108406 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b75eb-856c-4437-b8b0-9a6a6a2f79d0 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:59.108625 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b75eb-856c-4437-b8b0-9a6a6a2f79d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:59.108993 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 449/895] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:45:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:59.114805 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e3efc-0e1b-4e30-83f5-5ab97b12e0fa None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:59.129593 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-fa0b75eb-856c-4437-b8b0-9a6a6a2f79d0 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:59.130711 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-fa0b75eb-856c-4437-b8b0-9a6a6a2f79d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:59.212901 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 447/896] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:59 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:45:59.234692 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e3efc-0e1b-4e30-83f5-5ab97b12e0fa None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:59.271625 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ac73a1-620f-4aba-8e45-d81dd8c502cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:59.272293 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac73a1-620f-4aba-8e45-d81dd8c502cd None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:59.272571 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac73a1-620f-4aba-8e45-d81dd8c502cd None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:59.272902 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ac73a1-620f-4aba-8e45-d81dd8c502cd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:59.280882 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ac73a1-620f-4aba-8e45-d81dd8c502cd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:59.282394 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ac73a1-620f-4aba-8e45-d81dd8c502cd None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:59.294822 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-a3ac73a1-620f-4aba-8e45-d81dd8c502cd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 00:45:59.294822 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:45:59.294822 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:45:59.294822 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:45:59.294822 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:45:59.294822 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:45:59.294822 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:45:59.294822 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:45:59.294822 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:45:59.294822 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:45:59.294822 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:45:59.294822 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:45:59.294822 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:45:59.294822 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:45:59.294822 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:45:59.294822 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:45:59.295860 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:45:59.295860 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:45:59.295860 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:45:59.295860 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:45:59.295860 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:45:59.295860 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:45:59.295860 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:45:59.295860 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:45:59.295860 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:45:59.295860 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:45:59.295860 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:45:59.295860 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:45:59.295860 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:45:59.295860 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:45:59.295860 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:45:59.295860 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:45:59.295860 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:45:59.295860 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:45:59.296827 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:45:59.296827 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:45:59.296827 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:45:59.296827 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:45:59.296827 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:45:59.296827 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:45:59.296827 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:45:59.296827 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:45:59.296827 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 00:45:59.296827 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:45:59.296827 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 450/897] 10.222.0.49 () {56 vars in 1117 bytes} [Sun Aug 28 00:45:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:45:59.303842 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b75eb-856c-4437-b8b0-9a6a6a2f79d0 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:59.401201 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:59.417132 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b75eb-856c-4437-b8b0-9a6a6a2f79d0 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:59.452809 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7682fd81-a9b2-4353-b81f-0ebb5ab74cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:59.453451 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7682fd81-a9b2-4353-b81f-0ebb5ab74cd3 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:59.453781 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7682fd81-a9b2-4353-b81f-0ebb5ab74cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:59.454050 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7682fd81-a9b2-4353-b81f-0ebb5ab74cd3 None admin] PATH_INFO: `/v3/users` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:59.454826 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7682fd81-a9b2-4353-b81f-0ebb5ab74cd3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:45:59.455439 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7682fd81-a9b2-4353-b81f-0ebb5ab74cd3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:59.457309 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7682fd81-a9b2-4353-b81f-0ebb5ab74cd3 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:59.476730 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 448/898] 10.222.0.49 () {56 vars in 1149 bytes} [Sun Aug 28 00:45:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:45:59.482424 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ac73a1-620f-4aba-8e45-d81dd8c502cd None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:59.493260 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7682fd81-a9b2-4353-b81f-0ebb5ab74cd3 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:45:59.497627 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:59.608921 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ac73a1-620f-4aba-8e45-d81dd8c502cd None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:59.627073 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7682fd81-a9b2-4353-b81f-0ebb5ab74cd3 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:45:59.650303 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edec942-1e67-4f7a-8ebc-02af2fda682d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:59.650930 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edec942-1e67-4f7a-8ebc-02af2fda682d None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:59.651276 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edec942-1e67-4f7a-8ebc-02af2fda682d None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:59.651499 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edec942-1e67-4f7a-8ebc-02af2fda682d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:59.666559 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffef621-34bf-4b6a-9e48-cf765e5ce2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:45:59.667282 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffef621-34bf-4b6a-9e48-cf765e5ce2b9 None admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:59.667562 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffef621-34bf-4b6a-9e48-cf765e5ce2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:59.667862 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffef621-34bf-4b6a-9e48-cf765e5ce2b9 None admin] PATH_INFO: `/v3/services` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:59.668540 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffef621-34bf-4b6a-9e48-cf765e5ce2b9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:59.669909 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffef621-34bf-4b6a-9e48-cf765e5ce2b9 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:59.687994 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 449/899] 10.222.0.49 () {60 vars in 1141 bytes} [Sun Aug 28 00:45:59 2022] POST /identity/v3/services => generated 241 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:45:59.689494 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a308c0-1ee8-47bc-89d9-a68f1c503ddc None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:59.689784 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a308c0-1ee8-47bc-89d9-a68f1c503ddc None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:59.690057 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a308c0-1ee8-47bc-89d9-a68f1c503ddc None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:59.691740 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 450/900] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:45:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:45:59.697818 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b02eefc-5e9b-4a83-be3d-527c4ea531c8 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:45:59.698170 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b02eefc-5e9b-4a83-be3d-527c4ea531c8 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:45:59.698406 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b02eefc-5e9b-4a83-be3d-527c4ea531c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:45:59.707709 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:59.721874 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-0b02eefc-5e9b-4a83-be3d-527c4ea531c8 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:45:59.723356 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-0b02eefc-5e9b-4a83-be3d-527c4ea531c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:45:59.765896 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edec942-1e67-4f7a-8ebc-02af2fda682d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:45:59.768718 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edec942-1e67-4f7a-8ebc-02af2fda682d None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:45:59.786494 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:45:59.818977 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 451/901] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:45:59 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:45:59.893079 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 451/902] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 28 00:45:59 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:45:59.898441 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b02eefc-5e9b-4a83-be3d-527c4ea531c8 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:00.004098 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b02eefc-5e9b-4a83-be3d-527c4ea531c8 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:00.036700 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:00.043777 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c6d84-8a02-4f63-b630-91083fea7c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:00.044748 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c6d84-8a02-4f63-b630-91083fea7c69 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:00.045203 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c6d84-8a02-4f63-b630-91083fea7c69 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:00.045676 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c6d84-8a02-4f63-b630-91083fea7c69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:00.057037 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6c6d84-8a02-4f63-b630-91083fea7c69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:00.058829 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6c6d84-8a02-4f63-b630-91083fea7c69 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:00.074876 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-8c6c6d84-8a02-4f63-b630-91083fea7c69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:00.074876 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:00.074876 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:00.074876 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:00.074876 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:00.074876 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:00.074876 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:00.074876 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:00.074876 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:00.074876 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:00.074876 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:00.074876 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:00.074876 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:46:00.074876 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:46:00.074876 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:46:00.074876 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:46:00.075911 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:00.075911 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:00.075911 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:00.075911 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:00.075911 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:00.075911 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:00.075911 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:00.075911 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:00.075911 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:00.075911 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:00.075911 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:00.075911 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:00.075911 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:00.075911 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:00.075911 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:00.075911 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:00.075911 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:46:00.076867 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:46:00.076867 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:00.076867 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:46:00.078797 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 452/903] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:45:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:46:00.086092 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edec942-1e67-4f7a-8ebc-02af2fda682d None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:00.093722 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c6d84-8a02-4f63-b630-91083fea7c69 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:00.204304 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edec942-1e67-4f7a-8ebc-02af2fda682d None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:00.220076 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:00.228961 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c6d84-8a02-4f63-b630-91083fea7c69 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:00.243080 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9965139a-8936-49fa-b3ae-d7ba90273a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:00.243870 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9965139a-8936-49fa-b3ae-d7ba90273a72 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:00.244278 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9965139a-8936-49fa-b3ae-d7ba90273a72 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:00.244712 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9965139a-8936-49fa-b3ae-d7ba90273a72 None admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:00.245388 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9965139a-8936-49fa-b3ae-d7ba90273a72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:00.245808 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9965139a-8936-49fa-b3ae-d7ba90273a72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:00.247396 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9965139a-8936-49fa-b3ae-d7ba90273a72 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:00.261180 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 452/904] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:46:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:00.266658 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9965139a-8936-49fa-b3ae-d7ba90273a72 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:00.273433 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bdf718-d8fe-4a73-945c-b4ff861d8834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:00.274125 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bdf718-d8fe-4a73-945c-b4ff861d8834 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:00.274410 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bdf718-d8fe-4a73-945c-b4ff861d8834 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:00.274681 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bdf718-d8fe-4a73-945c-b4ff861d8834 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:00.275310 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bdf718-d8fe-4a73-945c-b4ff861d8834 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:00.276718 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bdf718-d8fe-4a73-945c-b4ff861d8834 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:00.286174 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-16bdf718-d8fe-4a73-945c-b4ff861d8834 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 28 00:46:00.286174 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:00.286174 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:46:00.286174 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:46:00.286174 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:46:00.286174 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:46:00.286174 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:46:00.286174 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:46:00.286174 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 28 00:46:00.286174 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:46:00.286174 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:46:00.286174 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:46:00.286174 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:00.286174 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:00.286174 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:00.286174 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:00.287170 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:00.287170 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:00.287170 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:00.287170 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:00.287170 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:00.287170 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:00.287170 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:00.287170 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:46:00.287170 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:46:00.287170 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:46:00.287170 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:46:00.287170 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:00.287170 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:00.287170 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:00.287170 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:00.287170 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:00.287170 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:00.288701 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:00.288701 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:00.288701 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:00.288701 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:00.288701 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:00.288701 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:00.288701 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:00.288701 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:00.288701 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:00.288701 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:00.288701 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:46:00.288701 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:46:00.288701 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 28 00:46:00.288701 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:46:00.292371 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 453/905] 10.222.0.49 () {56 vars in 1132 bytes} [Sun Aug 28 00:46:00 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:00.293279 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bdf718-d8fe-4a73-945c-b4ff861d8834 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:00.342238 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:00.399500 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9965139a-8936-49fa-b3ae-d7ba90273a72 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:00.419763 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bdf718-d8fe-4a73-945c-b4ff861d8834 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:00.443291 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e08f321-2335-4d5f-8b3c-626291104490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:00.444619 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08f321-2335-4d5f-8b3c-626291104490 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:00.445400 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08f321-2335-4d5f-8b3c-626291104490 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:00.446287 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08f321-2335-4d5f-8b3c-626291104490 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:00.456512 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e08f321-2335-4d5f-8b3c-626291104490 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:00.457428 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68528014-1639-4d37-9f6e-9aaa083f97f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:00.458112 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68528014-1639-4d37-9f6e-9aaa083f97f0 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:00.458458 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68528014-1639-4d37-9f6e-9aaa083f97f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:00.458800 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68528014-1639-4d37-9f6e-9aaa083f97f0 None admin] PATH_INFO: `/v3/services` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:00.459035 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e08f321-2335-4d5f-8b3c-626291104490 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:00.459575 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68528014-1639-4d37-9f6e-9aaa083f97f0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:00.459973 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68528014-1639-4d37-9f6e-9aaa083f97f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:00.461441 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68528014-1639-4d37-9f6e-9aaa083f97f0 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:00.471445 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 454/906] 10.222.0.49 () {56 vars in 1126 bytes} [Sun Aug 28 00:46:00 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:00.472429 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68528014-1639-4d37-9f6e-9aaa083f97f0 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:00.473316 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-6e08f321-2335-4d5f-8b3c-626291104490 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:46:00.473316 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:00.473316 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:00.473316 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:00.473316 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:00.473316 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:00.473316 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:00.473316 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:00.473316 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:00.473316 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:00.473316 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:00.473316 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:00.473316 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:46:00.473316 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:46:00.473316 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:46:00.474220 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:46:00.474220 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:00.474220 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:00.474220 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:00.474220 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:00.474220 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:00.474220 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:00.474220 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:00.474220 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:00.474220 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:00.474220 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:00.474220 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:00.474220 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:00.474220 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:00.474220 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:00.474220 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:00.474220 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:00.475146 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:46:00.475146 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:46:00.475146 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:46:00.475146 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:46:00.475146 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:46:00.475146 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:46:00.475146 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:46:00.475146 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:46:00.478533 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 453/907] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 28 00:46:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:00.487028 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e08f321-2335-4d5f-8b3c-626291104490 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:00.527582 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:00.606259 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68528014-1639-4d37-9f6e-9aaa083f97f0 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:00.621852 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:00.632867 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e08f321-2335-4d5f-8b3c-626291104490 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:00.649101 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f59ddf-b31b-4913-a202-7457cea1d02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:00.649937 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f59ddf-b31b-4913-a202-7457cea1d02c None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:00.650376 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f59ddf-b31b-4913-a202-7457cea1d02c None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:00.650773 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f59ddf-b31b-4913-a202-7457cea1d02c None admin] PATH_INFO: `/v3/services` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:00.651527 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f59ddf-b31b-4913-a202-7457cea1d02c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:00.651966 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f59ddf-b31b-4913-a202-7457cea1d02c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:00.653438 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f59ddf-b31b-4913-a202-7457cea1d02c None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:00.664254 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 455/908] 10.222.0.49 () {56 vars in 1126 bytes} [Sun Aug 28 00:46:00 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:00.665358 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f59ddf-b31b-4913-a202-7457cea1d02c None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:00.676505 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e98ca-a9de-4f15-b6d2-586f9290ddee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:00.677372 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e98ca-a9de-4f15-b6d2-586f9290ddee None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:00.678356 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e98ca-a9de-4f15-b6d2-586f9290ddee None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:00.678805 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e98ca-a9de-4f15-b6d2-586f9290ddee None admin] PATH_INFO: `/v3/projects` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:00.679710 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785e98ca-a9de-4f15-b6d2-586f9290ddee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:00.680659 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785e98ca-a9de-4f15-b6d2-586f9290ddee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:00.683307 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785e98ca-a9de-4f15-b6d2-586f9290ddee None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:00.706620 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 454/909] 10.222.0.49 () {56 vars in 1148 bytes} [Sun Aug 28 00:46:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:46:00.708322 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e98ca-a9de-4f15-b6d2-586f9290ddee None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:00.795560 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f59ddf-b31b-4913-a202-7457cea1d02c None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:00.838599 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e6fc5a-6282-449d-b1e4-466669c02f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:00.839262 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6fc5a-6282-449d-b1e4-466669c02f85 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:00.839589 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6fc5a-6282-449d-b1e4-466669c02f85 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:00.839808 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6fc5a-6282-449d-b1e4-466669c02f85 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:00.840729 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e6fc5a-6282-449d-b1e4-466669c02f85 None admin] RBAC: Adding query filter params (interface=public, service_id=333eb6d7df0b49c9ba0dab1363726daa, region_id=RegionOne) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:00.841044 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e6fc5a-6282-449d-b1e4-466669c02f85 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:00.842477 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e6fc5a-6282-449d-b1e4-466669c02f85 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:00.843304 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:00.854627 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 456/910] 10.222.0.49 () {56 vars in 1251 bytes} [Sun Aug 28 00:46:00 2022] GET /identity/v3/endpoints?service_id=333eb6d7df0b49c9ba0dab1363726daa&interface=public®ion_id=RegionOne => generated 194 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:00.855654 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e6fc5a-6282-449d-b1e4-466669c02f85 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:00.857756 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e98ca-a9de-4f15-b6d2-586f9290ddee None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:00.898269 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:00.908079 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd0058b-69d4-497c-9ca2-0801a98a2514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:00.909531 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0058b-69d4-497c-9ca2-0801a98a2514 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:00.909810 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0058b-69d4-497c-9ca2-0801a98a2514 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:00.910080 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd0058b-69d4-497c-9ca2-0801a98a2514 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:00.910823 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd0058b-69d4-497c-9ca2-0801a98a2514 None admin] RBAC: Adding query filter params (role.id=0113a36accc54c15b333655ed6b73d82, scope.project.id=6d6e897c6391486e9c44e9277a3ee823, user.id=cbe0653ed0c04a9080b5c337392de8ad) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:00.911133 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd0058b-69d4-497c-9ca2-0801a98a2514 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:00.912618 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd0058b-69d4-497c-9ca2-0801a98a2514 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:00.928120 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 455/911] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 28 00:46:00 2022] GET /identity/v3/role_assignments?user.id=cbe0653ed0c04a9080b5c337392de8ad&scope.project.id=6d6e897c6391486e9c44e9277a3ee823&role.id=0113a36accc54c15b333655ed6b73d82 => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:00.981641 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e6fc5a-6282-449d-b1e4-466669c02f85 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:00.990778 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba803129-2d99-47e5-b997-6efceaab810a None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:00.991136 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba803129-2d99-47e5-b997-6efceaab810a None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:00.991315 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba803129-2d99-47e5-b997-6efceaab810a None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:00.993224 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 456/912] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:46:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:01.001442 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d1fad-6a76-45c2-86c9-35982117e0a3 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:01.001442 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d1fad-6a76-45c2-86c9-35982117e0a3 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:01.001895 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d1fad-6a76-45c2-86c9-35982117e0a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:01.024193 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-fd4d1fad-6a76-45c2-86c9-35982117e0a3 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:01.025637 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-fd4d1fad-6a76-45c2-86c9-35982117e0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:01.027477 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dafd08-4d9b-441e-955c-6289210cdc6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:01.028303 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dafd08-4d9b-441e-955c-6289210cdc6d None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:01.028720 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dafd08-4d9b-441e-955c-6289210cdc6d None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:01.029150 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dafd08-4d9b-441e-955c-6289210cdc6d None admin] PATH_INFO: `/v3/services` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:01.030013 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dafd08-4d9b-441e-955c-6289210cdc6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:01.031590 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dafd08-4d9b-441e-955c-6289210cdc6d None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:01.039307 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 457/913] 10.222.0.49 () {56 vars in 1087 bytes} [Sun Aug 28 00:46:00 2022] GET /identity/v3/services => generated 1497 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 00:46:01.128037 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 457/914] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:00 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:46:01.396264 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dafd08-4d9b-441e-955c-6289210cdc6d None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:01.513138 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dafd08-4d9b-441e-955c-6289210cdc6d None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:01.514880 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:01.564392 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c567f1-1659-47d7-b464-d0bc8d653cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:01.565295 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c567f1-1659-47d7-b464-d0bc8d653cc2 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:01.565644 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c567f1-1659-47d7-b464-d0bc8d653cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:01.565949 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c567f1-1659-47d7-b464-d0bc8d653cc2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:01.566904 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c567f1-1659-47d7-b464-d0bc8d653cc2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:01.569009 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c567f1-1659-47d7-b464-d0bc8d653cc2 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:01.584417 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-55c567f1-1659-47d7-b464-d0bc8d653cc2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 28 00:46:01.584417 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:01.584417 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:46:01.584417 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:46:01.584417 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:46:01.584417 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:46:01.584417 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:46:01.584417 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:46:01.584417 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 28 00:46:01.584417 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:46:01.584417 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:46:01.584417 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:46:01.584417 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:01.584417 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:01.584417 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:01.584417 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:01.584417 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:01.585489 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:01.585489 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:01.585489 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:01.585489 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:01.585489 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:01.585489 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:01.585489 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:46:01.585489 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:46:01.585489 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:46:01.585489 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:46:01.585489 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:01.585489 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:01.585489 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:01.585489 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:01.585489 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:01.585489 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:01.586343 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:01.586343 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:01.586343 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:01.586343 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:01.586343 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:01.586343 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:01.586343 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:01.586343 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:01.586343 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:01.586343 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:01.586343 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:46:01.586343 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:46:01.586343 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 28 00:46:01.586343 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:46:01.586343 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 458/915] 10.222.0.49 () {56 vars in 1114 bytes} [Sun Aug 28 00:46:01 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:01.594729 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d1fad-6a76-45c2-86c9-35982117e0a3 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:01.679977 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74c448-5e50-4475-9e38-32baac2ced7d None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:01.680182 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74c448-5e50-4475-9e38-32baac2ced7d None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:01.680437 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec74c448-5e50-4475-9e38-32baac2ced7d None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:01.682153 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 459/916] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:46:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:46:01.687569 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19affb2-b9df-4796-9e6d-77777877a38d None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:01.687889 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19affb2-b9df-4796-9e6d-77777877a38d None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:01.688140 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19affb2-b9df-4796-9e6d-77777877a38d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:01.700269 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:01.710146 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-c19affb2-b9df-4796-9e6d-77777877a38d None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:01.711369 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-c19affb2-b9df-4796-9e6d-77777877a38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:01.720504 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d1fad-6a76-45c2-86c9-35982117e0a3 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:01.770544 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f0bb9-c02e-42c7-b6f9-3c78f369f993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:01.770544 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f0bb9-c02e-42c7-b6f9-3c78f369f993 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:01.770544 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f0bb9-c02e-42c7-b6f9-3c78f369f993 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:01.770544 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f0bb9-c02e-42c7-b6f9-3c78f369f993 None admin] PATH_INFO: `/v3/services` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:01.770972 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47f0bb9-c02e-42c7-b6f9-3c78f369f993 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:01.770972 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47f0bb9-c02e-42c7-b6f9-3c78f369f993 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:01.770972 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47f0bb9-c02e-42c7-b6f9-3c78f369f993 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:01.770972 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 458/917] 10.222.0.49 () {56 vars in 1114 bytes} [Sun Aug 28 00:46:01 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:01.777121 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f0bb9-c02e-42c7-b6f9-3c78f369f993 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:01.789457 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 460/918] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:46:01.892557 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f0bb9-c02e-42c7-b6f9-3c78f369f993 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:01.929316 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d6419-2c95-4207-9baf-76bf4530886f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:01.929935 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d6419-2c95-4207-9baf-76bf4530886f None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:01.930273 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d6419-2c95-4207-9baf-76bf4530886f None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:01.930482 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d6419-2c95-4207-9baf-76bf4530886f None admin] PATH_INFO: `/v3/services` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:01.931126 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8d6419-2c95-4207-9baf-76bf4530886f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:01.931484 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8d6419-2c95-4207-9baf-76bf4530886f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:01.932902 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8d6419-2c95-4207-9baf-76bf4530886f None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:01.938721 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 459/919] 10.222.0.49 () {56 vars in 1114 bytes} [Sun Aug 28 00:46:01 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:01.944420 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19affb2-b9df-4796-9e6d-77777877a38d None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:02.040513 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:02.046307 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19affb2-b9df-4796-9e6d-77777877a38d None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:02.066163 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d6419-2c95-4207-9baf-76bf4530886f None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:02.082196 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200c1ce7-b979-4c97-8697-281332931df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:02.082799 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c1ce7-b979-4c97-8697-281332931df3 None admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:02.083072 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c1ce7-b979-4c97-8697-281332931df3 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:02.083336 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c1ce7-b979-4c97-8697-281332931df3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:02.084051 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200c1ce7-b979-4c97-8697-281332931df3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:02.085121 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:02.085418 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200c1ce7-b979-4c97-8697-281332931df3 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:02.115699 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 461/920] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 00:46:01 2022] POST /identity/v3/endpoints => generated 346 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:46:02.198454 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d6419-2c95-4207-9baf-76bf4530886f None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:02.252288 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b427b31-f699-4837-94e6-0c6e1f21d9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:02.253312 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b427b31-f699-4837-94e6-0c6e1f21d9ed None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:02.253794 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b427b31-f699-4837-94e6-0c6e1f21d9ed None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:02.254264 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b427b31-f699-4837-94e6-0c6e1f21d9ed None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:02.255088 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b427b31-f699-4837-94e6-0c6e1f21d9ed None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:02.256779 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b427b31-f699-4837-94e6-0c6e1f21d9ed None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:02.267228 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-9b427b31-f699-4837-94e6-0c6e1f21d9ed None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 00:46:02.267228 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:02.267228 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:46:02.267228 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:46:02.267228 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:46:02.267228 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:46:02.267228 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:46:02.267228 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:46:02.267228 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 00:46:02.267228 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:46:02.267228 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:46:02.267228 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:46:02.267228 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:02.267228 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:02.267228 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:02.267228 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:02.267228 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:02.268381 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:02.268381 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:02.268381 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:02.268381 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:02.268381 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:02.268381 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:02.268381 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:46:02.268381 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:46:02.268381 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:46:02.268381 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:46:02.268381 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:02.268381 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:02.268381 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:02.268381 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:02.268381 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:02.268381 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:02.269210 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:02.269210 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:02.269210 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:02.269210 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:02.269210 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:02.269210 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:02.269210 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:02.269210 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:02.269210 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:02.269210 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:02.269210 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:46:02.269210 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:46:02.269210 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 00:46:02.269210 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:46:02.272229 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 460/921] 10.222.0.49 () {56 vars in 1126 bytes} [Sun Aug 28 00:46:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:02.279031 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200c1ce7-b979-4c97-8697-281332931df3 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:02.385092 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200c1ce7-b979-4c97-8697-281332931df3 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:02.422187 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08116e-ee16-42b6-836f-156657f15146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:02.423261 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08116e-ee16-42b6-836f-156657f15146 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:02.423767 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08116e-ee16-42b6-836f-156657f15146 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:02.424259 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08116e-ee16-42b6-836f-156657f15146 None admin] PATH_INFO: `/v3/services` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:02.425100 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c08116e-ee16-42b6-836f-156657f15146 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:02.425624 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c08116e-ee16-42b6-836f-156657f15146 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:02.427202 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c08116e-ee16-42b6-836f-156657f15146 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:02.433303 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 462/922] 10.222.0.49 () {56 vars in 1122 bytes} [Sun Aug 28 00:46:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:02.439388 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b427b31-f699-4837-94e6-0c6e1f21d9ed None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:02.517513 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:02.562687 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b427b31-f699-4837-94e6-0c6e1f21d9ed None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:02.600000 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b642c2-b609-4769-968e-756e9d1c9af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:02.601462 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b642c2-b609-4769-968e-756e9d1c9af4 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:02.601945 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b642c2-b609-4769-968e-756e9d1c9af4 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:02.602428 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b642c2-b609-4769-968e-756e9d1c9af4 None admin] PATH_INFO: `/v3/services` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:02.603315 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b642c2-b609-4769-968e-756e9d1c9af4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:02.603970 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b642c2-b609-4769-968e-756e9d1c9af4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:02.605559 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b642c2-b609-4769-968e-756e9d1c9af4 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:02.611479 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 461/923] 10.222.0.49 () {56 vars in 1122 bytes} [Sun Aug 28 00:46:02 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:02.617800 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08116e-ee16-42b6-836f-156657f15146 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:02.636889 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:02.726673 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08116e-ee16-42b6-836f-156657f15146 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:02.776504 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e58be-ce87-408c-99a9-8c032f691672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:02.777793 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e58be-ce87-408c-99a9-8c032f691672 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:02.778461 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e58be-ce87-408c-99a9-8c032f691672 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:02.779144 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e58be-ce87-408c-99a9-8c032f691672 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:02.780094 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285e58be-ce87-408c-99a9-8c032f691672 None admin] RBAC: Adding query filter params (interface=public, service_id=e9a6d029e1ea4b0ea814674ae9a0829f, region_id=RegionOne) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:02.780642 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285e58be-ce87-408c-99a9-8c032f691672 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:02.782314 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285e58be-ce87-408c-99a9-8c032f691672 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:02.790900 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 463/924] 10.222.0.49 () {56 vars in 1251 bytes} [Sun Aug 28 00:46:02 2022] GET /identity/v3/endpoints?service_id=e9a6d029e1ea4b0ea814674ae9a0829f&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:02.798132 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b642c2-b609-4769-968e-756e9d1c9af4 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:02.913275 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b642c2-b609-4769-968e-756e9d1c9af4 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:02.949507 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049210aa-be4b-43a9-bfad-bf74e4c19afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:02.950131 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049210aa-be4b-43a9-bfad-bf74e4c19afc None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:02.950408 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049210aa-be4b-43a9-bfad-bf74e4c19afc None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:02.950680 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049210aa-be4b-43a9-bfad-bf74e4c19afc None admin] PATH_INFO: `/v3/services` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:02.951296 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049210aa-be4b-43a9-bfad-bf74e4c19afc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:02.952724 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049210aa-be4b-43a9-bfad-bf74e4c19afc None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:02.954772 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:02.961151 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 462/925] 10.222.0.49 () {56 vars in 1087 bytes} [Sun Aug 28 00:46:02 2022] GET /identity/v3/services => generated 1497 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:46:02.962860 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc986a1-3744-42c2-bab7-213d7f970da4 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:02.963314 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc986a1-3744-42c2-bab7-213d7f970da4 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:02.963432 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc986a1-3744-42c2-bab7-213d7f970da4 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:02.966184 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 464/926] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:46:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:02.970895 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1316b5f-18ad-433c-8195-247ccb18b757 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:02.971188 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1316b5f-18ad-433c-8195-247ccb18b757 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:02.971449 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1316b5f-18ad-433c-8195-247ccb18b757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:02.995411 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-c1316b5f-18ad-433c-8195-247ccb18b757 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:02.996750 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-c1316b5f-18ad-433c-8195-247ccb18b757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:03.074269 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 463/927] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:02 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:46:03.106175 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbabf3f-d57b-4b4d-9156-76bef13e826f None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:03.107097 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbabf3f-d57b-4b4d-9156-76bef13e826f None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:03.107924 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbabf3f-d57b-4b4d-9156-76bef13e826f None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:03.110456 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 465/928] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:46:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:46:03.116729 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de9da1-3274-4f1d-a0a2-b44a5b4fd875 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:03.116729 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de9da1-3274-4f1d-a0a2-b44a5b4fd875 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:03.117021 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de9da1-3274-4f1d-a0a2-b44a5b4fd875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:03.138261 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-a7de9da1-3274-4f1d-a0a2-b44a5b4fd875 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:03.139460 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-a7de9da1-3274-4f1d-a0a2-b44a5b4fd875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:03.218555 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 464/929] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:03 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:46:03.342995 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbabf3f-d57b-4b4d-9156-76bef13e826f None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:03.427916 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:03.448180 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbabf3f-d57b-4b4d-9156-76bef13e826f None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:03.485703 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f4ab9-bb2c-4f27-b5ed-b67ecf390d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:03.486351 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f4ab9-bb2c-4f27-b5ed-b67ecf390d80 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:03.486630 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f4ab9-bb2c-4f27-b5ed-b67ecf390d80 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:03.486898 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f4ab9-bb2c-4f27-b5ed-b67ecf390d80 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:03.498484 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070f4ab9-bb2c-4f27-b5ed-b67ecf390d80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:46:03.503568 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-070f4ab9-bb2c-4f27-b5ed-b67ecf390d80 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 00:46:03.503568 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:03.503568 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:03.503568 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:03.503568 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:03.503568 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:03.503568 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:03.503568 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:03.503568 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:03.503568 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:03.503568 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:03.503568 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:03.503568 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:46:03.503568 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:46:03.503568 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:46:03.503568 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:46:03.504530 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:46:03.504530 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:46:03.504530 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:46:03.504530 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:46:03.504530 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:03.504530 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:03.504530 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:03.504530 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:03.504530 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:03.504530 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:03.504530 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:03.504530 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:03.504530 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:03.504530 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:03.504530 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:03.504530 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:03.505378 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:03.505378 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:03.505378 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:03.505378 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:03.505378 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:46:03.505378 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:46:03.505378 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:46:03.505378 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:46:03.505378 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:46:03.505378 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:46:03.505378 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 00:46:03.505378 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:46:03.509978 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 466/930] 10.222.0.49 () {56 vars in 1120 bytes} [Sun Aug 28 00:46:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:03.511608 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f4ab9-bb2c-4f27-b5ed-b67ecf390d80 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:03.511745 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7de9da1-3274-4f1d-a0a2-b44a5b4fd875 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:03.581332 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:03.628166 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f4ab9-bb2c-4f27-b5ed-b67ecf390d80 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:03.630090 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7de9da1-3274-4f1d-a0a2-b44a5b4fd875 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:03.668884 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e9b2b-b971-4a0a-9ec9-f25c6567b3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:03.669548 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e9b2b-b971-4a0a-9ec9-f25c6567b3c3 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:03.669829 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e9b2b-b971-4a0a-9ec9-f25c6567b3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:03.670096 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e9b2b-b971-4a0a-9ec9-f25c6567b3c3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:03.670694 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872e9b2b-b971-4a0a-9ec9-f25c6567b3c3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:03.672157 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872e9b2b-b971-4a0a-9ec9-f25c6567b3c3 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:03.672916 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e11da7-87f5-4228-891a-3e335365bdaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:03.673819 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e11da7-87f5-4228-891a-3e335365bdaf None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:03.674390 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e11da7-87f5-4228-891a-3e335365bdaf None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:03.674856 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e11da7-87f5-4228-891a-3e335365bdaf None admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:03.675863 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e11da7-87f5-4228-891a-3e335365bdaf None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:03.676409 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e11da7-87f5-4228-891a-3e335365bdaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:03.678069 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e11da7-87f5-4228-891a-3e335365bdaf None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:03.682827 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-872e9b2b-b971-4a0a-9ec9-f25c6567b3c3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 28 00:46:03.682827 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:03.682827 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:46:03.682827 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:46:03.682827 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:46:03.682827 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:46:03.682827 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:46:03.682827 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:46:03.682827 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 28 00:46:03.682827 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:46:03.682827 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:46:03.682827 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:46:03.682827 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:03.682827 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:03.682827 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:03.682827 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:03.683882 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:03.683882 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:03.683882 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:03.683882 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:03.683882 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:03.683882 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:03.683882 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:03.683882 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:46:03.683882 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:46:03.683882 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:46:03.683882 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:46:03.683882 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:03.683882 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:03.683882 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:03.683882 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:03.683882 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:03.683882 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:03.684792 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:03.684792 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:03.684792 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:03.684792 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:03.684792 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:03.684792 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:03.684792 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:03.684792 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:03.684792 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:03.684792 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:03.684792 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:46:03.684792 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:46:03.684792 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 28 00:46:03.684792 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:46:03.689658 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 467/931] 10.222.0.49 () {56 vars in 1132 bytes} [Sun Aug 28 00:46:03 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:03.690912 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e9b2b-b971-4a0a-9ec9-f25c6567b3c3 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:03.697725 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 465/932] 10.222.0.49 () {56 vars in 1115 bytes} [Sun Aug 28 00:46:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:03.699274 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e11da7-87f5-4228-891a-3e335365bdaf None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:03.700510 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:03.808643 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e9b2b-b971-4a0a-9ec9-f25c6567b3c3 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:03.809449 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e11da7-87f5-4228-891a-3e335365bdaf None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:03.840046 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:03.845271 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3fb424-ed8c-4827-a3dd-848b6bd3f4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:03.846095 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3fb424-ed8c-4827-a3dd-848b6bd3f4f8 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:03.846522 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3fb424-ed8c-4827-a3dd-848b6bd3f4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:03.846816 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ab621f-6c6e-49af-9d25-de30a33ab668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:03.847139 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3fb424-ed8c-4827-a3dd-848b6bd3f4f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:03.847759 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab621f-6c6e-49af-9d25-de30a33ab668 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:03.848321 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab621f-6c6e-49af-9d25-de30a33ab668 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:03.848694 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab621f-6c6e-49af-9d25-de30a33ab668 None admin] PATH_INFO: `/v3/services` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:03.849441 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ab621f-6c6e-49af-9d25-de30a33ab668 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:03.849841 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ab621f-6c6e-49af-9d25-de30a33ab668 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:03.851455 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ab621f-6c6e-49af-9d25-de30a33ab668 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:03.857517 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 468/933] 10.222.0.49 () {56 vars in 1126 bytes} [Sun Aug 28 00:46:03 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:03.863054 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ab621f-6c6e-49af-9d25-de30a33ab668 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:03.864079 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3fb424-ed8c-4827-a3dd-848b6bd3f4f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:03.865566 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3fb424-ed8c-4827-a3dd-848b6bd3f4f8 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:03.881029 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-1b3fb424-ed8c-4827-a3dd-848b6bd3f4f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:03.881029 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:03.881029 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:03.881029 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:03.881029 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:03.881029 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:03.881029 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:03.881029 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:03.881029 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:03.881029 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:03.881029 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:03.881029 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:03.881029 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:46:03.881029 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:46:03.881029 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:46:03.881029 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:46:03.882040 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:03.882040 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:03.882040 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:03.882040 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:03.882040 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:03.882040 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:03.882040 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:03.882040 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:03.882040 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:03.882040 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:03.882040 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:03.882040 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:03.882040 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:03.882040 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:03.882040 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:03.882040 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:03.882040 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:46:03.882953 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:46:03.882953 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:03.882953 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:46:03.887316 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 466/934] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:46:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:03.888269 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3fb424-ed8c-4827-a3dd-848b6bd3f4f8 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:03.941941 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:03.980921 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ab621f-6c6e-49af-9d25-de30a33ab668 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:03.990640 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3fb424-ed8c-4827-a3dd-848b6bd3f4f8 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:04.019786 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344db0c-d15e-44d6-94ca-b8cc2d551bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:04.020859 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344db0c-d15e-44d6-94ca-b8cc2d551bdc None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:04.021406 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344db0c-d15e-44d6-94ca-b8cc2d551bdc None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:04.021973 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344db0c-d15e-44d6-94ca-b8cc2d551bdc None admin] PATH_INFO: `/v3/services` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:04.023024 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b344db0c-d15e-44d6-94ca-b8cc2d551bdc None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:04.023609 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b344db0c-d15e-44d6-94ca-b8cc2d551bdc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:04.025440 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa02f06-43b0-4df0-9f5c-ac32bb3241d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:04.025826 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b344db0c-d15e-44d6-94ca-b8cc2d551bdc None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:04.026200 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa02f06-43b0-4df0-9f5c-ac32bb3241d3 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:04.026538 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa02f06-43b0-4df0-9f5c-ac32bb3241d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:04.026869 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa02f06-43b0-4df0-9f5c-ac32bb3241d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:04.027576 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa02f06-43b0-4df0-9f5c-ac32bb3241d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:04.027965 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa02f06-43b0-4df0-9f5c-ac32bb3241d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:04.029455 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa02f06-43b0-4df0-9f5c-ac32bb3241d3 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:04.033095 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 469/935] 10.222.0.49 () {56 vars in 1126 bytes} [Sun Aug 28 00:46:03 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:46:04.040512 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344db0c-d15e-44d6-94ca-b8cc2d551bdc None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:04.051945 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 467/936] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:46:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:04.052872 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa02f06-43b0-4df0-9f5c-ac32bb3241d3 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:04.087587 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:04.157656 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa02f06-43b0-4df0-9f5c-ac32bb3241d3 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:04.158482 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344db0c-d15e-44d6-94ca-b8cc2d551bdc None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:04.191637 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:04.192590 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a906e9-7390-48f2-becb-f3cbefff6695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:04.193318 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a906e9-7390-48f2-becb-f3cbefff6695 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:04.193684 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a906e9-7390-48f2-becb-f3cbefff6695 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:04.194037 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a906e9-7390-48f2-becb-f3cbefff6695 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:04.199380 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fdd15b-774a-42af-a8fd-5e0fb5d90312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:04.200252 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fdd15b-774a-42af-a8fd-5e0fb5d90312 None admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:04.200674 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fdd15b-774a-42af-a8fd-5e0fb5d90312 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:04.201096 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fdd15b-774a-42af-a8fd-5e0fb5d90312 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:04.201934 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fdd15b-774a-42af-a8fd-5e0fb5d90312 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:04.202836 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a906e9-7390-48f2-becb-f3cbefff6695 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:04.203774 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fdd15b-774a-42af-a8fd-5e0fb5d90312 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:04.204583 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a906e9-7390-48f2-becb-f3cbefff6695 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:04.217973 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-c4a906e9-7390-48f2-becb-f3cbefff6695 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 00:46:04.217973 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:04.217973 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:04.217973 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:04.217973 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:04.217973 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:04.217973 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:04.217973 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:04.217973 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:04.217973 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:04.217973 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:04.217973 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:04.217973 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:46:04.217973 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:46:04.217973 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:46:04.217973 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:46:04.219423 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:04.219423 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:04.219423 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:46:04.219423 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:46:04.219423 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:46:04.219423 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:46:04.219423 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:04.219423 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:04.219423 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:04.219423 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:04.219423 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:04.219423 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:04.219423 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:04.219423 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:04.219423 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:04.219423 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:04.219423 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:04.219423 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:04.221217 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:04.221217 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:04.221217 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:46:04.221217 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:46:04.221217 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:46:04.221217 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:46:04.221217 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:46:04.221217 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:46:04.221217 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 00:46:04.221217 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:46:04.223635 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 468/937] 10.222.0.49 () {56 vars in 1117 bytes} [Sun Aug 28 00:46:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:04.224520 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a906e9-7390-48f2-becb-f3cbefff6695 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:04.232170 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 470/938] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 00:46:04 2022] POST /identity/v3/endpoints => generated 347 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:46:04.253161 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c60fc-c195-411f-91ae-7d94d459472c None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:04.253930 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c60fc-c195-411f-91ae-7d94d459472c None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:04.254418 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c60fc-c195-411f-91ae-7d94d459472c None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:04.256855 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 471/939] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:46:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:46:04.263896 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d16cc-2f13-4e76-86e6-44f0acb98821 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:04.264515 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d16cc-2f13-4e76-86e6-44f0acb98821 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:04.264515 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d16cc-2f13-4e76-86e6-44f0acb98821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:04.285022 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-910d16cc-2f13-4e76-86e6-44f0acb98821 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:04.286084 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-910d16cc-2f13-4e76-86e6-44f0acb98821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:04.346164 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:04.355320 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a906e9-7390-48f2-becb-f3cbefff6695 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:04.383412 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 472/940] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:04 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:46:04.416185 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d675084f-a1e2-477e-955d-a5c03c9cb4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:04.416721 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675084f-a1e2-477e-955d-a5c03c9cb4dd None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:04.416975 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675084f-a1e2-477e-955d-a5c03c9cb4dd None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:04.417266 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675084f-a1e2-477e-955d-a5c03c9cb4dd None admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:04.418010 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d675084f-a1e2-477e-955d-a5c03c9cb4dd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:04.418380 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d675084f-a1e2-477e-955d-a5c03c9cb4dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:04.420696 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d675084f-a1e2-477e-955d-a5c03c9cb4dd None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:04.441910 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 469/941] 10.222.0.49 () {56 vars in 1149 bytes} [Sun Aug 28 00:46:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:04.447981 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910d16cc-2f13-4e76-86e6-44f0acb98821 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:04.564414 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910d16cc-2f13-4e76-86e6-44f0acb98821 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:04.587818 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:04.623278 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a812bdaa-67d7-422b-9a06-2ada907d9605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:04.624213 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a812bdaa-67d7-422b-9a06-2ada907d9605 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:04.624613 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a812bdaa-67d7-422b-9a06-2ada907d9605 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:04.624896 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a812bdaa-67d7-422b-9a06-2ada907d9605 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:04.638703 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a812bdaa-67d7-422b-9a06-2ada907d9605 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:04.640296 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a812bdaa-67d7-422b-9a06-2ada907d9605 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:04.656018 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-a812bdaa-67d7-422b-9a06-2ada907d9605 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:04.656018 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:04.656018 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:04.656018 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:04.656018 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:04.656018 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:04.656018 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:04.656018 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:04.656018 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:04.656018 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:04.656018 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:04.656018 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:04.656018 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:46:04.656018 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:46:04.656018 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:46:04.656018 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:46:04.657024 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:04.657024 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:04.657024 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:04.657024 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:04.657024 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:04.657024 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:04.657024 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:04.657024 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:04.657024 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:04.657024 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:04.657024 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:04.657024 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:04.657024 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:04.657024 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:04.657024 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:04.657024 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:04.657024 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:46:04.657945 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:46:04.657945 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:04.657945 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:46:04.657945 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 473/942] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:46:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:04.664629 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d675084f-a1e2-477e-955d-a5c03c9cb4dd None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:04.710672 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a812bdaa-67d7-422b-9a06-2ada907d9605 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:04.774977 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d675084f-a1e2-477e-955d-a5c03c9cb4dd None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:04.812806 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86798c47-8bdd-4366-915d-54d15f9be2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:04.813427 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86798c47-8bdd-4366-915d-54d15f9be2b3 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:04.813707 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86798c47-8bdd-4366-915d-54d15f9be2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:04.813980 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86798c47-8bdd-4366-915d-54d15f9be2b3 None admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:04.814789 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86798c47-8bdd-4366-915d-54d15f9be2b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:04.815125 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86798c47-8bdd-4366-915d-54d15f9be2b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:04.816595 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86798c47-8bdd-4366-915d-54d15f9be2b3 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:04.818214 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a812bdaa-67d7-422b-9a06-2ada907d9605 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:04.834439 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 470/943] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:46:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:04.835500 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86798c47-8bdd-4366-915d-54d15f9be2b3 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:04.852736 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:04.856941 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9436f352-a7af-4dfd-9595-d494f80b3855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:04.858776 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436f352-a7af-4dfd-9595-d494f80b3855 None admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:04.859225 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436f352-a7af-4dfd-9595-d494f80b3855 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:04.859642 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436f352-a7af-4dfd-9595-d494f80b3855 None admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:04.860480 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9436f352-a7af-4dfd-9595-d494f80b3855 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:04.862160 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9436f352-a7af-4dfd-9595-d494f80b3855 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:04.865188 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: WARNING keystone.server.flask.common [None req-9436f352-a7af-4dfd-9595-d494f80b3855 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 28 00:46:04.888200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.sql.core [None req-9436f352-a7af-4dfd-9595-d494f80b3855 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 28 00:46:04.888200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 28 00:46:04.888200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [parameters: {'id': '173224c0027748e0bba740446f040cce', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 28 00:46:04.888200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81808) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 28 00:46:04.896546 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-9436f352-a7af-4dfd-9595-d494f80b3855 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 173224c0027748e0bba740446f040cce.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 173224c0027748e0bba740446f040cce. Aug 28 00:46:04.896546 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:04.896546 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 28 00:46:04.896546 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 28 00:46:04.896546 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 28 00:46:04.896546 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 28 00:46:04.896546 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 28 00:46:04.896546 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application result = self._query(query) Aug 28 00:46:04.896546 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 28 00:46:04.896546 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application conn.query(q) Aug 28 00:46:04.896546 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 28 00:46:04.896546 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 28 00:46:04.896546 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 28 00:46:04.897583 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application result.read() Aug 28 00:46:04.897583 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 28 00:46:04.897583 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 28 00:46:04.897583 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 28 00:46:04.897583 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 28 00:46:04.897583 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 28 00:46:04.897583 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 28 00:46:04.897583 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 28 00:46:04.897583 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 28 00:46:04.897583 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 28 00:46:04.897583 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:46:04.897583 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 28 00:46:04.897583 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:46:04.897583 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:04.897583 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 28 00:46:04.897583 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 28 00:46:04.897583 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 28 00:46:04.897583 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 28 00:46:04.898787 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 28 00:46:04.898787 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application next(self.gen) Aug 28 00:46:04.898787 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 28 00:46:04.898787 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application yield resource Aug 28 00:46:04.898787 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 28 00:46:04.898787 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application next(self.gen) Aug 28 00:46:04.898787 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 28 00:46:04.898787 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application self.session.rollback() Aug 28 00:46:04.898787 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 28 00:46:04.898787 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application self.force_reraise() Aug 28 00:46:04.898787 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 28 00:46:04.898787 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise self.value Aug 28 00:46:04.898787 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 28 00:46:04.898787 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 28 00:46:04.898787 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 28 00:46:04.898787 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application session.commit() Aug 28 00:46:04.898787 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 28 00:46:04.899705 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 28 00:46:04.899705 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 28 00:46:04.899705 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application self._prepare_impl() Aug 28 00:46:04.899705 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 28 00:46:04.899705 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application self.session.flush() Aug 28 00:46:04.899705 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 28 00:46:04.899705 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application self._flush(objects) Aug 28 00:46:04.899705 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 28 00:46:04.899705 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 28 00:46:04.899705 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 28 00:46:04.899705 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application compat.raise_( Aug 28 00:46:04.899705 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 28 00:46:04.899705 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception Aug 28 00:46:04.899705 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 28 00:46:04.899705 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application flush_context.execute() Aug 28 00:46:04.899705 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 28 00:46:04.899705 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rec.execute(self) Aug 28 00:46:04.900803 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 28 00:46:04.900803 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 28 00:46:04.900803 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 28 00:46:04.900803 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 28 00:46:04.900803 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 28 00:46:04.900803 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 28 00:46:04.900803 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 28 00:46:04.900803 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 28 00:46:04.900803 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 28 00:46:04.900803 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 28 00:46:04.900803 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 28 00:46:04.900803 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 28 00:46:04.900803 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 28 00:46:04.900803 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 28 00:46:04.900803 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 28 00:46:04.901655 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 28 00:46:04.901655 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 28 00:46:04.901655 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception Aug 28 00:46:04.901655 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 28 00:46:04.901655 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 28 00:46:04.901655 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 28 00:46:04.901655 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 28 00:46:04.901655 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 28 00:46:04.901655 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application result = self._query(query) Aug 28 00:46:04.901655 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 28 00:46:04.901655 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application conn.query(q) Aug 28 00:46:04.901655 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 28 00:46:04.901655 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 28 00:46:04.901655 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 28 00:46:04.901655 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application result.read() Aug 28 00:46:04.901655 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 28 00:46:04.901655 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 28 00:46:04.902600 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 28 00:46:04.902600 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 28 00:46:04.902600 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 28 00:46:04.902600 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 28 00:46:04.902600 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 28 00:46:04.902600 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 28 00:46:04.902600 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 28 00:46:04.902600 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 28 00:46:04.902600 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [parameters: {'id': '173224c0027748e0bba740446f040cce', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 28 00:46:04.902600 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 28 00:46:04.902600 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:46:04.902600 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:46:04.902600 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:46:04.902600 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:04.902600 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 28 00:46:04.903433 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 28 00:46:04.903433 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 28 00:46:04.903433 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 28 00:46:04.903433 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 28 00:46:04.903433 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:46:04.903433 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:46:04.903433 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:46:04.903433 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:04.903433 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:04.903433 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:04.903433 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:04.903433 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:04.903433 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:04.903433 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:04.903433 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:04.903433 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:04.903433 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:04.904455 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:04.904455 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 28 00:46:04.904455 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 28 00:46:04.904455 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:04.904455 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:04.904455 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 28 00:46:04.904455 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 28 00:46:04.904455 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 173224c0027748e0bba740446f040cce. Aug 28 00:46:04.904455 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:46:04.911779 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 474/944] 10.222.0.49 () {60 vars in 1140 bytes} [Sun Aug 28 00:46:04 2022] POST /identity/v3/projects => generated 262 bytes in 197 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:46:04.913385 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9436f352-a7af-4dfd-9595-d494f80b3855 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:04.942612 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:04.949781 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86798c47-8bdd-4366-915d-54d15f9be2b3 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:04.988485 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455d87b1-df90-4b4a-9954-10e59c14e2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:04.989040 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d87b1-df90-4b4a-9954-10e59c14e2b2 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:04.989322 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d87b1-df90-4b4a-9954-10e59c14e2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:04.989596 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d87b1-df90-4b4a-9954-10e59c14e2b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:04.997796 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455d87b1-df90-4b4a-9954-10e59c14e2b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:04.999315 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455d87b1-df90-4b4a-9954-10e59c14e2b2 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:05.012512 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-455d87b1-df90-4b4a-9954-10e59c14e2b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:46:05.012512 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:05.012512 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:05.012512 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:05.012512 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:05.012512 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:05.012512 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:05.012512 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:05.012512 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:05.012512 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:05.012512 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:05.012512 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:05.012512 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:46:05.012512 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:46:05.012512 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:46:05.013660 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:46:05.013660 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:05.013660 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:05.013660 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:05.013660 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:05.013660 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:05.013660 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:05.013660 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:05.013660 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:05.013660 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:05.013660 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:05.013660 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:05.013660 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:05.013660 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:05.013660 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:05.013660 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:05.013660 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:05.014744 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:46:05.014744 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:46:05.014744 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:46:05.014744 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:46:05.014744 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:46:05.014744 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:46:05.014744 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:46:05.014744 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:46:05.018675 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 471/945] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 28 00:46:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:46:05.020209 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69541f20-005e-43d4-8bd4-adce4489725b None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:05.020495 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69541f20-005e-43d4-8bd4-adce4489725b None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:05.020767 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69541f20-005e-43d4-8bd4-adce4489725b None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:05.022160 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 472/946] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:46:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:05.023082 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69541f20-005e-43d4-8bd4-adce4489725b None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:05.038256 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9436f352-a7af-4dfd-9595-d494f80b3855 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:05.079656 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f15c5a8-1eb3-4e6e-8953-2cb72c68d076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:05.080661 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15c5a8-1eb3-4e6e-8953-2cb72c68d076 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:05.080943 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15c5a8-1eb3-4e6e-8953-2cb72c68d076 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:05.081212 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15c5a8-1eb3-4e6e-8953-2cb72c68d076 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:05.089670 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f15c5a8-1eb3-4e6e-8953-2cb72c68d076 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:05.091362 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f15c5a8-1eb3-4e6e-8953-2cb72c68d076 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:05.101282 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:05.103733 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-5f15c5a8-1eb3-4e6e-8953-2cb72c68d076 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:46:05.103733 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:05.103733 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:05.103733 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:05.103733 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:05.103733 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:05.103733 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:05.103733 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:05.103733 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:05.103733 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:05.103733 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:05.103733 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:05.103733 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:46:05.103733 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:46:05.103733 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:46:05.104844 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:46:05.104844 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:05.104844 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:05.104844 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:05.104844 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:05.104844 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:05.104844 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:05.104844 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:05.104844 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:05.104844 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:05.104844 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:05.104844 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:05.104844 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:05.104844 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:05.104844 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:05.104844 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:05.104844 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:05.105733 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:46:05.105733 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:46:05.105733 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:46:05.105733 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:46:05.105733 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:46:05.105733 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:46:05.105733 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:46:05.105733 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:46:05.105733 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 475/947] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 28 00:46:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:05.106228 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317dec5-7b58-4752-9e1d-d6d062c06640 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:05.106685 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317dec5-7b58-4752-9e1d-d6d062c06640 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:05.106787 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317dec5-7b58-4752-9e1d-d6d062c06640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:05.126275 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-5317dec5-7b58-4752-9e1d-d6d062c06640 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:05.127838 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-5317dec5-7b58-4752-9e1d-d6d062c06640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:05.148445 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69541f20-005e-43d4-8bd4-adce4489725b None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:05.186910 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b3bbe4-14de-4ddf-b162-975c782f003c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:05.187551 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b3bbe4-14de-4ddf-b162-975c782f003c None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:05.187857 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b3bbe4-14de-4ddf-b162-975c782f003c None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:05.188128 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b3bbe4-14de-4ddf-b162-975c782f003c None admin] PATH_INFO: `/v3/projects` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:05.188823 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b3bbe4-14de-4ddf-b162-975c782f003c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:05.189125 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b3bbe4-14de-4ddf-b162-975c782f003c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:05.190570 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b3bbe4-14de-4ddf-b162-975c782f003c None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:05.197774 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 476/948] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:46:05.198644 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5317dec5-7b58-4752-9e1d-d6d062c06640 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:05.216973 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 473/949] 10.222.0.49 () {56 vars in 1148 bytes} [Sun Aug 28 00:46:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:05.218308 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b3bbe4-14de-4ddf-b162-975c782f003c None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:05.219802 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:05.323336 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5317dec5-7b58-4752-9e1d-d6d062c06640 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:05.340963 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b3bbe4-14de-4ddf-b162-975c782f003c None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:05.358952 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2093daf-caba-473a-bdaa-86b6590ee3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:05.359566 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2093daf-caba-473a-bdaa-86b6590ee3ac None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:05.359869 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2093daf-caba-473a-bdaa-86b6590ee3ac None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:05.360133 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2093daf-caba-473a-bdaa-86b6590ee3ac None admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:05.360796 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2093daf-caba-473a-bdaa-86b6590ee3ac None admin] RBAC: Adding query filter params (name=service) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:05.361093 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2093daf-caba-473a-bdaa-86b6590ee3ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:05.362516 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2093daf-caba-473a-bdaa-86b6590ee3ac None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:05.372012 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:05.378760 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95971188-929e-482c-a1c3-08f5e9ff44eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:05.379802 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95971188-929e-482c-a1c3-08f5e9ff44eb None admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:05.380234 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95971188-929e-482c-a1c3-08f5e9ff44eb None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:05.380653 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95971188-929e-482c-a1c3-08f5e9ff44eb None admin] PATH_INFO: `/v3/projects/6d6e897c6391486e9c44e9277a3ee823/users/cbe0653ed0c04a9080b5c337392de8ad/roles/0113a36accc54c15b333655ed6b73d82` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:05.383570 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95971188-929e-482c-a1c3-08f5e9ff44eb None admin] RBAC: Authorizing `identity:create_grant(project_id=6d6e897c6391486e9c44e9277a3ee823, user_id=cbe0653ed0c04a9080b5c337392de8ad, role_id=0113a36accc54c15b333655ed6b73d82)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:05.383949 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 477/950] 10.222.0.49 () {56 vars in 1112 bytes} [Sun Aug 28 00:46:05 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:05.385734 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95971188-929e-482c-a1c3-08f5e9ff44eb None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:05.405308 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 474/951] 10.222.0.49 () {58 vars in 1439 bytes} [Sun Aug 28 00:46:05 2022] PUT /identity/v3/projects/6d6e897c6391486e9c44e9277a3ee823/users/cbe0653ed0c04a9080b5c337392de8ad/roles/0113a36accc54c15b333655ed6b73d82 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:46:05.471480 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2093daf-caba-473a-bdaa-86b6590ee3ac None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:05.570531 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:05.614550 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2093daf-caba-473a-bdaa-86b6590ee3ac None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:05.656918 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2395479-3ba0-487a-85d0-08b63142c75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:05.657572 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2395479-3ba0-487a-85d0-08b63142c75c None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:05.657845 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2395479-3ba0-487a-85d0-08b63142c75c None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:05.658108 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2395479-3ba0-487a-85d0-08b63142c75c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:05.658703 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2395479-3ba0-487a-85d0-08b63142c75c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:05.660134 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2395479-3ba0-487a-85d0-08b63142c75c None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:05.670057 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-b2395479-3ba0-487a-85d0-08b63142c75c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 00:46:05.670057 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:05.670057 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:46:05.670057 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:46:05.670057 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:46:05.670057 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:46:05.670057 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:46:05.670057 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:46:05.670057 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 00:46:05.670057 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:46:05.670057 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:46:05.670057 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:46:05.670057 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:05.670057 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:05.670057 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:05.670057 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:05.670057 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:05.671143 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:05.671143 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:05.671143 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:05.671143 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:05.671143 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:05.671143 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:05.671143 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:46:05.671143 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:46:05.671143 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:46:05.671143 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:46:05.671143 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:05.671143 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:05.671143 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:05.671143 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:05.671143 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:05.671143 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:05.672410 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:05.672410 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:05.672410 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:05.672410 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:05.672410 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:05.672410 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:05.672410 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:05.672410 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:05.672410 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:05.672410 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:05.672410 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:46:05.672410 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:46:05.672410 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 00:46:05.672410 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:46:05.672410 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 478/952] 10.222.0.49 () {56 vars in 1126 bytes} [Sun Aug 28 00:46:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:05.677822 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95971188-929e-482c-a1c3-08f5e9ff44eb None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:05.805843 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95971188-929e-482c-a1c3-08f5e9ff44eb None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:05.844032 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0350dcf-3e22-4585-af7b-4262a7c60c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:05.844652 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0350dcf-3e22-4585-af7b-4262a7c60c6f None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:05.844929 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0350dcf-3e22-4585-af7b-4262a7c60c6f None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:05.845199 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0350dcf-3e22-4585-af7b-4262a7c60c6f None admin] PATH_INFO: `/v3/services` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:05.845840 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0350dcf-3e22-4585-af7b-4262a7c60c6f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:05.846143 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0350dcf-3e22-4585-af7b-4262a7c60c6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:05.847536 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0350dcf-3e22-4585-af7b-4262a7c60c6f None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:05.853116 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 475/953] 10.222.0.49 () {56 vars in 1122 bytes} [Sun Aug 28 00:46:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:05.859468 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2395479-3ba0-487a-85d0-08b63142c75c None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:05.974663 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2395479-3ba0-487a-85d0-08b63142c75c None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:06.015241 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d777eb-faab-4d7a-a01c-b13fcd2bd000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:06.015890 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d777eb-faab-4d7a-a01c-b13fcd2bd000 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:06.016175 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d777eb-faab-4d7a-a01c-b13fcd2bd000 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:06.016449 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d777eb-faab-4d7a-a01c-b13fcd2bd000 None admin] PATH_INFO: `/v3/services` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:06.017101 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d777eb-faab-4d7a-a01c-b13fcd2bd000 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:06.017402 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d777eb-faab-4d7a-a01c-b13fcd2bd000 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:06.018788 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d777eb-faab-4d7a-a01c-b13fcd2bd000 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:06.021391 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:06.025803 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 479/954] 10.222.0.49 () {56 vars in 1122 bytes} [Sun Aug 28 00:46:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:06.033029 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0350dcf-3e22-4585-af7b-4262a7c60c6f None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:06.112171 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:06.145632 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0350dcf-3e22-4585-af7b-4262a7c60c6f None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:06.182777 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25d744d-4098-435c-84ba-e482e97de291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:06.183460 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d744d-4098-435c-84ba-e482e97de291 None admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:06.183772 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d744d-4098-435c-84ba-e482e97de291 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:06.184046 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d744d-4098-435c-84ba-e482e97de291 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:06.184743 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25d744d-4098-435c-84ba-e482e97de291 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:06.186193 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25d744d-4098-435c-84ba-e482e97de291 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:06.210517 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 476/955] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 00:46:06 2022] POST /identity/v3/endpoints => generated 349 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:46:06.328570 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754c941-5400-492b-9d3d-88e1deec0cb3 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:06.329093 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754c941-5400-492b-9d3d-88e1deec0cb3 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:06.329093 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754c941-5400-492b-9d3d-88e1deec0cb3 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:06.331069 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 480/956] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:46:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:06.337175 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ca315-3148-46aa-ac06-9caedae87730 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:06.337559 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ca315-3148-46aa-ac06-9caedae87730 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:06.337775 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ca315-3148-46aa-ac06-9caedae87730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:06.357689 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-a33ca315-3148-46aa-ac06-9caedae87730 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:06.358949 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-a33ca315-3148-46aa-ac06-9caedae87730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:06.460715 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 477/957] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:06 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:46:06.754262 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754c941-5400-492b-9d3d-88e1deec0cb3 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:06.864430 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754c941-5400-492b-9d3d-88e1deec0cb3 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:06.900886 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f5853-d93d-4a5b-b853-08c1d30a375c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:06.901537 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f5853-d93d-4a5b-b853-08c1d30a375c None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:06.901818 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f5853-d93d-4a5b-b853-08c1d30a375c None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:06.902096 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56f5853-d93d-4a5b-b853-08c1d30a375c None admin] PATH_INFO: `/v3/services/compute` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:06.902763 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56f5853-d93d-4a5b-b853-08c1d30a375c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:06.904203 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56f5853-d93d-4a5b-b853-08c1d30a375c None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:06.913819 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-a56f5853-d93d-4a5b-b853-08c1d30a375c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 28 00:46:06.913819 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:06.913819 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:46:06.913819 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:46:06.913819 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:46:06.913819 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:46:06.913819 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:46:06.913819 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:46:06.913819 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 28 00:46:06.913819 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:46:06.913819 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:46:06.913819 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:46:06.913819 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:06.913819 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:06.913819 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:06.913819 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:06.913819 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:06.915066 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:06.915066 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:06.915066 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:06.915066 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:06.915066 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:06.915066 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:06.915066 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:46:06.915066 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:46:06.915066 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:46:06.915066 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:46:06.915066 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:06.915066 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:06.915066 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:06.915066 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:06.915066 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:06.915066 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:06.916048 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:06.916048 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:06.916048 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:06.916048 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:06.916048 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:06.916048 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:06.916048 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:06.916048 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:06.916048 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:06.916048 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:06.916048 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:46:06.916048 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:46:06.916048 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 28 00:46:06.916048 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:46:06.916048 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 481/958] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 28 00:46:06 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:06.921422 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33ca315-3148-46aa-ac06-9caedae87730 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:06.964464 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:07.039193 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33ca315-3148-46aa-ac06-9caedae87730 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:07.075695 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86be4e93-757e-43e9-939c-76879c628765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:07.076483 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be4e93-757e-43e9-939c-76879c628765 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:07.076767 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be4e93-757e-43e9-939c-76879c628765 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:07.077034 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be4e93-757e-43e9-939c-76879c628765 None admin] PATH_INFO: `/v3/services` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:07.077681 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86be4e93-757e-43e9-939c-76879c628765 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:07.077980 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86be4e93-757e-43e9-939c-76879c628765 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:07.079376 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86be4e93-757e-43e9-939c-76879c628765 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:07.085381 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 478/959] 10.222.0.49 () {56 vars in 1112 bytes} [Sun Aug 28 00:46:06 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:07.090957 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f5853-d93d-4a5b-b853-08c1d30a375c None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:07.161994 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:07.202488 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56f5853-d93d-4a5b-b853-08c1d30a375c None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:07.239010 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b4486a-50ce-48fa-8604-859d6f2a5262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:07.239628 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4486a-50ce-48fa-8604-859d6f2a5262 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:07.239934 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4486a-50ce-48fa-8604-859d6f2a5262 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:07.240201 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4486a-50ce-48fa-8604-859d6f2a5262 None admin] PATH_INFO: `/v3/services` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:07.240846 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b4486a-50ce-48fa-8604-859d6f2a5262 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:07.241148 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b4486a-50ce-48fa-8604-859d6f2a5262 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:07.242532 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b4486a-50ce-48fa-8604-859d6f2a5262 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:07.247965 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 482/960] 10.222.0.49 () {56 vars in 1112 bytes} [Sun Aug 28 00:46:07 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:07.456859 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0180817b-01ff-43b9-a40b-afae5df66943 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:07.457532 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0180817b-01ff-43b9-a40b-afae5df66943 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:07.458007 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0180817b-01ff-43b9-a40b-afae5df66943 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:07.459977 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 479/961] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:46:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:07.465708 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64985071-c9da-45a0-b91d-c38e0758182f None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:07.466607 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64985071-c9da-45a0-b91d-c38e0758182f None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:07.467081 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64985071-c9da-45a0-b91d-c38e0758182f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:07.485986 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-64985071-c9da-45a0-b91d-c38e0758182f None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:07.487551 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-64985071-c9da-45a0-b91d-c38e0758182f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:07.567383 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 483/962] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:07 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:46:07.623540 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b5705-1424-4591-8d04-6bf4e087219b None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:07.624175 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b5705-1424-4591-8d04-6bf4e087219b None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:07.624715 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b5705-1424-4591-8d04-6bf4e087219b None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:07.626640 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 480/963] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:46:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:07.635005 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79b4e1-16f5-45f1-9ea7-8956b0e7e993 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:07.635766 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79b4e1-16f5-45f1-9ea7-8956b0e7e993 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:07.636250 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79b4e1-16f5-45f1-9ea7-8956b0e7e993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:07.659986 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-5a79b4e1-16f5-45f1-9ea7-8956b0e7e993 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:07.661553 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-5a79b4e1-16f5-45f1-9ea7-8956b0e7e993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:07.720256 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:07.736310 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 484/964] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:07 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:46:07.859228 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b5705-1424-4591-8d04-6bf4e087219b None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:07.984002 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b5705-1424-4591-8d04-6bf4e087219b None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:07.988031 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:08.002670 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a79b4e1-16f5-45f1-9ea7-8956b0e7e993 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:08.041059 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f655f466-3c86-443f-8207-8577ff9f0c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:08.041716 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f655f466-3c86-443f-8207-8577ff9f0c56 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:08.041997 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f655f466-3c86-443f-8207-8577ff9f0c56 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:08.042268 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f655f466-3c86-443f-8207-8577ff9f0c56 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:08.056698 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f655f466-3c86-443f-8207-8577ff9f0c56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:46:08.062964 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-f655f466-3c86-443f-8207-8577ff9f0c56 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 00:46:08.062964 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:08.062964 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:08.062964 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:08.062964 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:08.062964 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:08.062964 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:08.062964 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:08.062964 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:08.062964 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:08.062964 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:08.062964 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:08.062964 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:46:08.062964 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:46:08.062964 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:46:08.062964 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:46:08.064002 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:46:08.064002 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:46:08.064002 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:46:08.064002 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:46:08.064002 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:08.064002 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:08.064002 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:08.064002 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:08.064002 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:08.064002 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:08.064002 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:08.064002 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:08.064002 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:08.064002 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:08.064002 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:08.064002 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:08.064866 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:08.064866 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:08.064866 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:08.064866 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:08.064866 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:46:08.064866 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:46:08.064866 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:46:08.064866 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:46:08.064866 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:46:08.064866 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:46:08.064866 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 00:46:08.064866 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:46:08.064866 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 481/965] 10.222.0.49 () {56 vars in 1120 bytes} [Sun Aug 28 00:46:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:08.071704 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f655f466-3c86-443f-8207-8577ff9f0c56 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:08.149992 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a79b4e1-16f5-45f1-9ea7-8956b0e7e993 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:08.196264 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28feaf71-654d-4c25-8797-503dd3669ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:08.197043 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28feaf71-654d-4c25-8797-503dd3669ee5 None admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:08.197330 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28feaf71-654d-4c25-8797-503dd3669ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:08.197664 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28feaf71-654d-4c25-8797-503dd3669ee5 None admin] PATH_INFO: `/v3/users` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:08.198840 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28feaf71-654d-4c25-8797-503dd3669ee5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:08.200633 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28feaf71-654d-4c25-8797-503dd3669ee5 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:08.221246 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.sql.core [None req-28feaf71-654d-4c25-8797-503dd3669ee5 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 28 00:46:08.221246 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 28 00:46:08.221246 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [parameters: {'user_id': '9be95cdc7e30494a9b6c9cd6254fdecb', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 28 00:46:08.221246 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81808) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 28 00:46:08.226025 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f655f466-3c86-443f-8207-8577ff9f0c56 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:08.231559 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-28feaf71-654d-4c25-8797-503dd3669ee5 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 28 00:46:08.231559 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:08.231559 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 28 00:46:08.231559 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 28 00:46:08.231559 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 28 00:46:08.231559 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 28 00:46:08.231559 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 28 00:46:08.231559 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application result = self._query(query) Aug 28 00:46:08.231559 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 28 00:46:08.231559 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application conn.query(q) Aug 28 00:46:08.231559 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 28 00:46:08.231559 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 28 00:46:08.231559 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 28 00:46:08.231559 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application result.read() Aug 28 00:46:08.231559 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 28 00:46:08.232512 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 28 00:46:08.232512 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 28 00:46:08.232512 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 28 00:46:08.232512 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 28 00:46:08.232512 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 28 00:46:08.232512 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 28 00:46:08.232512 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 28 00:46:08.232512 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 28 00:46:08.232512 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:46:08.232512 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 28 00:46:08.232512 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:46:08.232512 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:08.232512 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 28 00:46:08.232512 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 28 00:46:08.232512 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 28 00:46:08.232512 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 28 00:46:08.232512 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 28 00:46:08.232512 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application next(self.gen) Aug 28 00:46:08.233482 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 28 00:46:08.233482 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application yield resource Aug 28 00:46:08.233482 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 28 00:46:08.233482 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application next(self.gen) Aug 28 00:46:08.233482 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 28 00:46:08.233482 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application self.session.rollback() Aug 28 00:46:08.233482 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 28 00:46:08.233482 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application self.force_reraise() Aug 28 00:46:08.233482 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 28 00:46:08.233482 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise self.value Aug 28 00:46:08.233482 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 28 00:46:08.233482 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 28 00:46:08.233482 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 28 00:46:08.233482 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application session.commit() Aug 28 00:46:08.233482 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 28 00:46:08.233482 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 28 00:46:08.233482 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 28 00:46:08.234464 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application self._prepare_impl() Aug 28 00:46:08.234464 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 28 00:46:08.234464 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application self.session.flush() Aug 28 00:46:08.234464 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 28 00:46:08.234464 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application self._flush(objects) Aug 28 00:46:08.234464 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 28 00:46:08.234464 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 28 00:46:08.234464 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 28 00:46:08.234464 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application compat.raise_( Aug 28 00:46:08.234464 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 28 00:46:08.234464 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception Aug 28 00:46:08.234464 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 28 00:46:08.234464 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application flush_context.execute() Aug 28 00:46:08.234464 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 28 00:46:08.234464 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rec.execute(self) Aug 28 00:46:08.234464 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 28 00:46:08.234464 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 28 00:46:08.235412 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 28 00:46:08.235412 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 28 00:46:08.235412 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 28 00:46:08.235412 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 28 00:46:08.235412 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 28 00:46:08.235412 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 28 00:46:08.235412 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 28 00:46:08.235412 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 28 00:46:08.235412 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 28 00:46:08.235412 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 28 00:46:08.235412 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 28 00:46:08.235412 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 28 00:46:08.235412 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 28 00:46:08.235412 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 28 00:46:08.235412 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 28 00:46:08.235412 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception Aug 28 00:46:08.236299 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 28 00:46:08.236299 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 28 00:46:08.236299 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 28 00:46:08.236299 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 28 00:46:08.236299 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 28 00:46:08.236299 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application result = self._query(query) Aug 28 00:46:08.236299 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 28 00:46:08.236299 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application conn.query(q) Aug 28 00:46:08.236299 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 28 00:46:08.236299 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 28 00:46:08.236299 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 28 00:46:08.236299 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application result.read() Aug 28 00:46:08.236299 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 28 00:46:08.236299 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 28 00:46:08.236299 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 28 00:46:08.236299 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 28 00:46:08.237148 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 28 00:46:08.237148 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 28 00:46:08.237148 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 28 00:46:08.237148 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 28 00:46:08.237148 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 28 00:46:08.237148 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 28 00:46:08.237148 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [parameters: {'user_id': '9be95cdc7e30494a9b6c9cd6254fdecb', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 28 00:46:08.237148 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 28 00:46:08.237148 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:46:08.237148 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:46:08.237148 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:46:08.237148 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:08.237148 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:08.237148 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:08.237148 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:08.240472 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:08.240472 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:08.240472 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:08.240472 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:08.240472 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:08.240472 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:08.240472 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:08.240472 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 28 00:46:08.240472 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 28 00:46:08.240472 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:08.240472 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:08.240472 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:46:08.240472 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:46:08.240472 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:46:08.240472 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:46:08.240472 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 28 00:46:08.240472 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 28 00:46:08.241542 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 28 00:46:08.241542 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 28 00:46:08.241542 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 28 00:46:08.241542 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 28 00:46:08.241542 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 28 00:46:08.241542 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:46:08.241542 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 485/966] 10.222.0.49 () {60 vars in 1131 bytes} [Sun Aug 28 00:46:08 2022] POST /identity/v3/users => generated 160 bytes in 235 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:08.246021 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28feaf71-654d-4c25-8797-503dd3669ee5 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:08.282867 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e80d13-4245-4f32-97fd-1c6f24882033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:08.283497 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e80d13-4245-4f32-97fd-1c6f24882033 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:08.283804 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e80d13-4245-4f32-97fd-1c6f24882033 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:08.284073 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e80d13-4245-4f32-97fd-1c6f24882033 None admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:08.284831 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e80d13-4245-4f32-97fd-1c6f24882033 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:08.285129 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e80d13-4245-4f32-97fd-1c6f24882033 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:08.286533 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e80d13-4245-4f32-97fd-1c6f24882033 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:08.296383 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 482/967] 10.222.0.49 () {56 vars in 1115 bytes} [Sun Aug 28 00:46:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:46:08.302290 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e80d13-4245-4f32-97fd-1c6f24882033 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:08.337312 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:08.341695 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:08.412407 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28feaf71-654d-4c25-8797-503dd3669ee5 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:08.429515 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e80d13-4245-4f32-97fd-1c6f24882033 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:08.451052 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc8a168-4446-4499-8e3d-2f0d8117f28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:08.451686 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8a168-4446-4499-8e3d-2f0d8117f28a None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:08.451995 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8a168-4446-4499-8e3d-2f0d8117f28a None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:08.452243 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8a168-4446-4499-8e3d-2f0d8117f28a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:08.460169 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc8a168-4446-4499-8e3d-2f0d8117f28a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:08.461809 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc8a168-4446-4499-8e3d-2f0d8117f28a None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:08.471234 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b397fb2-3d76-4547-9bfe-16012c4c7164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:08.471913 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b397fb2-3d76-4547-9bfe-16012c4c7164 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:08.472188 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b397fb2-3d76-4547-9bfe-16012c4c7164 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:08.472453 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b397fb2-3d76-4547-9bfe-16012c4c7164 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:08.473905 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-5fc8a168-4446-4499-8e3d-2f0d8117f28a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 28 00:46:08.473905 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:08.473905 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:08.473905 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:08.473905 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:08.473905 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:08.473905 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:08.473905 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:08.473905 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:08.473905 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:08.473905 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:08.473905 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:08.473905 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:46:08.473905 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:46:08.473905 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:46:08.473905 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:46:08.475178 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:08.475178 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:08.475178 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:46:08.475178 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:46:08.475178 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:46:08.475178 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:46:08.475178 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:08.475178 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:08.475178 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:08.475178 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:08.475178 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:08.475178 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:08.475178 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:08.475178 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:08.475178 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:08.475178 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:08.475178 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:08.475178 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:08.476221 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:08.476221 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:08.476221 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:46:08.476221 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:46:08.476221 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:46:08.476221 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:46:08.476221 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:46:08.476221 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:46:08.476221 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 28 00:46:08.476221 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:46:08.476221 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 486/968] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 28 00:46:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:08.476849 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524550ac-c2d8-4987-b713-ac3ad9373e4f None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:08.476849 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524550ac-c2d8-4987-b713-ac3ad9373e4f None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:08.476849 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524550ac-c2d8-4987-b713-ac3ad9373e4f None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:08.486335 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 487/969] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:46:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:08.486335 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524550ac-c2d8-4987-b713-ac3ad9373e4f None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:08.491276 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b397fb2-3d76-4547-9bfe-16012c4c7164 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:08.492755 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b397fb2-3d76-4547-9bfe-16012c4c7164 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:08.511734 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-6b397fb2-3d76-4547-9bfe-16012c4c7164 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:08.511734 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:08.511734 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:08.511734 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:08.511734 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:08.511734 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:08.511734 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:08.511734 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:08.511734 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:08.511734 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:08.511734 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:08.511734 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:08.511734 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:46:08.511734 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:46:08.511734 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:46:08.511734 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:46:08.512767 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:08.512767 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:08.512767 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:08.512767 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:08.512767 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:08.512767 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:08.512767 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:08.512767 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:08.512767 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:08.512767 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:08.512767 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:08.512767 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:08.512767 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:08.512767 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:08.512767 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:08.512767 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:08.512767 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:46:08.513675 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:46:08.513675 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:08.513675 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:46:08.513675 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 483/970] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:46:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:08.514584 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9539e269-28e3-46f9-9137-7213f39141bb None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:08.514584 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9539e269-28e3-46f9-9137-7213f39141bb None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:08.514584 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9539e269-28e3-46f9-9137-7213f39141bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:08.536611 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-9539e269-28e3-46f9-9137-7213f39141bb None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:08.537924 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-9539e269-28e3-46f9-9137-7213f39141bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:08.620121 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524550ac-c2d8-4987-b713-ac3ad9373e4f None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:08.632174 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:08.655692 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 484/971] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:08 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:46:08.655692 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9539e269-28e3-46f9-9137-7213f39141bb None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:08.665610 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec2d198-3499-48fb-b46c-a4fcc48f64b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:08.666419 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2d198-3499-48fb-b46c-a4fcc48f64b0 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:08.666837 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2d198-3499-48fb-b46c-a4fcc48f64b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:08.667253 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2d198-3499-48fb-b46c-a4fcc48f64b0 None admin] PATH_INFO: `/v3/users` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:08.668100 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec2d198-3499-48fb-b46c-a4fcc48f64b0 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:08.668580 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec2d198-3499-48fb-b46c-a4fcc48f64b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:08.669022 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:08.670223 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec2d198-3499-48fb-b46c-a4fcc48f64b0 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:08.720698 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 488/972] 10.222.0.49 () {56 vars in 1101 bytes} [Sun Aug 28 00:46:08 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:08.796860 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9539e269-28e3-46f9-9137-7213f39141bb None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:08.835691 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d66fc-c5dd-467d-97d2-4aeb1ff39562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:08.836316 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d66fc-c5dd-467d-97d2-4aeb1ff39562 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:08.836643 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d66fc-c5dd-467d-97d2-4aeb1ff39562 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:08.836926 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0d66fc-c5dd-467d-97d2-4aeb1ff39562 None admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:08.837662 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0d66fc-c5dd-467d-97d2-4aeb1ff39562 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:08.837965 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0d66fc-c5dd-467d-97d2-4aeb1ff39562 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:08.839364 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0d66fc-c5dd-467d-97d2-4aeb1ff39562 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:08.852704 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 485/973] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:46:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:08.860297 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec2d198-3499-48fb-b46c-a4fcc48f64b0 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:08.934392 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d66fc-c5dd-467d-97d2-4aeb1ff39562 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:08.984184 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec2d198-3499-48fb-b46c-a4fcc48f64b0 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:09.013502 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:09.028438 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db4a89-f112-4fa5-8ea9-1d114cff3e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:09.029094 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db4a89-f112-4fa5-8ea9-1d114cff3e4d None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:09.029377 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db4a89-f112-4fa5-8ea9-1d114cff3e4d None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:09.029648 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db4a89-f112-4fa5-8ea9-1d114cff3e4d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:09.038736 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7db4a89-f112-4fa5-8ea9-1d114cff3e4d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:09.040264 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7db4a89-f112-4fa5-8ea9-1d114cff3e4d None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:09.053652 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-a7db4a89-f112-4fa5-8ea9-1d114cff3e4d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 00:46:09.053652 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:09.053652 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:09.053652 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:09.053652 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:09.053652 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:09.053652 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:09.053652 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:09.053652 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:09.053652 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:09.053652 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:09.053652 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:09.053652 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:46:09.053652 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:46:09.053652 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:46:09.053652 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:46:09.054639 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:09.054639 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:09.054639 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:46:09.054639 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:46:09.054639 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:46:09.054639 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:46:09.054639 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:09.054639 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:09.054639 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:09.054639 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:09.054639 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:09.054639 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:09.054639 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:09.054639 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:09.054639 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:09.054639 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:09.054639 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:09.054639 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:09.055609 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:09.055609 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:09.055609 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:46:09.055609 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:46:09.055609 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:46:09.055609 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:46:09.055609 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:46:09.055609 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:46:09.055609 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 28 00:46:09.055609 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:46:09.055609 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 489/974] 10.222.0.49 () {56 vars in 1117 bytes} [Sun Aug 28 00:46:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:09.059576 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0d66fc-c5dd-467d-97d2-4aeb1ff39562 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:09.060383 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db4a89-f112-4fa5-8ea9-1d114cff3e4d None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:09.091970 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:09.100735 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d4814-e4d6-4793-b860-db03f88d9817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:09.101371 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d4814-e4d6-4793-b860-db03f88d9817 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:09.101646 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d4814-e4d6-4793-b860-db03f88d9817 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:09.101912 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d4814-e4d6-4793-b860-db03f88d9817 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:09.102490 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2d4814-e4d6-4793-b860-db03f88d9817 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:09.103978 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2d4814-e4d6-4793-b860-db03f88d9817 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:09.112888 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-6e2d4814-e4d6-4793-b860-db03f88d9817 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 00:46:09.112888 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:09.112888 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:46:09.112888 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:46:09.112888 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:46:09.112888 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:46:09.112888 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:46:09.112888 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:46:09.112888 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 00:46:09.112888 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:46:09.112888 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:46:09.112888 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:46:09.112888 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:09.112888 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:09.112888 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:09.112888 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:09.112888 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:09.113963 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:09.113963 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:09.113963 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:09.113963 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:09.113963 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:09.113963 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:09.113963 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:46:09.113963 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:46:09.113963 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:46:09.113963 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:46:09.113963 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:09.113963 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:09.113963 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:09.113963 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:09.113963 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:09.113963 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:09.114842 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:09.114842 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:09.114842 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:09.114842 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:09.114842 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:09.114842 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:09.114842 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:09.114842 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:09.114842 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:09.114842 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:09.114842 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:46:09.114842 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:46:09.114842 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 00:46:09.114842 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:46:09.114842 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 486/975] 10.222.0.49 () {56 vars in 1126 bytes} [Sun Aug 28 00:46:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:46:09.120079 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d4814-e4d6-4793-b860-db03f88d9817 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:09.176935 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db4a89-f112-4fa5-8ea9-1d114cff3e4d None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:09.219244 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b7e85-dbdc-4ec2-990c-2065d34f1d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:09.220181 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b7e85-dbdc-4ec2-990c-2065d34f1d67 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:09.220617 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b7e85-dbdc-4ec2-990c-2065d34f1d67 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:09.221244 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b7e85-dbdc-4ec2-990c-2065d34f1d67 None admin] PATH_INFO: `/v3/users` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:09.222243 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7b7e85-dbdc-4ec2-990c-2065d34f1d67 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:09.222653 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7b7e85-dbdc-4ec2-990c-2065d34f1d67 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:09.224650 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7b7e85-dbdc-4ec2-990c-2065d34f1d67 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:09.227191 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d4814-e4d6-4793-b860-db03f88d9817 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:09.253618 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 490/976] 10.222.0.49 () {56 vars in 1149 bytes} [Sun Aug 28 00:46:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:46:09.254671 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b7e85-dbdc-4ec2-990c-2065d34f1d67 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:09.274511 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:09.281390 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ca05f4-98ad-47b7-b4e8-68c24141647b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:09.282088 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca05f4-98ad-47b7-b4e8-68c24141647b None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:09.282429 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca05f4-98ad-47b7-b4e8-68c24141647b None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:09.282764 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ca05f4-98ad-47b7-b4e8-68c24141647b None admin] PATH_INFO: `/v3/services` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:09.283426 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ca05f4-98ad-47b7-b4e8-68c24141647b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:09.283753 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ca05f4-98ad-47b7-b4e8-68c24141647b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:09.285118 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ca05f4-98ad-47b7-b4e8-68c24141647b None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:09.296161 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 487/977] 10.222.0.49 () {56 vars in 1122 bytes} [Sun Aug 28 00:46:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:46:09.296161 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967de5e-b88d-42d6-aace-1439139a33e9 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:09.296161 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967de5e-b88d-42d6-aace-1439139a33e9 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:09.296161 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967de5e-b88d-42d6-aace-1439139a33e9 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:09.296161 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 488/978] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:46:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:09.299538 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967de5e-b88d-42d6-aace-1439139a33e9 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:09.344721 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:09.359917 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b7e85-dbdc-4ec2-990c-2065d34f1d67 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:09.395473 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836ca690-c692-4121-9165-7257b9c8f878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:09.396117 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ca690-c692-4121-9165-7257b9c8f878 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:09.396401 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ca690-c692-4121-9165-7257b9c8f878 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:09.396668 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ca690-c692-4121-9165-7257b9c8f878 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:09.404880 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967de5e-b88d-42d6-aace-1439139a33e9 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:09.438577 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd89140-8545-46c2-be54-9dc161b81fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:09.439188 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd89140-8545-46c2-be54-9dc161b81fc8 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:09.439455 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd89140-8545-46c2-be54-9dc161b81fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:09.439749 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd89140-8545-46c2-be54-9dc161b81fc8 None admin] PATH_INFO: `/v3/services` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:09.440373 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd89140-8545-46c2-be54-9dc161b81fc8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:09.440770 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd89140-8545-46c2-be54-9dc161b81fc8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:09.442028 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd89140-8545-46c2-be54-9dc161b81fc8 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:09.446750 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 489/979] 10.222.0.49 () {56 vars in 1122 bytes} [Sun Aug 28 00:46:09 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:09.447889 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd5382-527e-41ac-87b8-271ea2d814ac None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:09.448166 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd5382-527e-41ac-87b8-271ea2d814ac None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:09.448474 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd5382-527e-41ac-87b8-271ea2d814ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:09.463691 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836ca690-c692-4121-9165-7257b9c8f878 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:09.465123 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836ca690-c692-4121-9165-7257b9c8f878 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:09.466178 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-1cdd5382-527e-41ac-87b8-271ea2d814ac None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:09.467439 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-1cdd5382-527e-41ac-87b8-271ea2d814ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:09.519438 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:09.545049 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 490/980] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:46:09.546598 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd5382-527e-41ac-87b8-271ea2d814ac None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:09.559207 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:09.577321 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 491/981] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 28 00:46:09 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:46:09.584230 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836ca690-c692-4121-9165-7257b9c8f878 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:09.682303 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd5382-527e-41ac-87b8-271ea2d814ac None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:09.699477 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836ca690-c692-4121-9165-7257b9c8f878 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:09.738654 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ffe56e-4a3b-4230-9df1-6a6f5ecae707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:09.739377 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ffe56e-4a3b-4230-9df1-6a6f5ecae707 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:09.739687 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ffe56e-4a3b-4230-9df1-6a6f5ecae707 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:09.739963 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ffe56e-4a3b-4230-9df1-6a6f5ecae707 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:09.740691 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ffe56e-4a3b-4230-9df1-6a6f5ecae707 None admin] RBAC: Adding query filter params (interface=admin, service_id=e9a6d029e1ea4b0ea814674ae9a0829f, region_id=RegionOne) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:09.741081 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ffe56e-4a3b-4230-9df1-6a6f5ecae707 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:09.741183 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2a227d-c91f-44d9-93ae-9b869110c419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:09.743475 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a227d-c91f-44d9-93ae-9b869110c419 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:09.743475 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a227d-c91f-44d9-93ae-9b869110c419 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:09.743475 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a227d-c91f-44d9-93ae-9b869110c419 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:09.743802 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ffe56e-4a3b-4230-9df1-6a6f5ecae707 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:09.748461 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 491/982] 10.222.0.49 () {56 vars in 1249 bytes} [Sun Aug 28 00:46:09 2022] GET /identity/v3/endpoints?service_id=e9a6d029e1ea4b0ea814674ae9a0829f&interface=admin®ion_id=RegionOne => generated 193 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:09.754964 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ffe56e-4a3b-4230-9df1-6a6f5ecae707 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:09.763143 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2a227d-c91f-44d9-93ae-9b869110c419 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:09.766464 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2a227d-c91f-44d9-93ae-9b869110c419 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:09.784731 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-2d2a227d-c91f-44d9-93ae-9b869110c419 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:09.784731 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:09.784731 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:09.784731 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:09.784731 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:09.784731 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:09.784731 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:09.784731 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:09.784731 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:09.784731 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:09.784731 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:09.784731 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:09.784731 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:46:09.784731 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:46:09.784731 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:46:09.784731 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:46:09.786083 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:09.786083 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:09.786083 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:09.786083 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:09.786083 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:09.786083 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:09.786083 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:09.786083 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:09.786083 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:09.786083 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:09.786083 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:09.786083 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:09.786083 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:09.786083 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:09.786083 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:09.786083 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:09.786083 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:46:09.787769 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:46:09.787769 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:09.787769 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:46:09.787769 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 492/983] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:46:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:09.792187 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2a227d-c91f-44d9-93ae-9b869110c419 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:09.822574 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:09.838104 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:09.878326 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ffe56e-4a3b-4230-9df1-6a6f5ecae707 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:09.905209 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2a227d-c91f-44d9-93ae-9b869110c419 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:09.916208 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510e6f5e-e8d4-4e74-9947-13d46a2ad7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:09.916824 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e6f5e-e8d4-4e74-9947-13d46a2ad7c8 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:09.917100 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e6f5e-e8d4-4e74-9947-13d46a2ad7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:09.917376 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e6f5e-e8d4-4e74-9947-13d46a2ad7c8 None admin] PATH_INFO: `/v3/services` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:09.917987 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510e6f5e-e8d4-4e74-9947-13d46a2ad7c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:09.919365 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510e6f5e-e8d4-4e74-9947-13d46a2ad7c8 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:09.925899 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 492/984] 10.222.0.49 () {56 vars in 1087 bytes} [Sun Aug 28 00:46:09 2022] GET /identity/v3/services => generated 1497 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 00:46:09.926676 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510e6f5e-e8d4-4e74-9947-13d46a2ad7c8 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:09.956409 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd07f1a1-ca6c-4824-b8dd-862304f3428c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:09.957296 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07f1a1-ca6c-4824-b8dd-862304f3428c None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:09.957696 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07f1a1-ca6c-4824-b8dd-862304f3428c None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:09.958110 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07f1a1-ca6c-4824-b8dd-862304f3428c None admin] PATH_INFO: `/v3/domains` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:09.958816 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd07f1a1-ca6c-4824-b8dd-862304f3428c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:09.959315 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd07f1a1-ca6c-4824-b8dd-862304f3428c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:09.960986 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd07f1a1-ca6c-4824-b8dd-862304f3428c None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:09.975976 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 493/985] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:46:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:46:09.982027 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd07f1a1-ca6c-4824-b8dd-862304f3428c None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:10.073372 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510e6f5e-e8d4-4e74-9947-13d46a2ad7c8 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:10.096378 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:10.124360 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:10.126144 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53d9eaa-b029-455d-ad70-cce03bd162ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:10.127031 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d9eaa-b029-455d-ad70-cce03bd162ef None admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:10.127802 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d9eaa-b029-455d-ad70-cce03bd162ef None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:10.128204 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d9eaa-b029-455d-ad70-cce03bd162ef None admin] PATH_INFO: `/v3/services` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:10.128998 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53d9eaa-b029-455d-ad70-cce03bd162ef None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:10.129410 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd07f1a1-ca6c-4824-b8dd-862304f3428c None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:10.130822 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53d9eaa-b029-455d-ad70-cce03bd162ef None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:10.151745 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 493/986] 10.222.0.49 () {60 vars in 1141 bytes} [Sun Aug 28 00:46:09 2022] POST /identity/v3/services => generated 242 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:46:10.189822 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d67aa6d-aae9-4c4f-b10c-57004f4d9c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:10.190478 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67aa6d-aae9-4c4f-b10c-57004f4d9c44 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:10.190754 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67aa6d-aae9-4c4f-b10c-57004f4d9c44 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:10.191107 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67aa6d-aae9-4c4f-b10c-57004f4d9c44 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:10.199881 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d67aa6d-aae9-4c4f-b10c-57004f4d9c44 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:10.201423 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d67aa6d-aae9-4c4f-b10c-57004f4d9c44 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:10.215706 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-6d67aa6d-aae9-4c4f-b10c-57004f4d9c44 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:46:10.215706 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:10.215706 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:10.215706 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:10.215706 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:10.215706 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:10.215706 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:10.215706 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:10.215706 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:10.215706 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:10.215706 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:10.215706 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:10.215706 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:46:10.215706 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:46:10.215706 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:46:10.216821 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:46:10.216821 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:10.216821 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:10.216821 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:10.216821 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:10.216821 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:10.216821 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:10.216821 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:10.216821 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:10.216821 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:10.216821 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:10.216821 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:10.216821 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:10.216821 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:10.216821 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:10.216821 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:10.216821 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:10.218393 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:46:10.218393 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:46:10.218393 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:46:10.218393 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:46:10.218393 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:46:10.218393 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:46:10.218393 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:46:10.218393 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:46:10.218393 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 494/987] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 28 00:46:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:46:10.224867 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53d9eaa-b029-455d-ad70-cce03bd162ef None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:10.362136 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53d9eaa-b029-455d-ad70-cce03bd162ef None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:10.403991 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64994a6c-f6a2-40db-b062-83621462795a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:10.404623 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64994a6c-f6a2-40db-b062-83621462795a None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:10.404903 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64994a6c-f6a2-40db-b062-83621462795a None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:10.405173 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64994a6c-f6a2-40db-b062-83621462795a None admin] PATH_INFO: `/v3/projects` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:10.405873 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64994a6c-f6a2-40db-b062-83621462795a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:10.406178 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64994a6c-f6a2-40db-b062-83621462795a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:10.407627 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64994a6c-f6a2-40db-b062-83621462795a None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:10.421002 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 494/988] 10.222.0.49 () {56 vars in 1148 bytes} [Sun Aug 28 00:46:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:10.428374 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d67aa6d-aae9-4c4f-b10c-57004f4d9c44 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:10.544082 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d67aa6d-aae9-4c4f-b10c-57004f4d9c44 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:10.588154 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e898964d-3fb3-4168-b749-c267b4fbd0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:10.589067 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898964d-3fb3-4168-b749-c267b4fbd0e1 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:10.589450 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898964d-3fb3-4168-b749-c267b4fbd0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:10.589698 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898964d-3fb3-4168-b749-c267b4fbd0e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:10.590462 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e898964d-3fb3-4168-b749-c267b4fbd0e1 None admin] RBAC: Adding query filter params (role.id=0113a36accc54c15b333655ed6b73d82, scope.project.id=6d6e897c6391486e9c44e9277a3ee823, user.id=cbe0653ed0c04a9080b5c337392de8ad) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:10.590917 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e898964d-3fb3-4168-b749-c267b4fbd0e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:10.592552 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e898964d-3fb3-4168-b749-c267b4fbd0e1 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:10.600400 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 495/989] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 28 00:46:10 2022] GET /identity/v3/role_assignments?user.id=cbe0653ed0c04a9080b5c337392de8ad&scope.project.id=6d6e897c6391486e9c44e9277a3ee823&role.id=0113a36accc54c15b333655ed6b73d82 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:11.870440 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f005ae5-a14a-45c8-b315-d8ebfd654572 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:11.870975 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f005ae5-a14a-45c8-b315-d8ebfd654572 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:11.870975 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f005ae5-a14a-45c8-b315-d8ebfd654572 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:11.872364 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 495/990] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:46:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:11.879261 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7e51f-f8b4-4c78-ae76-427011b01579 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:11.880038 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7e51f-f8b4-4c78-ae76-427011b01579 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:11.880038 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7e51f-f8b4-4c78-ae76-427011b01579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:11.903589 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-87d7e51f-f8b4-4c78-ae76-427011b01579 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:11.906142 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-87d7e51f-f8b4-4c78-ae76-427011b01579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:11.927837 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:11.998514 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 496/991] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:11 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:46:12.134623 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df6cf0-4c5f-4faa-98af-a0a585952f80 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:12.134869 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df6cf0-4c5f-4faa-98af-a0a585952f80 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:12.135137 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df6cf0-4c5f-4faa-98af-a0a585952f80 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:12.136711 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 496/992] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:46:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:12.142082 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844464a8-5c29-48af-be53-9eea90968d13 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:12.142343 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844464a8-5c29-48af-be53-9eea90968d13 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:12.142632 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844464a8-5c29-48af-be53-9eea90968d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:12.161443 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-844464a8-5c29-48af-be53-9eea90968d13 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:12.162618 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-844464a8-5c29-48af-be53-9eea90968d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:12.235497 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 497/993] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:12 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:46:12.262436 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df6cf0-4c5f-4faa-98af-a0a585952f80 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:12.308318 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:12.396466 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df6cf0-4c5f-4faa-98af-a0a585952f80 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:12.437677 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28487db5-34f4-40fe-b838-edac00aeced2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:12.438331 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28487db5-34f4-40fe-b838-edac00aeced2 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:12.438605 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28487db5-34f4-40fe-b838-edac00aeced2 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:12.438873 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28487db5-34f4-40fe-b838-edac00aeced2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:12.439473 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28487db5-34f4-40fe-b838-edac00aeced2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:12.440893 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28487db5-34f4-40fe-b838-edac00aeced2 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:12.451018 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-28487db5-34f4-40fe-b838-edac00aeced2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 00:46:12.451018 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:12.451018 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:46:12.451018 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:46:12.451018 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:46:12.451018 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:46:12.451018 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:46:12.451018 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:46:12.451018 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 00:46:12.451018 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:46:12.451018 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:46:12.451018 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:46:12.451018 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:12.451018 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:12.451018 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:12.451018 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:12.451018 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:12.453253 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:12.453253 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:12.453253 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:12.453253 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:12.453253 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:12.453253 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:12.453253 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:46:12.453253 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:46:12.453253 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:46:12.453253 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:46:12.453253 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:12.453253 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:12.453253 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:12.453253 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:12.453253 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:12.453253 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:12.454882 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:12.454882 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:12.454882 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:12.454882 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:12.454882 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:12.454882 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:12.454882 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:12.454882 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:12.454882 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:12.454882 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:12.454882 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:46:12.454882 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:46:12.454882 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 28 00:46:12.454882 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:46:12.458576 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 497/994] 10.222.0.49 () {56 vars in 1126 bytes} [Sun Aug 28 00:46:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:12.460811 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844464a8-5c29-48af-be53-9eea90968d13 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:12.507177 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28487db5-34f4-40fe-b838-edac00aeced2 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:12.576397 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:12.599042 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844464a8-5c29-48af-be53-9eea90968d13 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:12.617774 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:12.620991 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28487db5-34f4-40fe-b838-edac00aeced2 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:12.633433 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ac55de-61ac-4edb-83de-d086863ae4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:12.634039 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac55de-61ac-4edb-83de-d086863ae4f9 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:12.634342 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac55de-61ac-4edb-83de-d086863ae4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:12.634604 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac55de-61ac-4edb-83de-d086863ae4f9 None admin] PATH_INFO: `/v3/services` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:12.635231 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ac55de-61ac-4edb-83de-d086863ae4f9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:12.635525 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ac55de-61ac-4edb-83de-d086863ae4f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:12.636928 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ac55de-61ac-4edb-83de-d086863ae4f9 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:12.642069 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 498/995] 10.222.0.49 () {56 vars in 1122 bytes} [Sun Aug 28 00:46:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:12.643472 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0ff48-11e4-4ac7-bee8-42fca114da2a None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:12.643796 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0ff48-11e4-4ac7-bee8-42fca114da2a None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:12.644071 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0ff48-11e4-4ac7-bee8-42fca114da2a None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:12.645237 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 499/996] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:46:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:12.648631 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f0ff48-11e4-4ac7-bee8-42fca114da2a None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:12.660011 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b290f8e-11ea-4c60-b881-8cfbd18f0925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:12.660646 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b290f8e-11ea-4c60-b881-8cfbd18f0925 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:12.660924 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b290f8e-11ea-4c60-b881-8cfbd18f0925 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:12.661192 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b290f8e-11ea-4c60-b881-8cfbd18f0925 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:12.661781 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b290f8e-11ea-4c60-b881-8cfbd18f0925 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:12.663151 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b290f8e-11ea-4c60-b881-8cfbd18f0925 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:12.671903 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-4b290f8e-11ea-4c60-b881-8cfbd18f0925 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 28 00:46:12.671903 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:12.671903 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:46:12.671903 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:46:12.671903 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:46:12.671903 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:46:12.671903 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:46:12.671903 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:46:12.671903 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 28 00:46:12.671903 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:46:12.671903 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:46:12.671903 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:46:12.671903 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:12.671903 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:12.671903 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:12.671903 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:12.671903 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:12.678044 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:12.678044 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:12.678044 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:12.678044 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:12.678044 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:12.678044 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:12.678044 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:46:12.678044 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:46:12.678044 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:46:12.678044 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:46:12.678044 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:12.678044 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:12.678044 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:12.678044 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:12.678044 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:12.678044 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:12.679147 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:12.679147 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:12.679147 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:12.679147 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:12.679147 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:12.679147 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:12.679147 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:12.679147 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:12.679147 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:12.679147 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:12.679147 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:46:12.679147 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:46:12.679147 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 28 00:46:12.679147 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:46:12.679147 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 498/997] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 28 00:46:12 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:46:12.680188 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea56e25-4e2f-42d8-8c75-8293397d1015 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:12.680188 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea56e25-4e2f-42d8-8c75-8293397d1015 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:12.680188 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea56e25-4e2f-42d8-8c75-8293397d1015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:12.695631 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-dea56e25-4e2f-42d8-8c75-8293397d1015 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:12.696867 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-dea56e25-4e2f-42d8-8c75-8293397d1015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:12.754057 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f0ff48-11e4-4ac7-bee8-42fca114da2a None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:12.766285 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 499/998] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:12 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:46:12.767136 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea56e25-4e2f-42d8-8c75-8293397d1015 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:12.801137 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca8a879-978d-4027-b329-1a82f4d47c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:12.802483 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca8a879-978d-4027-b329-1a82f4d47c6b None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:12.802954 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca8a879-978d-4027-b329-1a82f4d47c6b None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:12.803385 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca8a879-978d-4027-b329-1a82f4d47c6b None admin] PATH_INFO: `/v3/services` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:12.804531 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca8a879-978d-4027-b329-1a82f4d47c6b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:12.804902 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca8a879-978d-4027-b329-1a82f4d47c6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:12.808054 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca8a879-978d-4027-b329-1a82f4d47c6b None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:12.816356 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 500/999] 10.222.0.49 () {56 vars in 1122 bytes} [Sun Aug 28 00:46:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:12.824216 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca8a879-978d-4027-b329-1a82f4d47c6b None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:12.837933 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:12.885689 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:12.899435 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea56e25-4e2f-42d8-8c75-8293397d1015 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:12.941080 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c50724-4d70-4f18-a2a9-371043486cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:12.941952 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c50724-4d70-4f18-a2a9-371043486cef None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:12.942393 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c50724-4d70-4f18-a2a9-371043486cef None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:12.942754 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c50724-4d70-4f18-a2a9-371043486cef None admin] PATH_INFO: `/v3/services` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:12.943414 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c50724-4d70-4f18-a2a9-371043486cef None admin] RBAC: Adding query filter params (name=compute) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:12.943916 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c50724-4d70-4f18-a2a9-371043486cef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:12.945827 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c50724-4d70-4f18-a2a9-371043486cef None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:12.953942 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 500/1000] 10.222.0.49 () {56 vars in 1112 bytes} [Sun Aug 28 00:46:12 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:12.957265 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca8a879-978d-4027-b329-1a82f4d47c6b None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:12.961765 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c50724-4d70-4f18-a2a9-371043486cef None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:12.995223 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce104d25-1398-41df-9c3d-4097c1d9f2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:12.995955 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce104d25-1398-41df-9c3d-4097c1d9f2bc None admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:12.996341 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce104d25-1398-41df-9c3d-4097c1d9f2bc None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:12.996613 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce104d25-1398-41df-9c3d-4097c1d9f2bc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:12.997520 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce104d25-1398-41df-9c3d-4097c1d9f2bc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:12.998893 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce104d25-1398-41df-9c3d-4097c1d9f2bc None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:13.019314 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 501/1001] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 00:46:12 2022] POST /identity/v3/endpoints => generated 325 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:46:13.036824 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce104d25-1398-41df-9c3d-4097c1d9f2bc None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:13.091913 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c50724-4d70-4f18-a2a9-371043486cef None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:13.120599 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:13.144647 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6794147b-6599-404c-9369-3e6c67821ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:13.145575 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794147b-6599-404c-9369-3e6c67821ffb None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:13.145827 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794147b-6599-404c-9369-3e6c67821ffb None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:13.146164 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794147b-6599-404c-9369-3e6c67821ffb None admin] PATH_INFO: `/v3/services` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:13.146797 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6794147b-6599-404c-9369-3e6c67821ffb None admin] RBAC: Adding query filter params (type=compute) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:13.147250 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6794147b-6599-404c-9369-3e6c67821ffb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:13.148557 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6794147b-6599-404c-9369-3e6c67821ffb None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:13.161248 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 501/1002] 10.222.0.49 () {56 vars in 1112 bytes} [Sun Aug 28 00:46:12 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:13.167554 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6794147b-6599-404c-9369-3e6c67821ffb None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:13.180398 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce104d25-1398-41df-9c3d-4097c1d9f2bc None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:13.194177 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:13.223179 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29373176-5a6d-4f0d-9d92-fe9c612d80af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:13.223894 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29373176-5a6d-4f0d-9d92-fe9c612d80af None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:13.224170 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29373176-5a6d-4f0d-9d92-fe9c612d80af None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:13.224441 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29373176-5a6d-4f0d-9d92-fe9c612d80af None admin] PATH_INFO: `/v3/services/image` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:13.225044 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29373176-5a6d-4f0d-9d92-fe9c612d80af None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:13.226946 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29373176-5a6d-4f0d-9d92-fe9c612d80af None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:13.238217 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-29373176-5a6d-4f0d-9d92-fe9c612d80af None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 28 00:46:13.238217 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:13.238217 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:46:13.238217 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:46:13.238217 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:46:13.238217 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:46:13.238217 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:46:13.238217 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:46:13.238217 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 28 00:46:13.238217 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:46:13.238217 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:46:13.238217 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:46:13.238217 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:13.238217 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:13.238217 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:13.238217 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:13.238217 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:13.239551 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:13.239551 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:13.239551 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:13.239551 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:13.239551 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:13.239551 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:13.239551 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:46:13.239551 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:46:13.239551 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:46:13.239551 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:46:13.239551 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:13.239551 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:13.239551 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:13.239551 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:13.239551 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:13.239551 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:13.241078 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:13.241078 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:13.241078 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:13.241078 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:13.241078 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:13.241078 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:13.241078 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:13.241078 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:13.241078 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:13.241078 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:13.241078 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:46:13.241078 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:46:13.241078 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 28 00:46:13.241078 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:46:13.243927 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 502/1003] 10.222.0.49 () {56 vars in 1105 bytes} [Sun Aug 28 00:46:13 2022] GET /identity/v3/services/image => generated 86 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:46:13.245847 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29373176-5a6d-4f0d-9d92-fe9c612d80af None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:13.310546 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6794147b-6599-404c-9369-3e6c67821ffb None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:13.358621 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d40bdc-d3b1-45c2-9eea-213bfe3fde46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:13.359135 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d40bdc-d3b1-45c2-9eea-213bfe3fde46 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:13.359416 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d40bdc-d3b1-45c2-9eea-213bfe3fde46 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:13.359742 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d40bdc-d3b1-45c2-9eea-213bfe3fde46 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:13.360404 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d40bdc-d3b1-45c2-9eea-213bfe3fde46 None admin] RBAC: Adding query filter params (interface=public, service_id=bea310c617df4fbeb9c16dfb9a954967, region_id=RegionOne) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:13.360939 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d40bdc-d3b1-45c2-9eea-213bfe3fde46 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:13.362297 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d40bdc-d3b1-45c2-9eea-213bfe3fde46 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:13.380271 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 502/1004] 10.222.0.49 () {56 vars in 1251 bytes} [Sun Aug 28 00:46:13 2022] GET /identity/v3/endpoints?service_id=bea310c617df4fbeb9c16dfb9a954967&interface=public®ion_id=RegionOne => generated 194 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:13.383074 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d40bdc-d3b1-45c2-9eea-213bfe3fde46 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:13.384882 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29373176-5a6d-4f0d-9d92-fe9c612d80af None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:13.425645 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:13.434462 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5476d92-17e4-45c1-852d-e10cade86f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:13.435177 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5476d92-17e4-45c1-852d-e10cade86f9d None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:13.435558 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5476d92-17e4-45c1-852d-e10cade86f9d None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:13.435980 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5476d92-17e4-45c1-852d-e10cade86f9d None admin] PATH_INFO: `/v3/services` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:13.436700 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5476d92-17e4-45c1-852d-e10cade86f9d None admin] RBAC: Adding query filter params (name=image) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:13.437101 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5476d92-17e4-45c1-852d-e10cade86f9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:13.438597 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5476d92-17e4-45c1-852d-e10cade86f9d None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:13.444431 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 503/1005] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:46:13 2022] GET /identity/v3/services?name=image => generated 122 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:46:13.451965 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5476d92-17e4-45c1-852d-e10cade86f9d None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:13.506531 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:13.532026 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d40bdc-d3b1-45c2-9eea-213bfe3fde46 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:13.578255 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5476d92-17e4-45c1-852d-e10cade86f9d None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:13.593593 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618356cc-37e5-4647-9487-73a084088c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:13.594246 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618356cc-37e5-4647-9487-73a084088c9e None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:13.594703 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618356cc-37e5-4647-9487-73a084088c9e None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:13.595161 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618356cc-37e5-4647-9487-73a084088c9e None admin] PATH_INFO: `/v3/services` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:13.596114 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618356cc-37e5-4647-9487-73a084088c9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:13.597666 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618356cc-37e5-4647-9487-73a084088c9e None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:13.604828 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 503/1006] 10.222.0.49 () {56 vars in 1087 bytes} [Sun Aug 28 00:46:13 2022] GET /identity/v3/services => generated 1727 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:46:13.630959 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b685e158-9606-46f1-92b8-d9b14c065990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:13.631917 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685e158-9606-46f1-92b8-d9b14c065990 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:13.632339 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685e158-9606-46f1-92b8-d9b14c065990 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:13.632757 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b685e158-9606-46f1-92b8-d9b14c065990 None admin] PATH_INFO: `/v3/services` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:13.633796 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b685e158-9606-46f1-92b8-d9b14c065990 None admin] RBAC: Adding query filter params (type=image) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:13.634594 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b685e158-9606-46f1-92b8-d9b14c065990 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:13.637367 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b685e158-9606-46f1-92b8-d9b14c065990 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:13.646124 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 504/1007] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:46:13 2022] GET /identity/v3/services?type=image => generated 122 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:46:14.991045 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad00de28-115e-4411-b0c0-49779d005097 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:14.991575 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad00de28-115e-4411-b0c0-49779d005097 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:14.991575 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad00de28-115e-4411-b0c0-49779d005097 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:14.992997 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 504/1008] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:46:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:14.998855 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb7c1f-1c52-43b4-8b63-f1339c41b25f None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:14.999323 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb7c1f-1c52-43b4-8b63-f1339c41b25f None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:14.999399 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb7c1f-1c52-43b4-8b63-f1339c41b25f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:15.017845 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-5dbb7c1f-1c52-43b4-8b63-f1339c41b25f None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:15.019036 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-5dbb7c1f-1c52-43b4-8b63-f1339c41b25f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:15.094505 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:15.110932 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 505/1009] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:14 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:46:15.387947 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad00de28-115e-4411-b0c0-49779d005097 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:15.500575 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad00de28-115e-4411-b0c0-49779d005097 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:15.540579 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e0fe4f-a23d-4880-8195-d20eb123a7f4 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:15.540917 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e0fe4f-a23d-4880-8195-d20eb123a7f4 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:15.541120 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e0fe4f-a23d-4880-8195-d20eb123a7f4 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:15.542469 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 506/1010] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:46:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:15.548053 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b13ec5-d569-4967-82e4-393b7c2e4fad None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:15.548244 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f174d20-47cc-403e-a67b-1e1815d987ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:15.548344 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b13ec5-d569-4967-82e4-393b7c2e4fad None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:15.548608 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b13ec5-d569-4967-82e4-393b7c2e4fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:15.548770 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f174d20-47cc-403e-a67b-1e1815d987ed None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:15.549036 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f174d20-47cc-403e-a67b-1e1815d987ed None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:15.549307 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f174d20-47cc-403e-a67b-1e1815d987ed None admin] PATH_INFO: `/v3/domains/default` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:15.550454 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f174d20-47cc-403e-a67b-1e1815d987ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:15.551932 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f174d20-47cc-403e-a67b-1e1815d987ed None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:15.553666 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 505/1011] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:46:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:15.559487 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f174d20-47cc-403e-a67b-1e1815d987ed None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:15.568832 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-02b13ec5-d569-4967-82e4-393b7c2e4fad None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:15.570501 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-02b13ec5-d569-4967-82e4-393b7c2e4fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:15.577785 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:15.648358 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 507/1012] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:15 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:46:15.649545 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cff36e-f1e9-4bb0-a4ba-8bb3b4eaadab None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:15.649889 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cff36e-f1e9-4bb0-a4ba-8bb3b4eaadab None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:15.650166 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cff36e-f1e9-4bb0-a4ba-8bb3b4eaadab None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:15.651652 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 508/1013] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:46:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:15.658453 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3db6b-0d8a-4995-9569-f99905db7006 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:15.658919 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3db6b-0d8a-4995-9569-f99905db7006 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:15.659370 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3db6b-0d8a-4995-9569-f99905db7006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:15.681246 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f174d20-47cc-403e-a67b-1e1815d987ed None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:15.686782 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-fab3db6b-0d8a-4995-9569-f99905db7006 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:15.688052 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-fab3db6b-0d8a-4995-9569-f99905db7006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:15.752989 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c341f694-6284-48ff-a6d8-fa97329c83dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:15.753825 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341f694-6284-48ff-a6d8-fa97329c83dd None admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:15.754221 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341f694-6284-48ff-a6d8-fa97329c83dd None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:15.754643 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341f694-6284-48ff-a6d8-fa97329c83dd None admin] PATH_INFO: `/v3/projects` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:15.755574 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c341f694-6284-48ff-a6d8-fa97329c83dd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:15.757615 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c341f694-6284-48ff-a6d8-fa97329c83dd None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:15.789724 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 506/1014] 10.222.0.49 () {60 vars in 1141 bytes} [Sun Aug 28 00:46:15 2022] POST /identity/v3/projects => generated 311 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:46:15.805297 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 509/1015] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:15 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:46:15.911897 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c341f694-6284-48ff-a6d8-fa97329c83dd None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:15.993181 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:16.033036 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c341f694-6284-48ff-a6d8-fa97329c83dd None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:16.069441 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab3db6b-0d8a-4995-9569-f99905db7006 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:16.076293 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded8681d-17ac-4a17-80d4-64babdaada2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:16.076938 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8681d-17ac-4a17-80d4-64babdaada2a None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:16.077216 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8681d-17ac-4a17-80d4-64babdaada2a None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:16.077489 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8681d-17ac-4a17-80d4-64babdaada2a None admin] PATH_INFO: `/v3/services/compute` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:16.078080 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded8681d-17ac-4a17-80d4-64babdaada2a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:16.079479 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded8681d-17ac-4a17-80d4-64babdaada2a None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:16.093740 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-ded8681d-17ac-4a17-80d4-64babdaada2a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 28 00:46:16.093740 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:16.093740 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:46:16.093740 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:46:16.093740 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:46:16.093740 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:46:16.093740 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:46:16.093740 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:46:16.093740 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 28 00:46:16.093740 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:46:16.093740 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:46:16.093740 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:46:16.093740 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:16.093740 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:16.093740 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:16.093740 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:16.093740 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:16.094778 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:16.094778 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:16.094778 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:16.094778 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:16.094778 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:16.094778 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:16.094778 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:46:16.094778 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:46:16.094778 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:46:16.094778 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:46:16.094778 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:16.094778 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:16.094778 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:16.094778 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:16.094778 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:16.094778 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:16.095608 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:16.095608 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:16.095608 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:16.095608 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:16.095608 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:16.095608 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:16.095608 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:16.095608 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:16.095608 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:16.095608 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:16.095608 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:46:16.095608 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:46:16.095608 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 28 00:46:16.095608 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:46:16.097084 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 507/1016] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 28 00:46:15 2022] GET /identity/v3/services/compute => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:16.102208 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded8681d-17ac-4a17-80d4-64babdaada2a None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:16.126236 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:16.187144 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab3db6b-0d8a-4995-9569-f99905db7006 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:16.227867 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded8681d-17ac-4a17-80d4-64babdaada2a None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:16.231228 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aab430-8b34-40e3-93fd-6d74f32308a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:16.232034 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aab430-8b34-40e3-93fd-6d74f32308a1 None admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:16.232317 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aab430-8b34-40e3-93fd-6d74f32308a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:16.232588 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aab430-8b34-40e3-93fd-6d74f32308a1 None admin] PATH_INFO: `/v3/services` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:16.233501 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aab430-8b34-40e3-93fd-6d74f32308a1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:16.234671 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aab430-8b34-40e3-93fd-6d74f32308a1 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:16.259742 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 510/1017] 10.222.0.49 () {60 vars in 1141 bytes} [Sun Aug 28 00:46:16 2022] POST /identity/v3/services => generated 242 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:46:16.275434 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:16.289487 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d7c00-462d-4ae4-a6fc-cff174589484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:16.290107 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d7c00-462d-4ae4-a6fc-cff174589484 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:16.290420 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d7c00-462d-4ae4-a6fc-cff174589484 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:16.290690 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d7c00-462d-4ae4-a6fc-cff174589484 None admin] PATH_INFO: `/v3/services` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:16.291378 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4d7c00-462d-4ae4-a6fc-cff174589484 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:16.291769 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4d7c00-462d-4ae4-a6fc-cff174589484 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:16.293143 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4d7c00-462d-4ae4-a6fc-cff174589484 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:16.299242 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 508/1018] 10.222.0.49 () {56 vars in 1112 bytes} [Sun Aug 28 00:46:16 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:16.305009 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aab430-8b34-40e3-93fd-6d74f32308a1 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:16.419575 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aab430-8b34-40e3-93fd-6d74f32308a1 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:16.429926 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:16.460055 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c09bcca-761d-4325-b21a-522d22d71a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:16.460596 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09bcca-761d-4325-b21a-522d22d71a77 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:16.460871 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09bcca-761d-4325-b21a-522d22d71a77 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:16.461140 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09bcca-761d-4325-b21a-522d22d71a77 None admin] PATH_INFO: `/v3/services` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:16.461780 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c09bcca-761d-4325-b21a-522d22d71a77 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:16.462073 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c09bcca-761d-4325-b21a-522d22d71a77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:16.463567 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c09bcca-761d-4325-b21a-522d22d71a77 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:16.471466 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 511/1019] 10.222.0.49 () {56 vars in 1112 bytes} [Sun Aug 28 00:46:16 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:16.477230 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d7c00-462d-4ae4-a6fc-cff174589484 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:16.585418 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d7c00-462d-4ae4-a6fc-cff174589484 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:16.619618 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a227952-8765-4769-8cae-f3d3240a946c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:16.620259 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a227952-8765-4769-8cae-f3d3240a946c None admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:16.620533 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a227952-8765-4769-8cae-f3d3240a946c None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:16.620802 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a227952-8765-4769-8cae-f3d3240a946c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:16.621478 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a227952-8765-4769-8cae-f3d3240a946c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:16.622839 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a227952-8765-4769-8cae-f3d3240a946c None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:16.644122 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 509/1020] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 00:46:16 2022] POST /identity/v3/endpoints => generated 334 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:46:17.815611 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf04a26-d271-4378-bf53-92ee96491382 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:17.816188 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf04a26-d271-4378-bf53-92ee96491382 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:17.816188 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf04a26-d271-4378-bf53-92ee96491382 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:17.817788 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 512/1021] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:46:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:17.823473 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37887b9b-ec86-4553-992c-e8e179e9f70f None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:17.823963 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37887b9b-ec86-4553-992c-e8e179e9f70f None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:17.824038 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37887b9b-ec86-4553-992c-e8e179e9f70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:17.843106 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-37887b9b-ec86-4553-992c-e8e179e9f70f None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:17.844395 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-37887b9b-ec86-4553-992c-e8e179e9f70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:17.888851 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:17.922699 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 510/1022] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:17 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:46:18.164361 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5de677-259f-4bb4-bd39-d8383c23bced None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:18.164548 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5de677-259f-4bb4-bd39-d8383c23bced None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:18.164774 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5de677-259f-4bb4-bd39-d8383c23bced None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:18.166388 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 513/1023] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:46:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:18.171654 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f59a08-937d-491c-aad4-62f5b6863da7 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:18.172013 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f59a08-937d-491c-aad4-62f5b6863da7 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:18.172286 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f59a08-937d-491c-aad4-62f5b6863da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:18.192012 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5de677-259f-4bb4-bd39-d8383c23bced None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:18.192427 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-26f59a08-937d-491c-aad4-62f5b6863da7 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:18.193641 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-26f59a08-937d-491c-aad4-62f5b6863da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:18.267375 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 511/1024] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:18 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:46:18.303805 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5de677-259f-4bb4-bd39-d8383c23bced None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:18.342606 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ea11e-dc94-424b-88a4-71dfa4e1a502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:18.343692 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ea11e-dc94-424b-88a4-71dfa4e1a502 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:18.344166 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ea11e-dc94-424b-88a4-71dfa4e1a502 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:18.344642 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ea11e-dc94-424b-88a4-71dfa4e1a502 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:18.345959 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3ea11e-dc94-424b-88a4-71dfa4e1a502 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:18.347568 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3ea11e-dc94-424b-88a4-71dfa4e1a502 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:18.349621 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 514/1025] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:46:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:46:18.355814 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f59a08-937d-491c-aad4-62f5b6863da7 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:18.460949 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f59a08-937d-491c-aad4-62f5b6863da7 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:18.462835 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:18.499408 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4927b242-faa2-4d0c-a348-a607336d34a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:18.500043 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927b242-faa2-4d0c-a348-a607336d34a0 None admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:18.500323 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927b242-faa2-4d0c-a348-a607336d34a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:18.500592 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927b242-faa2-4d0c-a348-a607336d34a0 None admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:18.501250 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4927b242-faa2-4d0c-a348-a607336d34a0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:18.502694 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4927b242-faa2-4d0c-a348-a607336d34a0 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:18.531690 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 512/1026] 10.222.0.49 () {60 vars in 1132 bytes} [Sun Aug 28 00:46:18 2022] POST /identity/v3/users => generated 285 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:46:18.558905 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ea11e-dc94-424b-88a4-71dfa4e1a502 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:18.607687 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:18.637171 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a1c34f-322d-4aa5-96ab-906f9a85a2be None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:18.637447 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a1c34f-322d-4aa5-96ab-906f9a85a2be None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:18.637761 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a1c34f-322d-4aa5-96ab-906f9a85a2be None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:18.639324 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 513/1027] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:46:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:18.645136 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae8118b-e50c-4a80-9eeb-d8565279bc8b None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:18.645473 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae8118b-e50c-4a80-9eeb-d8565279bc8b None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:18.645703 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae8118b-e50c-4a80-9eeb-d8565279bc8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:18.664607 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-5ae8118b-e50c-4a80-9eeb-d8565279bc8b None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:18.665876 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-5ae8118b-e50c-4a80-9eeb-d8565279bc8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:18.677875 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ea11e-dc94-424b-88a4-71dfa4e1a502 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:18.719485 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0889c321-6afc-4c2f-b53d-100ea7526d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:18.720442 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0889c321-6afc-4c2f-b53d-100ea7526d38 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:18.720917 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0889c321-6afc-4c2f-b53d-100ea7526d38 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:18.721378 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0889c321-6afc-4c2f-b53d-100ea7526d38 None admin] PATH_INFO: `/v3/services/image` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:18.722188 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0889c321-6afc-4c2f-b53d-100ea7526d38 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:18.723762 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0889c321-6afc-4c2f-b53d-100ea7526d38 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:18.734437 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-0889c321-6afc-4c2f-b53d-100ea7526d38 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 28 00:46:18.734437 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:18.734437 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:46:18.734437 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:46:18.734437 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:46:18.734437 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:46:18.734437 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:46:18.734437 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:46:18.734437 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 28 00:46:18.734437 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:46:18.734437 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:46:18.734437 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:46:18.734437 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:18.734437 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:18.734437 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:18.734437 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:18.734437 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:18.735629 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:18.735629 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:18.735629 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:18.735629 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:18.735629 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:18.735629 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:18.735629 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:46:18.735629 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:46:18.735629 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:46:18.735629 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:46:18.735629 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:18.735629 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:18.735629 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:18.735629 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:18.735629 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:18.735629 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:18.736593 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:18.736593 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:18.736593 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:18.736593 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:18.736593 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:18.736593 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:18.736593 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:18.736593 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:18.736593 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:18.736593 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:18.736593 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:46:18.736593 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:46:18.736593 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 28 00:46:18.736593 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:46:18.742427 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 515/1028] 10.222.0.49 () {56 vars in 1105 bytes} [Sun Aug 28 00:46:18 2022] GET /identity/v3/services/image => generated 86 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:18.744208 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0889c321-6afc-4c2f-b53d-100ea7526d38 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:18.757094 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 514/1029] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:18 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:46:18.857369 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0889c321-6afc-4c2f-b53d-100ea7526d38 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:18.860713 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:18.897568 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77768fe-2f9f-408d-9e76-c96d182df75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:18.898186 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77768fe-2f9f-408d-9e76-c96d182df75f None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:18.898459 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77768fe-2f9f-408d-9e76-c96d182df75f None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:18.898727 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77768fe-2f9f-408d-9e76-c96d182df75f None admin] PATH_INFO: `/v3/services` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:18.899360 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77768fe-2f9f-408d-9e76-c96d182df75f None admin] RBAC: Adding query filter params (name=image) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:18.899698 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77768fe-2f9f-408d-9e76-c96d182df75f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:18.901587 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77768fe-2f9f-408d-9e76-c96d182df75f None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:18.911934 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 516/1030] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:46:18 2022] GET /identity/v3/services?name=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:46:18.913607 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae8118b-e50c-4a80-9eeb-d8565279bc8b None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:19.006268 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:19.019471 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77768fe-2f9f-408d-9e76-c96d182df75f None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:19.020603 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae8118b-e50c-4a80-9eeb-d8565279bc8b None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:19.055845 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c06b47-b396-45dc-ae59-6d015c02303e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:19.056498 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c06b47-b396-45dc-ae59-6d015c02303e None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:19.056771 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c06b47-b396-45dc-ae59-6d015c02303e None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:19.057038 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c06b47-b396-45dc-ae59-6d015c02303e None admin] PATH_INFO: `/v3/services` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:19.057688 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c06b47-b396-45dc-ae59-6d015c02303e None admin] RBAC: Adding query filter params (type=image) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:19.057973 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c06b47-b396-45dc-ae59-6d015c02303e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:19.059371 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c06b47-b396-45dc-ae59-6d015c02303e None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:19.064952 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 515/1031] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:46:18 2022] GET /identity/v3/services?type=image => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:19.070751 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c06b47-b396-45dc-ae59-6d015c02303e None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:19.146739 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77768fe-2f9f-408d-9e76-c96d182df75f None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:19.181550 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64af254-dae5-4172-bdd0-2219c14469bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:19.182195 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64af254-dae5-4172-bdd0-2219c14469bc None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:19.182470 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64af254-dae5-4172-bdd0-2219c14469bc None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:19.182759 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64af254-dae5-4172-bdd0-2219c14469bc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:19.190722 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c06b47-b396-45dc-ae59-6d015c02303e None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:19.202071 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64af254-dae5-4172-bdd0-2219c14469bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:46:19.207184 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-e64af254-dae5-4172-bdd0-2219c14469bc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 00:46:19.207184 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:19.207184 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:19.207184 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:19.207184 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:19.207184 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:19.207184 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:19.207184 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:19.207184 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:19.207184 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:19.207184 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:19.207184 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:19.207184 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:46:19.207184 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:46:19.207184 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:46:19.207184 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:46:19.208191 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:46:19.208191 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:46:19.208191 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:46:19.208191 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:46:19.208191 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:19.208191 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:19.208191 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:19.208191 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:19.208191 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:19.208191 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:19.208191 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:19.208191 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:19.208191 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:19.208191 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:19.208191 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:19.208191 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:19.209571 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:19.209571 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:19.209571 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:19.209571 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:19.209571 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:46:19.209571 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:46:19.209571 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:46:19.209571 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:46:19.209571 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:46:19.209571 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:46:19.209571 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 00:46:19.209571 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:46:19.209571 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 517/1032] 10.222.0.49 () {56 vars in 1120 bytes} [Sun Aug 28 00:46:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:46:19.214168 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64af254-dae5-4172-bdd0-2219c14469bc None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:19.235166 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002757f-8418-4a13-9d51-642314f3f4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:19.235802 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002757f-8418-4a13-9d51-642314f3f4ef None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:19.236078 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002757f-8418-4a13-9d51-642314f3f4ef None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:19.236341 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002757f-8418-4a13-9d51-642314f3f4ef None admin] PATH_INFO: `/v3/endpoints` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:19.237035 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0002757f-8418-4a13-9d51-642314f3f4ef None admin] RBAC: Adding query filter params (interface=public, service_id=518f0ac907f94d5abcef9524ed7b0137, region_id=RegionOne) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:19.237334 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0002757f-8418-4a13-9d51-642314f3f4ef None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:19.238692 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0002757f-8418-4a13-9d51-642314f3f4ef None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:19.245249 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:19.247004 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 516/1033] 10.222.0.49 () {56 vars in 1251 bytes} [Sun Aug 28 00:46:19 2022] GET /identity/v3/endpoints?service_id=518f0ac907f94d5abcef9524ed7b0137&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:19.252558 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002757f-8418-4a13-9d51-642314f3f4ef None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:19.271735 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:19.318493 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64af254-dae5-4172-bdd0-2219c14469bc None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:19.360372 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002757f-8418-4a13-9d51-642314f3f4ef None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:19.363327 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8119f814-16ca-4826-b49c-36d3921fd6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:19.363968 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119f814-16ca-4826-b49c-36d3921fd6d1 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:19.364243 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119f814-16ca-4826-b49c-36d3921fd6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:19.364509 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119f814-16ca-4826-b49c-36d3921fd6d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:19.365177 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8119f814-16ca-4826-b49c-36d3921fd6d1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:19.365471 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8119f814-16ca-4826-b49c-36d3921fd6d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:19.366845 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8119f814-16ca-4826-b49c-36d3921fd6d1 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:19.375638 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 518/1034] 10.222.0.49 () {56 vars in 1115 bytes} [Sun Aug 28 00:46:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:46:19.382992 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8119f814-16ca-4826-b49c-36d3921fd6d1 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:19.406828 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373ae34c-a36d-43e6-89c2-30032be49f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:19.407891 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373ae34c-a36d-43e6-89c2-30032be49f71 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:19.408378 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373ae34c-a36d-43e6-89c2-30032be49f71 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:19.408868 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373ae34c-a36d-43e6-89c2-30032be49f71 None admin] PATH_INFO: `/v3/services` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:19.409809 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373ae34c-a36d-43e6-89c2-30032be49f71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:19.411222 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373ae34c-a36d-43e6-89c2-30032be49f71 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:19.423711 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 517/1035] 10.222.0.49 () {56 vars in 1087 bytes} [Sun Aug 28 00:46:19 2022] GET /identity/v3/services => generated 1957 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 00:46:19.504136 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:19.516594 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8119f814-16ca-4826-b49c-36d3921fd6d1 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:19.558912 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3a9195-1fd3-4bb5-bc20-e24f8f563fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:19.559490 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a9195-1fd3-4bb5-bc20-e24f8f563fbb None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:19.559806 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a9195-1fd3-4bb5-bc20-e24f8f563fbb None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:19.560081 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a9195-1fd3-4bb5-bc20-e24f8f563fbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:19.577949 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3a9195-1fd3-4bb5-bc20-e24f8f563fbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:19.579428 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3a9195-1fd3-4bb5-bc20-e24f8f563fbb None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:19.597584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-eb3a9195-1fd3-4bb5-bc20-e24f8f563fbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:19.597584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:19.597584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:19.597584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:19.597584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:19.597584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:19.597584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:19.597584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:19.597584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:19.597584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:19.597584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:19.597584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:19.597584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:46:19.597584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:46:19.597584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:46:19.597584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:46:19.598614 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:19.598614 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:19.598614 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:19.598614 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:19.598614 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:19.598614 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:19.598614 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:19.598614 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:19.598614 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:19.598614 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:19.598614 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:19.598614 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:19.598614 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:19.598614 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:19.598614 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:19.598614 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:19.598614 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:46:19.599518 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:46:19.599518 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:19.599518 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:46:19.599518 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 519/1036] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:46:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:19.605876 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373ae34c-a36d-43e6-89c2-30032be49f71 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:19.706532 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:19.729917 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373ae34c-a36d-43e6-89c2-30032be49f71 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:19.770880 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b01a15-40cf-49a0-9c3b-2c765df9e372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:19.771503 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b01a15-40cf-49a0-9c3b-2c765df9e372 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:19.771896 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b01a15-40cf-49a0-9c3b-2c765df9e372 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:19.772179 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b01a15-40cf-49a0-9c3b-2c765df9e372 None admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:19.772837 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b01a15-40cf-49a0-9c3b-2c765df9e372 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:19.773141 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b01a15-40cf-49a0-9c3b-2c765df9e372 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:19.774554 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b01a15-40cf-49a0-9c3b-2c765df9e372 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:19.787955 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 518/1037] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:46:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:46:19.793760 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3a9195-1fd3-4bb5-bc20-e24f8f563fbb None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:19.910465 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3a9195-1fd3-4bb5-bc20-e24f8f563fbb None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:19.949149 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d35beb-366d-4b11-bb79-8c67a28ba9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:19.949773 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d35beb-366d-4b11-bb79-8c67a28ba9cb None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:19.950048 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d35beb-366d-4b11-bb79-8c67a28ba9cb None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:19.950313 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d35beb-366d-4b11-bb79-8c67a28ba9cb None admin] PATH_INFO: `/v3/users/nova` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:19.958865 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d35beb-366d-4b11-bb79-8c67a28ba9cb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:19.960348 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d35beb-366d-4b11-bb79-8c67a28ba9cb None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:19.972612 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-70d35beb-366d-4b11-bb79-8c67a28ba9cb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 28 00:46:19.972612 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:19.972612 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:19.972612 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:19.972612 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:19.972612 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:19.972612 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:19.972612 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:19.972612 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:19.972612 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:19.972612 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:19.972612 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:19.972612 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:46:19.972612 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:46:19.972612 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:46:19.972612 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:46:19.973677 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:19.973677 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:19.973677 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:46:19.973677 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:46:19.973677 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:46:19.973677 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:46:19.973677 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:19.973677 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:19.973677 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:19.973677 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:19.973677 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:19.973677 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:19.973677 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:19.973677 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:19.973677 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:19.973677 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:19.973677 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:19.973677 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:19.974713 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:19.974713 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:19.974713 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:46:19.974713 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:46:19.974713 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:46:19.974713 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:46:19.974713 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:46:19.974713 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:46:19.974713 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 28 00:46:19.974713 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:46:19.974713 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 520/1038] 10.222.0.49 () {56 vars in 1093 bytes} [Sun Aug 28 00:46:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:19.983806 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b01a15-40cf-49a0-9c3b-2c765df9e372 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:20.101242 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b01a15-40cf-49a0-9c3b-2c765df9e372 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:20.148013 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b13693-ba21-44a4-ae35-a92f8c8c8cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:20.148632 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b13693-ba21-44a4-ae35-a92f8c8c8cb1 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:20.148907 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b13693-ba21-44a4-ae35-a92f8c8c8cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:20.149176 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b13693-ba21-44a4-ae35-a92f8c8c8cb1 None admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:20.150072 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b13693-ba21-44a4-ae35-a92f8c8c8cb1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:20.150375 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b13693-ba21-44a4-ae35-a92f8c8c8cb1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:20.151844 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b13693-ba21-44a4-ae35-a92f8c8c8cb1 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:20.163725 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:20.180739 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 519/1039] 10.222.0.49 () {56 vars in 1133 bytes} [Sun Aug 28 00:46:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:20.183059 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d35beb-366d-4b11-bb79-8c67a28ba9cb None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:20.187710 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:20.301239 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d35beb-366d-4b11-bb79-8c67a28ba9cb None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:20.352871 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4c6ad9-730c-497a-8fe6-92108b90e658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:20.353941 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c6ad9-730c-497a-8fe6-92108b90e658 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:20.354398 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c6ad9-730c-497a-8fe6-92108b90e658 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:20.354843 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c6ad9-730c-497a-8fe6-92108b90e658 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:20.447061 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4c6ad9-730c-497a-8fe6-92108b90e658 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:20.448566 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4c6ad9-730c-497a-8fe6-92108b90e658 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:20.450943 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:20.499022 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f531f-f675-47d7-98e4-32480fb17e4d None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:20.499403 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f531f-f675-47d7-98e4-32480fb17e4d None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:20.499582 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f531f-f675-47d7-98e4-32480fb17e4d None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:20.501185 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 520/1040] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:46:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:20.506712 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a01a0-55e6-4859-9df9-9170b23fb830 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:20.507017 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a01a0-55e6-4859-9df9-9170b23fb830 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:20.507228 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a01a0-55e6-4859-9df9-9170b23fb830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:20.533808 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-ae7a01a0-55e6-4859-9df9-9170b23fb830 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:20.533808 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-ae7a01a0-55e6-4859-9df9-9170b23fb830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:20.590178 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 521/1041] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 28 00:46:20 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:46:20.595917 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4c6ad9-730c-497a-8fe6-92108b90e658 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:20.624033 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 521/1042] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:20 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:46:20.708500 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4c6ad9-730c-497a-8fe6-92108b90e658 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:20.709945 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:20.760586 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37b0b55-f69f-4258-a306-d6351baa99c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:20.762037 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b0b55-f69f-4258-a306-d6351baa99c4 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:20.762699 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b0b55-f69f-4258-a306-d6351baa99c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:20.763432 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b0b55-f69f-4258-a306-d6351baa99c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:20.780913 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37b0b55-f69f-4258-a306-d6351baa99c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:20.782765 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37b0b55-f69f-4258-a306-d6351baa99c4 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:20.798605 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-e37b0b55-f69f-4258-a306-d6351baa99c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:20.798605 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:20.798605 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:20.798605 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:20.798605 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:20.798605 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:20.798605 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:20.798605 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:20.798605 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:20.798605 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:20.798605 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:20.798605 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:20.798605 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:46:20.798605 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:46:20.798605 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:46:20.798605 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:46:20.799614 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:20.799614 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:20.799614 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:20.799614 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:20.799614 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:20.799614 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:20.799614 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:20.799614 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:20.799614 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:20.799614 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:20.799614 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:20.799614 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:20.799614 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:20.799614 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:20.799614 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:20.799614 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:20.799614 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:46:20.800631 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:46:20.800631 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:20.800631 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:46:20.802162 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 522/1043] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:46:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:46:20.808086 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7a01a0-55e6-4859-9df9-9170b23fb830 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:20.881044 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37b0b55-f69f-4258-a306-d6351baa99c4 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:20.914175 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7a01a0-55e6-4859-9df9-9170b23fb830 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:20.943450 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:20.952587 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cada32-7afa-432b-8b83-beb4db3db035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:20.953216 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cada32-7afa-432b-8b83-beb4db3db035 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:20.953562 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cada32-7afa-432b-8b83-beb4db3db035 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:20.953731 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cada32-7afa-432b-8b83-beb4db3db035 None admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:20.954385 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cada32-7afa-432b-8b83-beb4db3db035 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:20.954685 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cada32-7afa-432b-8b83-beb4db3db035 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:20.956406 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cada32-7afa-432b-8b83-beb4db3db035 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:20.973415 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 522/1044] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:46:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:20.974301 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cada32-7afa-432b-8b83-beb4db3db035 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:20.995703 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37b0b55-f69f-4258-a306-d6351baa99c4 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:21.035138 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd7af9-1ec9-461c-8476-bb4b8983807a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:21.035809 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd7af9-1ec9-461c-8476-bb4b8983807a None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:21.036089 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd7af9-1ec9-461c-8476-bb4b8983807a None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:21.036580 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd7af9-1ec9-461c-8476-bb4b8983807a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:21.047531 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfd7af9-1ec9-461c-8476-bb4b8983807a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:46:21.052441 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-2bfd7af9-1ec9-461c-8476-bb4b8983807a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:46:21.052441 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:21.052441 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:21.052441 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:21.052441 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:21.052441 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:21.052441 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:21.052441 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:21.052441 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:21.052441 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:21.052441 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:21.052441 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:21.052441 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:46:21.052441 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:46:21.052441 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:46:21.052441 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:46:21.057486 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:46:21.057486 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:46:21.057486 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:46:21.057486 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:46:21.057486 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:21.057486 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:21.057486 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:21.057486 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:21.057486 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:21.057486 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:21.057486 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:21.057486 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:21.057486 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:21.057486 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:21.057486 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:21.057486 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:21.061048 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:21.061048 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:21.061048 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:21.061048 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:21.061048 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:46:21.061048 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:46:21.061048 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:46:21.061048 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:46:21.061048 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:46:21.061048 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:46:21.061048 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:46:21.061048 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:46:21.061048 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 523/1045] 10.222.0.49 () {56 vars in 1096 bytes} [Sun Aug 28 00:46:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:21.061048 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd7af9-1ec9-461c-8476-bb4b8983807a None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:21.078182 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:21.087347 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cada32-7afa-432b-8b83-beb4db3db035 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:21.134182 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a8507-b2b2-4263-acc7-164dbdb287a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:21.135019 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a8507-b2b2-4263-acc7-164dbdb287a1 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:21.135485 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a8507-b2b2-4263-acc7-164dbdb287a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:21.135981 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a8507-b2b2-4263-acc7-164dbdb287a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:21.146766 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073a8507-b2b2-4263-acc7-164dbdb287a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:21.148827 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073a8507-b2b2-4263-acc7-164dbdb287a1 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:21.167058 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-073a8507-b2b2-4263-acc7-164dbdb287a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:46:21.167058 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:21.167058 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:21.167058 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:21.167058 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:21.167058 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:21.167058 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:21.167058 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:21.167058 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:21.167058 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:21.167058 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:21.167058 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:21.167058 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:46:21.167058 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:46:21.167058 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:46:21.168046 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:46:21.168046 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:21.168046 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:21.168046 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:21.168046 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:21.168046 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:21.168046 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:21.168046 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:21.168046 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:21.168046 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:21.168046 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:21.168046 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:21.168046 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:21.168046 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:21.168046 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:21.168046 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:21.168046 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:21.168952 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:46:21.168952 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:46:21.168952 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:46:21.168952 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:46:21.168952 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:46:21.168952 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:46:21.168952 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:46:21.168952 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:46:21.168952 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 523/1046] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 28 00:46:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:46:21.176348 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a8507-b2b2-4263-acc7-164dbdb287a1 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:21.203751 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd7af9-1ec9-461c-8476-bb4b8983807a None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:21.246401 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fec6dc5-6697-4f24-ae4a-a26de17d29e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:21.246906 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec6dc5-6697-4f24-ae4a-a26de17d29e2 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:21.247197 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec6dc5-6697-4f24-ae4a-a26de17d29e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:21.247470 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec6dc5-6697-4f24-ae4a-a26de17d29e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:21.248162 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fec6dc5-6697-4f24-ae4a-a26de17d29e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:21.248473 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fec6dc5-6697-4f24-ae4a-a26de17d29e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:21.249725 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:21.249835 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fec6dc5-6697-4f24-ae4a-a26de17d29e2 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:21.263703 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 524/1047] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 28 00:46:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:21.265008 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fec6dc5-6697-4f24-ae4a-a26de17d29e2 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:21.312001 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a8507-b2b2-4263-acc7-164dbdb287a1 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:21.346681 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde64c8a-f727-41c0-83de-517a0df14ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:21.347298 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde64c8a-f727-41c0-83de-517a0df14ed3 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:21.347574 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde64c8a-f727-41c0-83de-517a0df14ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:21.347873 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde64c8a-f727-41c0-83de-517a0df14ed3 None admin] PATH_INFO: `/v3/projects` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:21.348569 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde64c8a-f727-41c0-83de-517a0df14ed3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:21.348874 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde64c8a-f727-41c0-83de-517a0df14ed3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:21.348974 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:21.350319 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde64c8a-f727-41c0-83de-517a0df14ed3 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:21.363323 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 524/1048] 10.222.0.49 () {56 vars in 1148 bytes} [Sun Aug 28 00:46:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:46:21.364567 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61edb527-a4de-4a90-a5e7-d16defdcfbfe None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:21.364851 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61edb527-a4de-4a90-a5e7-d16defdcfbfe None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:21.365123 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61edb527-a4de-4a90-a5e7-d16defdcfbfe None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:21.366387 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 525/1049] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:46:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:21.369661 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61edb527-a4de-4a90-a5e7-d16defdcfbfe None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:21.372502 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fec6dc5-6697-4f24-ae4a-a26de17d29e2 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:21.409357 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd01ed44-a4b8-465f-a21f-f616044ff362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:21.409976 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd01ed44-a4b8-465f-a21f-f616044ff362 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:21.410251 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd01ed44-a4b8-465f-a21f-f616044ff362 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:21.410515 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd01ed44-a4b8-465f-a21f-f616044ff362 None admin] PATH_INFO: `/v3/users/de5eb716580443f9932a41d67d3a06f2` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:21.424559 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd01ed44-a4b8-465f-a21f-f616044ff362 None admin] RBAC: Authorizing `identity:get_user(user_id=de5eb716580443f9932a41d67d3a06f2)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:21.426000 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd01ed44-a4b8-465f-a21f-f616044ff362 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:21.427653 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 525/1050] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 28 00:46:21 2022] GET /identity/v3/users/de5eb716580443f9932a41d67d3a06f2 => generated 285 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:21.428906 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff61d5-7ebf-4f24-bf98-56bb8e1216aa None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:21.429184 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff61d5-7ebf-4f24-bf98-56bb8e1216aa None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:21.429513 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff61d5-7ebf-4f24-bf98-56bb8e1216aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:21.446974 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-48ff61d5-7ebf-4f24-bf98-56bb8e1216aa None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:21.448179 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-48ff61d5-7ebf-4f24-bf98-56bb8e1216aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:21.476081 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61edb527-a4de-4a90-a5e7-d16defdcfbfe None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:21.486556 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:21.518677 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb5aa2-d5f0-41ce-88c1-187d49fc753c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:21.519205 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb5aa2-d5f0-41ce-88c1-187d49fc753c None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:21.519481 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb5aa2-d5f0-41ce-88c1-187d49fc753c None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:21.519774 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb5aa2-d5f0-41ce-88c1-187d49fc753c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:21.520528 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcb5aa2-d5f0-41ce-88c1-187d49fc753c None admin] RBAC: Adding query filter params (role.id=0113a36accc54c15b333655ed6b73d82, scope.project.id=6d6e897c6391486e9c44e9277a3ee823, user.id=3dc0655c8156457a8fcb006c9fe85eb9) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:21.520819 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcb5aa2-d5f0-41ce-88c1-187d49fc753c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:21.522292 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcb5aa2-d5f0-41ce-88c1-187d49fc753c None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:21.528436 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 526/1051] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 28 00:46:21 2022] GET /identity/v3/role_assignments?user.id=3dc0655c8156457a8fcb006c9fe85eb9&scope.project.id=6d6e897c6391486e9c44e9277a3ee823&role.id=0113a36accc54c15b333655ed6b73d82 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:21.529279 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb5aa2-d5f0-41ce-88c1-187d49fc753c None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:21.540137 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 526/1052] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:21 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:46:21.670386 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb5aa2-d5f0-41ce-88c1-187d49fc753c None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:21.721228 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c56ffe9-c88f-4664-bce5-fabb3ceb3535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:21.721343 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56ffe9-c88f-4664-bce5-fabb3ceb3535 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:21.721655 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56ffe9-c88f-4664-bce5-fabb3ceb3535 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:21.721865 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56ffe9-c88f-4664-bce5-fabb3ceb3535 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:21.770877 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:21.800592 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c56ffe9-c88f-4664-bce5-fabb3ceb3535 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:21.802106 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c56ffe9-c88f-4664-bce5-fabb3ceb3535 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:21.811719 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ff61d5-7ebf-4f24-bf98-56bb8e1216aa None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:21.877187 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:21.919697 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ff61d5-7ebf-4f24-bf98-56bb8e1216aa None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:21.928831 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 527/1053] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 28 00:46:21 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:46:21.930420 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c56ffe9-c88f-4664-bce5-fabb3ceb3535 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:21.957880 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168574c9-37c6-4ca5-8fba-d865367c7416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:21.958543 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168574c9-37c6-4ca5-8fba-d865367c7416 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:21.958815 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168574c9-37c6-4ca5-8fba-d865367c7416 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:21.959079 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168574c9-37c6-4ca5-8fba-d865367c7416 None admin] PATH_INFO: `/v3/services/image` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:21.959709 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168574c9-37c6-4ca5-8fba-d865367c7416 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:21.961070 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168574c9-37c6-4ca5-8fba-d865367c7416 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:21.970200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-168574c9-37c6-4ca5-8fba-d865367c7416 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 28 00:46:21.970200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:21.970200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:46:21.970200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:46:21.970200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:46:21.970200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:46:21.970200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:46:21.970200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:46:21.970200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 28 00:46:21.970200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:46:21.970200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:46:21.970200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:46:21.970200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:21.970200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:21.970200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:21.970200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:21.970200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:21.971253 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:21.971253 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:21.971253 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:21.971253 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:21.971253 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:21.971253 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:21.971253 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:46:21.971253 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:46:21.971253 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:46:21.971253 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:46:21.971253 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:21.971253 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:21.971253 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:21.971253 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:21.971253 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:21.971253 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:21.976947 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:21.976947 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:21.976947 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:21.976947 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:21.976947 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:21.976947 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:21.976947 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:21.976947 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:21.976947 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:21.976947 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:21.976947 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:46:21.976947 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:46:21.976947 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 28 00:46:21.976947 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:46:21.976947 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 527/1054] 10.222.0.49 () {56 vars in 1105 bytes} [Sun Aug 28 00:46:21 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:46:21.978990 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168574c9-37c6-4ca5-8fba-d865367c7416 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:22.008762 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:22.040765 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c56ffe9-c88f-4664-bce5-fabb3ceb3535 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:22.079330 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1b62b-3f6f-40e7-bbde-efd74078e147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:22.080338 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1b62b-3f6f-40e7-bbde-efd74078e147 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:22.080612 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1b62b-3f6f-40e7-bbde-efd74078e147 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:22.080875 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1b62b-3f6f-40e7-bbde-efd74078e147 None admin] PATH_INFO: `/v3/projects/cc822eb8ca9d437888658e2e69e96c98` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:22.082036 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f1b62b-3f6f-40e7-bbde-efd74078e147 None admin] RBAC: Authorizing `identity:get_project(project_id=cc822eb8ca9d437888658e2e69e96c98)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:22.083477 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f1b62b-3f6f-40e7-bbde-efd74078e147 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:22.085259 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 528/1055] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 28 00:46:21 2022] GET /identity/v3/projects/cc822eb8ca9d437888658e2e69e96c98 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:22.089581 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168574c9-37c6-4ca5-8fba-d865367c7416 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:22.092005 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1b62b-3f6f-40e7-bbde-efd74078e147 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:22.120477 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:22.131509 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e05bf8-e841-42b1-9c3f-ee88a677f3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:22.132166 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e05bf8-e841-42b1-9c3f-ee88a677f3e2 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:22.132458 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e05bf8-e841-42b1-9c3f-ee88a677f3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:22.132726 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e05bf8-e841-42b1-9c3f-ee88a677f3e2 None admin] PATH_INFO: `/v3/services` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:22.133367 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e05bf8-e841-42b1-9c3f-ee88a677f3e2 None admin] RBAC: Adding query filter params (name=image) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:22.133660 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e05bf8-e841-42b1-9c3f-ee88a677f3e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:22.135160 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e05bf8-e841-42b1-9c3f-ee88a677f3e2 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:22.140930 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 528/1056] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:46:21 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:22.146512 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e05bf8-e841-42b1-9c3f-ee88a677f3e2 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:22.214341 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1b62b-3f6f-40e7-bbde-efd74078e147 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:22.254107 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2efce9-ea4f-42b3-acb6-3cb539967ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:22.254484 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e05bf8-e841-42b1-9c3f-ee88a677f3e2 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:22.254721 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2efce9-ea4f-42b3-acb6-3cb539967ccf None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:22.254995 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2efce9-ea4f-42b3-acb6-3cb539967ccf None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:22.255260 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2efce9-ea4f-42b3-acb6-3cb539967ccf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:22.256197 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2efce9-ea4f-42b3-acb6-3cb539967ccf None admin] RBAC: Adding query filter params (role.id=2e4889bb71f9434392c0baba59f2534e, scope.project.id=cc822eb8ca9d437888658e2e69e96c98, user.id=de5eb716580443f9932a41d67d3a06f2) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:22.256503 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2efce9-ea4f-42b3-acb6-3cb539967ccf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:22.258804 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2efce9-ea4f-42b3-acb6-3cb539967ccf None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:22.266644 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 529/1057] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 28 00:46:22 2022] GET /identity/v3/role_assignments?user.id=de5eb716580443f9932a41d67d3a06f2&scope.project.id=cc822eb8ca9d437888658e2e69e96c98&role.id=2e4889bb71f9434392c0baba59f2534e => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:46:22.293157 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a054e0-6218-495a-8fc4-6499131cbbc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:22.293746 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a054e0-6218-495a-8fc4-6499131cbbc5 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:22.294018 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a054e0-6218-495a-8fc4-6499131cbbc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:22.294281 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a054e0-6218-495a-8fc4-6499131cbbc5 None admin] PATH_INFO: `/v3/services` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:22.295029 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a054e0-6218-495a-8fc4-6499131cbbc5 None admin] RBAC: Adding query filter params (type=image) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:22.295363 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a054e0-6218-495a-8fc4-6499131cbbc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:22.296872 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a054e0-6218-495a-8fc4-6499131cbbc5 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:22.302859 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 529/1058] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:46:22 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:46:22.308541 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2efce9-ea4f-42b3-acb6-3cb539967ccf None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:22.313790 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:22.424912 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2efce9-ea4f-42b3-acb6-3cb539967ccf None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:22.460328 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc2fd1-3226-413a-a30d-c57d12cf6f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:22.460932 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc2fd1-3226-413a-a30d-c57d12cf6f68 None admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:22.461202 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc2fd1-3226-413a-a30d-c57d12cf6f68 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:22.461464 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc2fd1-3226-413a-a30d-c57d12cf6f68 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:22.462195 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc2fd1-3226-413a-a30d-c57d12cf6f68 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:22.463564 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc2fd1-3226-413a-a30d-c57d12cf6f68 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:22.490660 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 530/1059] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 00:46:22 2022] POST /identity/v3/endpoints => generated 327 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:46:23.423107 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29af637-ce64-4bbf-ab39-e0f0c5ab8278 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:23.423644 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29af637-ce64-4bbf-ab39-e0f0c5ab8278 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:23.423644 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29af637-ce64-4bbf-ab39-e0f0c5ab8278 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:23.425079 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 530/1060] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:46:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:23.430522 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8abb86-3c72-49c6-8b0a-23862f648a53 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:23.430980 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8abb86-3c72-49c6-8b0a-23862f648a53 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:23.431073 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8abb86-3c72-49c6-8b0a-23862f648a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:23.449383 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-eb8abb86-3c72-49c6-8b0a-23862f648a53 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:23.450540 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-eb8abb86-3c72-49c6-8b0a-23862f648a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:23.509064 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:23.527923 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 531/1061] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:46:23.803217 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29af637-ce64-4bbf-ab39-e0f0c5ab8278 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:23.870160 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:23.931907 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29af637-ce64-4bbf-ab39-e0f0c5ab8278 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:23.968989 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc40d7a-151b-4ec9-8465-14716c6dcbe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:23.969631 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc40d7a-151b-4ec9-8465-14716c6dcbe5 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:23.969909 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc40d7a-151b-4ec9-8465-14716c6dcbe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:23.970182 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc40d7a-151b-4ec9-8465-14716c6dcbe5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:23.981370 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc40d7a-151b-4ec9-8465-14716c6dcbe5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:46:23.986300 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-9cc40d7a-151b-4ec9-8465-14716c6dcbe5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 00:46:23.986300 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:23.986300 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:23.986300 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:23.986300 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:23.986300 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:23.986300 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:23.986300 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:23.986300 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:23.986300 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:23.986300 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:23.986300 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:23.986300 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:46:23.986300 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:46:23.986300 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:46:23.986300 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:46:23.987231 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:46:23.987231 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:46:23.987231 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:46:23.987231 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:46:23.987231 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:23.987231 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:23.987231 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:23.987231 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:23.987231 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:23.987231 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:23.987231 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:23.987231 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:23.987231 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:23.987231 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:23.987231 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:23.987231 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:23.992519 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:23.992519 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:23.992519 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:23.992519 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:23.992519 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:46:23.992519 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:46:23.992519 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:46:23.992519 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:46:23.992519 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:46:23.992519 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:46:23.992519 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 00:46:23.992519 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:46:23.992519 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 531/1062] 10.222.0.49 () {56 vars in 1120 bytes} [Sun Aug 28 00:46:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:23.994492 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8abb86-3c72-49c6-8b0a-23862f648a53 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:24.104100 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8abb86-3c72-49c6-8b0a-23862f648a53 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:24.140525 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57bc3b1-7b11-4558-bb71-6fe267d447c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:24.141196 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57bc3b1-7b11-4558-bb71-6fe267d447c4 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:24.141480 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57bc3b1-7b11-4558-bb71-6fe267d447c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:24.141743 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57bc3b1-7b11-4558-bb71-6fe267d447c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:24.142403 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57bc3b1-7b11-4558-bb71-6fe267d447c4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:24.142709 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57bc3b1-7b11-4558-bb71-6fe267d447c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:24.144130 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57bc3b1-7b11-4558-bb71-6fe267d447c4 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:24.150678 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3670373-63a3-44f0-8a26-0c843d82fa53 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:24.150949 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3670373-63a3-44f0-8a26-0c843d82fa53 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:24.151233 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3670373-63a3-44f0-8a26-0c843d82fa53 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:24.153350 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 532/1063] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:46:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:46:24.156028 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 532/1064] 10.222.0.49 () {56 vars in 1115 bytes} [Sun Aug 28 00:46:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:24.158475 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48036639-ac29-4cf2-809b-32ef2c14ac70 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:24.158759 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48036639-ac29-4cf2-809b-32ef2c14ac70 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:24.159025 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48036639-ac29-4cf2-809b-32ef2c14ac70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:24.159236 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57bc3b1-7b11-4558-bb71-6fe267d447c4 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:24.177714 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-48036639-ac29-4cf2-809b-32ef2c14ac70 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:24.178912 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-48036639-ac29-4cf2-809b-32ef2c14ac70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:24.216995 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:24.251599 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 533/1065] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:46:24.275022 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57bc3b1-7b11-4558-bb71-6fe267d447c4 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:24.310959 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8cbd11-eaf8-4f46-b12c-37172690f774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:24.311590 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8cbd11-eaf8-4f46-b12c-37172690f774 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:24.311883 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8cbd11-eaf8-4f46-b12c-37172690f774 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:24.312152 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8cbd11-eaf8-4f46-b12c-37172690f774 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:24.323418 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8cbd11-eaf8-4f46-b12c-37172690f774 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:24.324923 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8cbd11-eaf8-4f46-b12c-37172690f774 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:24.340231 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-bf8cbd11-eaf8-4f46-b12c-37172690f774 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:24.340231 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:24.340231 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:24.340231 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:24.340231 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:24.340231 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:24.340231 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:24.340231 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:24.340231 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:24.340231 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:24.340231 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:24.340231 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:24.340231 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:46:24.340231 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:46:24.340231 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:46:24.340231 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:46:24.341229 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:24.341229 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:24.341229 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:24.341229 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:24.341229 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:24.341229 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:24.341229 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:24.341229 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:24.341229 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:24.341229 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:24.341229 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:24.341229 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:24.341229 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:24.341229 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:24.341229 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:24.341229 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:24.341229 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:46:24.342186 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:46:24.342186 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:24.342186 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:46:24.343986 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 533/1066] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:46:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:46:24.347209 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48036639-ac29-4cf2-809b-32ef2c14ac70 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:24.397114 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:24.422099 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e38fa-e5ba-4f7d-84e9-6e4713d36e01 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:24.422099 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e38fa-e5ba-4f7d-84e9-6e4713d36e01 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:24.422449 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085e38fa-e5ba-4f7d-84e9-6e4713d36e01 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:24.423763 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 534/1067] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:46:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:46:24.429278 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c37e1e-80e5-4dbb-94d8-02d678d295c8 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:24.429538 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c37e1e-80e5-4dbb-94d8-02d678d295c8 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:24.430010 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c37e1e-80e5-4dbb-94d8-02d678d295c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:24.449108 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-b8c37e1e-80e5-4dbb-94d8-02d678d295c8 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:24.450299 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-b8c37e1e-80e5-4dbb-94d8-02d678d295c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:24.455787 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48036639-ac29-4cf2-809b-32ef2c14ac70 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:24.498351 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed3c3ff-ce7e-45c5-8204-1867412ddf0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:24.498983 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3c3ff-ce7e-45c5-8204-1867412ddf0e None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:24.499261 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3c3ff-ce7e-45c5-8204-1867412ddf0e None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:24.499529 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3c3ff-ce7e-45c5-8204-1867412ddf0e None admin] PATH_INFO: `/v3/domains` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:24.500285 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed3c3ff-ce7e-45c5-8204-1867412ddf0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:24.500573 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed3c3ff-ce7e-45c5-8204-1867412ddf0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:24.502145 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed3c3ff-ce7e-45c5-8204-1867412ddf0e None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:24.516059 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 534/1068] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:46:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:24.518372 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed3c3ff-ce7e-45c5-8204-1867412ddf0e None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:24.538901 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 535/1069] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:46:24.539831 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c37e1e-80e5-4dbb-94d8-02d678d295c8 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:24.575471 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:24.640014 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed3c3ff-ce7e-45c5-8204-1867412ddf0e None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:24.650512 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:24.651497 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c37e1e-80e5-4dbb-94d8-02d678d295c8 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:24.685377 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9bffb6-5dfe-42b9-a108-dce761c53779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:24.686027 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9bffb6-5dfe-42b9-a108-dce761c53779 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:24.686297 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9bffb6-5dfe-42b9-a108-dce761c53779 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:24.686570 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9bffb6-5dfe-42b9-a108-dce761c53779 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:24.688496 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d325184-b53c-4f6b-9629-823327e3f436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:24.689752 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d325184-b53c-4f6b-9629-823327e3f436 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:24.690234 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d325184-b53c-4f6b-9629-823327e3f436 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:24.690704 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d325184-b53c-4f6b-9629-823327e3f436 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:24.697455 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9bffb6-5dfe-42b9-a108-dce761c53779 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:46:24.698836 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d325184-b53c-4f6b-9629-823327e3f436 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:24.700334 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d325184-b53c-4f6b-9629-823327e3f436 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:24.702351 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-ae9bffb6-5dfe-42b9-a108-dce761c53779 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:46:24.702351 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:24.702351 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:24.702351 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:24.702351 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:24.702351 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:24.702351 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:24.702351 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:24.702351 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:24.702351 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:24.702351 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:24.702351 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:24.702351 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:46:24.702351 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:46:24.702351 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:46:24.702351 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:46:24.703265 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:46:24.703265 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:46:24.703265 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:46:24.703265 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:46:24.703265 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:24.703265 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:24.703265 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:24.703265 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:24.703265 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:24.703265 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:24.703265 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:24.703265 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:24.703265 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:24.703265 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:24.703265 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:24.703265 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:24.704166 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:24.704166 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:24.704166 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:24.704166 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:24.704166 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:46:24.704166 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:46:24.704166 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:46:24.704166 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:46:24.704166 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:46:24.704166 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:46:24.704166 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:46:24.704166 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:46:24.704166 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 535/1070] 10.222.0.49 () {56 vars in 1096 bytes} [Sun Aug 28 00:46:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:46:24.709720 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9bffb6-5dfe-42b9-a108-dce761c53779 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:24.714953 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-4d325184-b53c-4f6b-9629-823327e3f436 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 28 00:46:24.714953 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:24.714953 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:24.714953 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:24.714953 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:24.714953 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:24.714953 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:24.714953 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:24.714953 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:24.714953 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:24.714953 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:24.714953 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:24.714953 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:46:24.714953 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:46:24.714953 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:46:24.714953 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:46:24.716124 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:24.716124 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:24.716124 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:46:24.716124 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:46:24.716124 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:46:24.716124 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:46:24.716124 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:24.716124 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:24.716124 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:24.716124 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:24.716124 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:24.716124 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:24.716124 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:24.716124 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:24.716124 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:24.716124 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:24.716124 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:24.716124 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:24.717307 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:24.717307 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:24.717307 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:46:24.717307 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:46:24.717307 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:46:24.717307 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:46:24.717307 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:46:24.717307 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:46:24.717307 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 28 00:46:24.717307 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:46:24.719437 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 536/1071] 10.222.0.49 () {56 vars in 1093 bytes} [Sun Aug 28 00:46:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:24.726987 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d325184-b53c-4f6b-9629-823327e3f436 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:24.816413 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9bffb6-5dfe-42b9-a108-dce761c53779 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:24.822054 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:24.833733 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d325184-b53c-4f6b-9629-823327e3f436 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:24.850151 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c7cb06-3fdf-4db0-a781-334b0abe7654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:24.851042 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7cb06-3fdf-4db0-a781-334b0abe7654 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:24.851319 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7cb06-3fdf-4db0-a781-334b0abe7654 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:24.851642 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c7cb06-3fdf-4db0-a781-334b0abe7654 None admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:24.852290 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c7cb06-3fdf-4db0-a781-334b0abe7654 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:24.852614 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c7cb06-3fdf-4db0-a781-334b0abe7654 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:24.854483 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c7cb06-3fdf-4db0-a781-334b0abe7654 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:24.862393 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 536/1072] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 28 00:46:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:46:24.863171 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c7cb06-3fdf-4db0-a781-334b0abe7654 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:24.866342 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839a1241-641c-4c12-acf2-42c4deedd4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:24.867032 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a1241-641c-4c12-acf2-42c4deedd4cc None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:24.867368 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a1241-641c-4c12-acf2-42c4deedd4cc None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:24.867640 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a1241-641c-4c12-acf2-42c4deedd4cc None admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:24.868424 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839a1241-641c-4c12-acf2-42c4deedd4cc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:24.868731 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839a1241-641c-4c12-acf2-42c4deedd4cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:24.870143 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839a1241-641c-4c12-acf2-42c4deedd4cc None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:24.887598 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 537/1073] 10.222.0.49 () {56 vars in 1133 bytes} [Sun Aug 28 00:46:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:24.888438 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839a1241-641c-4c12-acf2-42c4deedd4cc None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:24.892977 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:24.963099 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c7cb06-3fdf-4db0-a781-334b0abe7654 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:24.985324 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839a1241-641c-4c12-acf2-42c4deedd4cc None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:24.996875 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28890fe9-7dfd-42f5-8889-d5249eafbfc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:24.997477 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28890fe9-7dfd-42f5-8889-d5249eafbfc0 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:24.997756 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28890fe9-7dfd-42f5-8889-d5249eafbfc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:24.998028 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28890fe9-7dfd-42f5-8889-d5249eafbfc0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:25.019425 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e67b877-21d0-4e6c-9a91-484eca93dd1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:25.020093 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67b877-21d0-4e6c-9a91-484eca93dd1c None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:25.020371 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67b877-21d0-4e6c-9a91-484eca93dd1c None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:25.020640 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e67b877-21d0-4e6c-9a91-484eca93dd1c None admin] PATH_INFO: `/v3/users/de5eb716580443f9932a41d67d3a06f2` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:25.021764 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e67b877-21d0-4e6c-9a91-484eca93dd1c None admin] RBAC: Authorizing `identity:get_user(user_id=de5eb716580443f9932a41d67d3a06f2)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:25.023236 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e67b877-21d0-4e6c-9a91-484eca93dd1c None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:25.024913 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 538/1074] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 28 00:46:24 2022] GET /identity/v3/users/de5eb716580443f9932a41d67d3a06f2 => generated 285 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:25.025662 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e67b877-21d0-4e6c-9a91-484eca93dd1c None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:25.043159 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:25.068490 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28890fe9-7dfd-42f5-8889-d5249eafbfc0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:25.069893 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28890fe9-7dfd-42f5-8889-d5249eafbfc0 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:25.097673 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:25.127777 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e67b877-21d0-4e6c-9a91-484eca93dd1c None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:25.162111 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a561fc8e-b15a-4095-add2-159da4957ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:25.162733 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561fc8e-b15a-4095-add2-159da4957ce2 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:25.163006 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561fc8e-b15a-4095-add2-159da4957ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:25.163298 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561fc8e-b15a-4095-add2-159da4957ce2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:25.171775 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 537/1075] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 28 00:46:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:46:25.172906 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28890fe9-7dfd-42f5-8889-d5249eafbfc0 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:25.173230 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a561fc8e-b15a-4095-add2-159da4957ce2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:25.174659 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a561fc8e-b15a-4095-add2-159da4957ce2 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:25.190027 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-a561fc8e-b15a-4095-add2-159da4957ce2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:25.190027 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:25.190027 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:25.190027 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:25.190027 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:25.190027 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:25.190027 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:25.190027 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:25.190027 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:25.190027 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:25.190027 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:25.190027 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:25.190027 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:46:25.190027 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:46:25.190027 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:46:25.190027 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:46:25.191099 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:25.191099 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:25.191099 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:25.191099 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:25.191099 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:25.191099 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:25.191099 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:25.191099 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:25.191099 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:25.191099 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:25.191099 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:25.191099 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:25.191099 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:25.191099 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:25.191099 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:25.191099 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:25.191099 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:46:25.192238 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:46:25.192238 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:25.192238 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:46:25.192238 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 539/1076] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:46:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:25.192238 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a561fc8e-b15a-4095-add2-159da4957ce2 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:25.255955 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:25.274068 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28890fe9-7dfd-42f5-8889-d5249eafbfc0 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:25.292140 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a561fc8e-b15a-4095-add2-159da4957ce2 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:25.300310 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:25.309954 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcea2cf-a486-4175-8a02-1ab7c6b9aa35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:25.310598 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcea2cf-a486-4175-8a02-1ab7c6b9aa35 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:25.310872 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcea2cf-a486-4175-8a02-1ab7c6b9aa35 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:25.311138 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcea2cf-a486-4175-8a02-1ab7c6b9aa35 None admin] PATH_INFO: `/v3/projects/cc822eb8ca9d437888658e2e69e96c98` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:25.312393 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcea2cf-a486-4175-8a02-1ab7c6b9aa35 None admin] RBAC: Authorizing `identity:get_project(project_id=cc822eb8ca9d437888658e2e69e96c98)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:25.313860 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcea2cf-a486-4175-8a02-1ab7c6b9aa35 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:25.315533 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 538/1077] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 28 00:46:25 2022] GET /identity/v3/projects/cc822eb8ca9d437888658e2e69e96c98 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:25.316362 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcea2cf-a486-4175-8a02-1ab7c6b9aa35 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:25.329839 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe6411-0896-4427-925c-25b8583644ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:25.330873 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe6411-0896-4427-925c-25b8583644ed None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:25.331155 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe6411-0896-4427-925c-25b8583644ed None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:25.331430 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe6411-0896-4427-925c-25b8583644ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:25.342746 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fe6411-0896-4427-925c-25b8583644ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:25.344252 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fe6411-0896-4427-925c-25b8583644ed None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:25.358805 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-35fe6411-0896-4427-925c-25b8583644ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:25.358805 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:25.358805 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:25.358805 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:25.358805 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:25.358805 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:25.358805 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:25.358805 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:25.358805 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:25.358805 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:25.358805 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:25.358805 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:25.358805 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:46:25.358805 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:46:25.358805 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:46:25.358805 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:46:25.359872 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:25.359872 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:25.359872 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:25.359872 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:25.359872 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:25.359872 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:25.359872 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:25.359872 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:25.359872 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:25.359872 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:25.359872 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:25.359872 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:25.359872 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:25.359872 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:25.359872 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:25.359872 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:25.359872 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:46:25.360803 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:46:25.360803 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:25.360803 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:46:25.360803 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 540/1078] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:46:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:25.360803 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe6411-0896-4427-925c-25b8583644ed None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:25.423119 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcea2cf-a486-4175-8a02-1ab7c6b9aa35 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:25.458159 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db57a9-97e1-41b8-8a41-d2200bd425ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:25.458865 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db57a9-97e1-41b8-8a41-d2200bd425ce None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:25.459038 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db57a9-97e1-41b8-8a41-d2200bd425ce None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:25.459307 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db57a9-97e1-41b8-8a41-d2200bd425ce None admin] PATH_INFO: `/v3/domains` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:25.459993 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64db57a9-97e1-41b8-8a41-d2200bd425ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:25.460294 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64db57a9-97e1-41b8-8a41-d2200bd425ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:25.461814 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64db57a9-97e1-41b8-8a41-d2200bd425ce None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:25.465013 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe6411-0896-4427-925c-25b8583644ed None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:25.474577 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 539/1079] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:46:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:25.475428 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db57a9-97e1-41b8-8a41-d2200bd425ce None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:25.487879 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:25.503696 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c535c-76ef-4b2a-8059-fe06c3debe5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:25.504360 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c535c-76ef-4b2a-8059-fe06c3debe5f None admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:25.504633 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c535c-76ef-4b2a-8059-fe06c3debe5f None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:25.504904 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c535c-76ef-4b2a-8059-fe06c3debe5f None admin] PATH_INFO: `/v3/projects/cc822eb8ca9d437888658e2e69e96c98/users/de5eb716580443f9932a41d67d3a06f2/roles/2e4889bb71f9434392c0baba59f2534e` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:25.506923 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4c535c-76ef-4b2a-8059-fe06c3debe5f None admin] RBAC: Authorizing `identity:create_grant(project_id=cc822eb8ca9d437888658e2e69e96c98, user_id=de5eb716580443f9932a41d67d3a06f2, role_id=2e4889bb71f9434392c0baba59f2534e)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:25.508444 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4c535c-76ef-4b2a-8059-fe06c3debe5f None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:25.521634 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 541/1080] 10.222.0.49 () {58 vars in 1439 bytes} [Sun Aug 28 00:46:25 2022] PUT /identity/v3/projects/cc822eb8ca9d437888658e2e69e96c98/users/de5eb716580443f9932a41d67d3a06f2/roles/2e4889bb71f9434392c0baba59f2534e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:46:25.522454 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c535c-76ef-4b2a-8059-fe06c3debe5f None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:25.546419 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:25.600501 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db57a9-97e1-41b8-8a41-d2200bd425ce None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:25.642716 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2576e84-ba38-4721-8cb8-37c95c963f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:25.643372 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2576e84-ba38-4721-8cb8-37c95c963f79 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:25.643646 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2576e84-ba38-4721-8cb8-37c95c963f79 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:25.643946 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2576e84-ba38-4721-8cb8-37c95c963f79 None admin] PATH_INFO: `/v3/domains` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:25.644621 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2576e84-ba38-4721-8cb8-37c95c963f79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:25.644920 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2576e84-ba38-4721-8cb8-37c95c963f79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:25.646341 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2576e84-ba38-4721-8cb8-37c95c963f79 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:25.650112 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c535c-76ef-4b2a-8059-fe06c3debe5f None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:25.659473 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 540/1081] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:46:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:25.693699 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb2d928-1047-4004-b247-509ba25ed5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:25.694339 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb2d928-1047-4004-b247-509ba25ed5d1 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:25.694609 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb2d928-1047-4004-b247-509ba25ed5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:25.694870 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb2d928-1047-4004-b247-509ba25ed5d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:25.704277 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb2d928-1047-4004-b247-509ba25ed5d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:25.705822 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb2d928-1047-4004-b247-509ba25ed5d1 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:25.719201 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-ecb2d928-1047-4004-b247-509ba25ed5d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:46:25.719201 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:25.719201 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:25.719201 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:25.719201 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:25.719201 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:25.719201 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:25.719201 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:25.719201 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:25.719201 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:25.719201 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:25.719201 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:25.719201 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:46:25.719201 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:46:25.719201 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:46:25.720306 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:46:25.720306 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:25.720306 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:25.720306 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:25.720306 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:25.720306 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:25.720306 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:25.720306 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:25.720306 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:25.720306 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:25.720306 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:25.720306 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:25.720306 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:25.720306 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:25.720306 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:25.720306 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:25.720306 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:25.721290 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:46:25.721290 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:46:25.721290 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:46:25.721290 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:46:25.721290 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:46:25.721290 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:46:25.721290 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:46:25.721290 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:46:25.721290 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 542/1082] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 28 00:46:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:25.728794 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2576e84-ba38-4721-8cb8-37c95c963f79 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:25.850899 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2576e84-ba38-4721-8cb8-37c95c963f79 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:25.869834 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:25.901291 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10195c7f-7d51-467b-bba8-c4fb56c10092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:25.902315 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10195c7f-7d51-467b-bba8-c4fb56c10092 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:25.902795 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10195c7f-7d51-467b-bba8-c4fb56c10092 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:25.903259 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10195c7f-7d51-467b-bba8-c4fb56c10092 None admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:25.904525 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10195c7f-7d51-467b-bba8-c4fb56c10092 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:25.905060 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10195c7f-7d51-467b-bba8-c4fb56c10092 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:25.907720 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10195c7f-7d51-467b-bba8-c4fb56c10092 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:25.929893 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 541/1083] 10.222.0.49 () {56 vars in 1148 bytes} [Sun Aug 28 00:46:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:25.935754 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb2d928-1047-4004-b247-509ba25ed5d1 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:25.993634 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:26.054656 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb2d928-1047-4004-b247-509ba25ed5d1 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:26.092207 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c0608-fa51-4d41-bc4c-8a5e0cda23a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:26.092869 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c0608-fa51-4d41-bc4c-8a5e0cda23a4 None admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:26.093141 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c0608-fa51-4d41-bc4c-8a5e0cda23a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:26.093407 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c0608-fa51-4d41-bc4c-8a5e0cda23a4 None admin] PATH_INFO: `/v3/projects/6d6e897c6391486e9c44e9277a3ee823/users/3dc0655c8156457a8fcb006c9fe85eb9/roles/0113a36accc54c15b333655ed6b73d82` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:26.096034 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4c0608-fa51-4d41-bc4c-8a5e0cda23a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=6d6e897c6391486e9c44e9277a3ee823, user_id=3dc0655c8156457a8fcb006c9fe85eb9, role_id=0113a36accc54c15b333655ed6b73d82)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:26.097515 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4c0608-fa51-4d41-bc4c-8a5e0cda23a4 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:26.111961 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 543/1084] 10.222.0.49 () {58 vars in 1439 bytes} [Sun Aug 28 00:46:25 2022] PUT /identity/v3/projects/6d6e897c6391486e9c44e9277a3ee823/users/3dc0655c8156457a8fcb006c9fe85eb9/roles/0113a36accc54c15b333655ed6b73d82 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:46:27.525511 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ebb89-9a3c-4ae2-bf1c-770e28cbe6b1 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:27.526192 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ebb89-9a3c-4ae2-bf1c-770e28cbe6b1 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:27.526192 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ebb89-9a3c-4ae2-bf1c-770e28cbe6b1 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:27.527377 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 542/1085] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:46:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:27.533661 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e2f964-b96e-4eb9-8df6-83f1a523cb11 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:27.534186 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e2f964-b96e-4eb9-8df6-83f1a523cb11 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:27.534186 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e2f964-b96e-4eb9-8df6-83f1a523cb11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:27.553511 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-e7e2f964-b96e-4eb9-8df6-83f1a523cb11 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:27.554678 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-e7e2f964-b96e-4eb9-8df6-83f1a523cb11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:27.627101 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 544/1086] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:46:27.892585 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394ebb89-9a3c-4ae2-bf1c-770e28cbe6b1 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:28.005347 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394ebb89-9a3c-4ae2-bf1c-770e28cbe6b1 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:28.013348 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c56ab3-f471-45a4-90d2-bc6acca65988 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:28.013618 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c56ab3-f471-45a4-90d2-bc6acca65988 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:28.013878 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c56ab3-f471-45a4-90d2-bc6acca65988 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:28.015213 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 545/1087] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:46:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:46:28.020492 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6004f9-dd69-4c62-8708-c6c6d02785fe None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:28.020776 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6004f9-dd69-4c62-8708-c6c6d02785fe None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:28.021047 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6004f9-dd69-4c62-8708-c6c6d02785fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:28.038945 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-7f6004f9-dd69-4c62-8708-c6c6d02785fe None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:28.040254 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-7f6004f9-dd69-4c62-8708-c6c6d02785fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:28.041932 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ac0c0-3446-4b43-afc8-988b5ab69a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:28.042564 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ac0c0-3446-4b43-afc8-988b5ab69a40 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:28.042837 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ac0c0-3446-4b43-afc8-988b5ab69a40 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:28.043093 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ac0c0-3446-4b43-afc8-988b5ab69a40 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:28.053821 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169ac0c0-3446-4b43-afc8-988b5ab69a40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:46:28.058583 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-169ac0c0-3446-4b43-afc8-988b5ab69a40 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:46:28.058583 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:28.058583 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:28.058583 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:28.058583 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:28.058583 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:28.058583 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:28.058583 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:28.058583 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:28.058583 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:28.058583 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:28.058583 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:28.058583 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:46:28.058583 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:46:28.058583 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:46:28.058583 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:46:28.060326 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:46:28.060326 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:46:28.060326 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:46:28.060326 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:46:28.060326 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:28.060326 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:28.060326 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:28.060326 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:28.060326 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:28.060326 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:28.060326 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:28.060326 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:28.060326 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:28.060326 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:28.060326 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:28.060326 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:28.062002 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:28.062002 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:28.062002 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:28.062002 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:28.062002 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:46:28.062002 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:46:28.062002 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:46:28.062002 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:46:28.062002 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:46:28.062002 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:46:28.062002 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:46:28.062002 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:46:28.062002 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 543/1088] 10.222.0.49 () {56 vars in 1096 bytes} [Sun Aug 28 00:46:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:28.065890 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ac0c0-3446-4b43-afc8-988b5ab69a40 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:28.067705 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:28.107691 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:28.131845 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 546/1089] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:46:28.184396 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ac0c0-3446-4b43-afc8-988b5ab69a40 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:28.225883 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e01290-4197-4341-b172-331ee3802a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:28.226486 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e01290-4197-4341-b172-331ee3802a90 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:28.226763 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e01290-4197-4341-b172-331ee3802a90 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:28.227022 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e01290-4197-4341-b172-331ee3802a90 None admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:28.227698 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e01290-4197-4341-b172-331ee3802a90 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:28.228008 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e01290-4197-4341-b172-331ee3802a90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:28.229382 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e01290-4197-4341-b172-331ee3802a90 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:28.238283 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 544/1090] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 28 00:46:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:28.247912 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6004f9-dd69-4c62-8708-c6c6d02785fe None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:28.364651 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6004f9-dd69-4c62-8708-c6c6d02785fe None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:28.399073 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e01290-4197-4341-b172-331ee3802a90 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:28.404749 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f0e1e-7c89-41e1-a64a-e1126eedd616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:28.404749 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f0e1e-7c89-41e1-a64a-e1126eedd616 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:28.404749 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f0e1e-7c89-41e1-a64a-e1126eedd616 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:28.404749 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f0e1e-7c89-41e1-a64a-e1126eedd616 None admin] PATH_INFO: `/v3/users/de5eb716580443f9932a41d67d3a06f2` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:28.405124 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95f0e1e-7c89-41e1-a64a-e1126eedd616 None admin] RBAC: Authorizing `identity:get_user(user_id=de5eb716580443f9932a41d67d3a06f2)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:28.406531 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95f0e1e-7c89-41e1-a64a-e1126eedd616 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:28.408191 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 547/1091] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 28 00:46:28 2022] GET /identity/v3/users/de5eb716580443f9932a41d67d3a06f2 => generated 285 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:28.414013 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f0e1e-7c89-41e1-a64a-e1126eedd616 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:28.443334 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:28.507266 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:28.511501 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e01290-4197-4341-b172-331ee3802a90 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:28.518642 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f0e1e-7c89-41e1-a64a-e1126eedd616 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:28.546749 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf13f93-10f3-4169-be0c-0c88e6e0e216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:28.547435 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf13f93-10f3-4169-be0c-0c88e6e0e216 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:28.547742 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf13f93-10f3-4169-be0c-0c88e6e0e216 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:28.548020 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf13f93-10f3-4169-be0c-0c88e6e0e216 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:28.552073 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d426be14-8ffe-4ce3-a41e-874d51912e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:28.552677 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426be14-8ffe-4ce3-a41e-874d51912e4e None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:28.552952 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426be14-8ffe-4ce3-a41e-874d51912e4e None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:28.553217 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426be14-8ffe-4ce3-a41e-874d51912e4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:28.558927 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf13f93-10f3-4169-be0c-0c88e6e0e216 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:46:28.563721 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-caf13f93-10f3-4169-be0c-0c88e6e0e216 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 00:46:28.563721 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:28.563721 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:28.563721 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:28.563721 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:28.563721 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:28.563721 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:28.563721 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:28.563721 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:28.563721 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:28.563721 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:28.563721 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:28.563721 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:46:28.563721 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:46:28.563721 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:46:28.563721 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:46:28.565729 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:46:28.565729 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:46:28.565729 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:46:28.565729 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:46:28.565729 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:28.565729 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:28.565729 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:28.565729 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:28.565729 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:28.565729 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:28.565729 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:28.565729 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:28.565729 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:28.565729 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:28.565729 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:28.565729 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:28.567773 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:28.567773 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:28.567773 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:28.567773 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:28.567773 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:46:28.567773 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:46:28.567773 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:46:28.567773 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:46:28.567773 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:46:28.567773 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:46:28.567773 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 28 00:46:28.567773 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:46:28.567773 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 545/1092] 10.222.0.49 () {56 vars in 1120 bytes} [Sun Aug 28 00:46:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:28.573530 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf13f93-10f3-4169-be0c-0c88e6e0e216 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:28.639459 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d426be14-8ffe-4ce3-a41e-874d51912e4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:28.640976 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d426be14-8ffe-4ce3-a41e-874d51912e4e None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:28.681641 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:28.686524 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf13f93-10f3-4169-be0c-0c88e6e0e216 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:28.727788 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1552d47c-c70d-4d3e-b6b0-4e7ede3b0a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:28.728598 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552d47c-c70d-4d3e-b6b0-4e7ede3b0a87 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:28.728873 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552d47c-c70d-4d3e-b6b0-4e7ede3b0a87 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:28.729139 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1552d47c-c70d-4d3e-b6b0-4e7ede3b0a87 None admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:28.729824 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1552d47c-c70d-4d3e-b6b0-4e7ede3b0a87 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:28.730125 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1552d47c-c70d-4d3e-b6b0-4e7ede3b0a87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:28.731505 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1552d47c-c70d-4d3e-b6b0-4e7ede3b0a87 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:28.739925 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 546/1093] 10.222.0.49 () {56 vars in 1115 bytes} [Sun Aug 28 00:46:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:46:28.745598 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1552d47c-c70d-4d3e-b6b0-4e7ede3b0a87 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:28.762531 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 548/1094] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 28 00:46:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:46:28.767154 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:28.768449 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d426be14-8ffe-4ce3-a41e-874d51912e4e None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:28.847257 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1552d47c-c70d-4d3e-b6b0-4e7ede3b0a87 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:28.866921 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d426be14-8ffe-4ce3-a41e-874d51912e4e None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:28.881590 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca589b4b-ea5a-465b-876c-d144c59d92e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:28.882219 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca589b4b-ea5a-465b-876c-d144c59d92e6 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:28.882491 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca589b4b-ea5a-465b-876c-d144c59d92e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:28.882758 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca589b4b-ea5a-465b-876c-d144c59d92e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:28.894403 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca589b4b-ea5a-465b-876c-d144c59d92e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:28.895950 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca589b4b-ea5a-465b-876c-d144c59d92e6 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:28.898345 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:28.908142 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b157ff-67a1-4e82-a730-20947b652456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:28.908804 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b157ff-67a1-4e82-a730-20947b652456 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:28.909083 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b157ff-67a1-4e82-a730-20947b652456 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:28.909354 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b157ff-67a1-4e82-a730-20947b652456 None admin] PATH_INFO: `/v3/projects/cc822eb8ca9d437888658e2e69e96c98` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:28.910585 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b157ff-67a1-4e82-a730-20947b652456 None admin] RBAC: Authorizing `identity:get_project(project_id=cc822eb8ca9d437888658e2e69e96c98)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:28.911030 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-ca589b4b-ea5a-465b-876c-d144c59d92e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:28.911030 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:28.911030 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:28.911030 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:28.911030 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:28.911030 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:28.911030 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:28.911030 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:28.911030 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:28.911030 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:28.911030 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:28.911030 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:28.911030 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:46:28.911030 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:46:28.911030 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:46:28.911030 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:46:28.916996 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:28.916996 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:28.916996 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:28.916996 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:28.916996 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:28.916996 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:28.916996 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:28.916996 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:28.916996 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:28.916996 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:28.916996 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:28.916996 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:28.916996 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:28.916996 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:28.916996 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:28.916996 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:28.916996 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:46:28.918042 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:46:28.918042 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:28.918042 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:46:28.918242 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b157ff-67a1-4e82-a730-20947b652456 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:28.918333 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 547/1095] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:46:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:46:28.918405 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 549/1096] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 28 00:46:28 2022] GET /identity/v3/projects/cc822eb8ca9d437888658e2e69e96c98 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:46:28.919514 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca589b4b-ea5a-465b-876c-d144c59d92e6 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:28.919700 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b157ff-67a1-4e82-a730-20947b652456 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:29.004110 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:29.032187 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b157ff-67a1-4e82-a730-20947b652456 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:29.038980 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca589b4b-ea5a-465b-876c-d144c59d92e6 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:29.084148 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab15f038-a056-4737-957c-52edcb36d639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:29.085211 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15f038-a056-4737-957c-52edcb36d639 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:29.085211 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15f038-a056-4737-957c-52edcb36d639 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:29.085481 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15f038-a056-4737-957c-52edcb36d639 None admin] PATH_INFO: `/v3/domains` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:29.086007 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab15f038-a056-4737-957c-52edcb36d639 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:29.086239 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab15f038-a056-4737-957c-52edcb36d639 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:29.087639 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab15f038-a056-4737-957c-52edcb36d639 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:29.092307 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b445ab55-430d-4406-8e21-f39ab55c989f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:29.092937 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445ab55-430d-4406-8e21-f39ab55c989f None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:29.093190 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445ab55-430d-4406-8e21-f39ab55c989f None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:29.093515 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445ab55-430d-4406-8e21-f39ab55c989f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:29.094255 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b445ab55-430d-4406-8e21-f39ab55c989f None admin] RBAC: Adding query filter params (role.id=2e4889bb71f9434392c0baba59f2534e, scope.project.id=cc822eb8ca9d437888658e2e69e96c98, user.id=de5eb716580443f9932a41d67d3a06f2) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:29.094559 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b445ab55-430d-4406-8e21-f39ab55c989f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:29.096585 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b445ab55-430d-4406-8e21-f39ab55c989f None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:29.102200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 548/1097] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:46:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:29.106210 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 550/1098] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 28 00:46:28 2022] GET /identity/v3/role_assignments?user.id=de5eb716580443f9932a41d67d3a06f2&scope.project.id=cc822eb8ca9d437888658e2e69e96c98&role.id=2e4889bb71f9434392c0baba59f2534e => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:29.108259 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab15f038-a056-4737-957c-52edcb36d639 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:29.247275 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab15f038-a056-4737-957c-52edcb36d639 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:29.283304 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:29.290229 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64f617-f407-4fad-b03d-bbe244e25a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:29.290870 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64f617-f407-4fad-b03d-bbe244e25a67 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:29.291147 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64f617-f407-4fad-b03d-bbe244e25a67 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:29.291427 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64f617-f407-4fad-b03d-bbe244e25a67 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:29.300326 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de64f617-f407-4fad-b03d-bbe244e25a67 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:29.302361 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de64f617-f407-4fad-b03d-bbe244e25a67 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:29.315327 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-de64f617-f407-4fad-b03d-bbe244e25a67 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 28 00:46:29.315327 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:29.315327 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:29.315327 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:29.315327 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:29.315327 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:29.315327 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:29.315327 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:29.315327 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:29.315327 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:29.315327 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:29.315327 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:29.315327 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:46:29.315327 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:46:29.315327 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:46:29.315327 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:46:29.316655 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:29.316655 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:29.316655 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:46:29.316655 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:46:29.316655 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:46:29.316655 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:46:29.316655 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:29.316655 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:29.316655 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:29.316655 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:29.316655 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:29.316655 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:29.316655 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:29.316655 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:29.316655 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:29.316655 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:29.316655 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:29.316655 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:29.318054 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:29.318054 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:29.318054 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:46:29.318054 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:46:29.318054 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:46:29.318054 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:46:29.318054 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:46:29.318054 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:46:29.318054 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 28 00:46:29.318054 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:46:29.318054 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 549/1099] 10.222.0.49 () {56 vars in 1093 bytes} [Sun Aug 28 00:46:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:29.322855 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b445ab55-430d-4406-8e21-f39ab55c989f None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:29.394422 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:29.435763 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b445ab55-430d-4406-8e21-f39ab55c989f None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:29.471016 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73909248-562b-4193-8e7b-ae2f4370c853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:29.471617 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73909248-562b-4193-8e7b-ae2f4370c853 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:29.471930 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73909248-562b-4193-8e7b-ae2f4370c853 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:29.472199 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73909248-562b-4193-8e7b-ae2f4370c853 None admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:29.472926 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73909248-562b-4193-8e7b-ae2f4370c853 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:29.473229 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73909248-562b-4193-8e7b-ae2f4370c853 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:29.474662 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73909248-562b-4193-8e7b-ae2f4370c853 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:29.492578 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 551/1100] 10.222.0.49 () {56 vars in 1133 bytes} [Sun Aug 28 00:46:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:29.498593 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64f617-f407-4fad-b03d-bbe244e25a67 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:29.601312 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64f617-f407-4fad-b03d-bbe244e25a67 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:29.635910 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a154c6e9-287a-4f24-a012-7728d0035474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:29.636522 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154c6e9-287a-4f24-a012-7728d0035474 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:29.636798 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154c6e9-287a-4f24-a012-7728d0035474 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:29.637058 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154c6e9-287a-4f24-a012-7728d0035474 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:29.699811 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:29.710343 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a154c6e9-287a-4f24-a012-7728d0035474 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:29.711874 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a154c6e9-287a-4f24-a012-7728d0035474 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:29.814485 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 550/1101] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 28 00:46:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:46:29.820730 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73909248-562b-4193-8e7b-ae2f4370c853 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:29.927586 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73909248-562b-4193-8e7b-ae2f4370c853 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:29.945418 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:29.963505 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5792706-5505-4aa3-b505-07bbb2f88f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:29.964169 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5792706-5505-4aa3-b505-07bbb2f88f03 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:29.964450 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5792706-5505-4aa3-b505-07bbb2f88f03 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:29.964720 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5792706-5505-4aa3-b505-07bbb2f88f03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:29.974784 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5792706-5505-4aa3-b505-07bbb2f88f03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:29.976276 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5792706-5505-4aa3-b505-07bbb2f88f03 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:29.991188 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-d5792706-5505-4aa3-b505-07bbb2f88f03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:29.991188 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:29.991188 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:29.991188 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:29.991188 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:29.991188 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:29.991188 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:29.991188 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:29.991188 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:29.991188 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:29.991188 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:29.991188 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:29.991188 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:46:29.991188 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:46:29.991188 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:46:29.991188 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:46:29.992398 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:29.992398 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:29.992398 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:29.992398 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:29.992398 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:29.992398 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:29.992398 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:29.992398 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:29.992398 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:29.992398 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:29.992398 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:29.992398 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:29.992398 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:29.992398 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:29.992398 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:29.992398 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:29.992398 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:46:29.993356 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:46:29.993356 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:46:29.993356 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:46:29.993356 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 552/1102] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:46:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:29.998214 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a154c6e9-287a-4f24-a012-7728d0035474 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:30.091142 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:30.101201 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a154c6e9-287a-4f24-a012-7728d0035474 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:30.137998 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95e633-533c-454e-bd80-df31d5b4ee6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:30.138608 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95e633-533c-454e-bd80-df31d5b4ee6c None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:30.138891 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95e633-533c-454e-bd80-df31d5b4ee6c None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:30.139163 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95e633-533c-454e-bd80-df31d5b4ee6c None admin] PATH_INFO: `/v3/domains` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:30.139852 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df95e633-533c-454e-bd80-df31d5b4ee6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:30.140158 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df95e633-533c-454e-bd80-df31d5b4ee6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:30.141543 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df95e633-533c-454e-bd80-df31d5b4ee6c None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:30.153700 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 551/1103] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:46:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:46:30.159601 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5792706-5505-4aa3-b505-07bbb2f88f03 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:30.271777 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5792706-5505-4aa3-b505-07bbb2f88f03 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:30.310377 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15164ee2-2a13-49f7-8383-564ce4ed31f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:30.311000 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15164ee2-2a13-49f7-8383-564ce4ed31f2 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:30.311274 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15164ee2-2a13-49f7-8383-564ce4ed31f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:30.311543 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15164ee2-2a13-49f7-8383-564ce4ed31f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:30.318485 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15164ee2-2a13-49f7-8383-564ce4ed31f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:30.319989 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15164ee2-2a13-49f7-8383-564ce4ed31f2 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:30.331487 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-15164ee2-2a13-49f7-8383-564ce4ed31f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:46:30.331487 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:30.331487 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:30.331487 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:30.331487 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:30.331487 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:30.331487 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:30.331487 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:30.331487 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:30.331487 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:30.331487 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:30.331487 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:30.331487 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:46:30.331487 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:46:30.331487 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:46:30.332675 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:46:30.332675 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:30.332675 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:30.332675 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:30.332675 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:30.332675 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:30.332675 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:30.332675 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:30.332675 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:30.332675 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:30.332675 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:30.332675 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:30.332675 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:30.332675 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:30.332675 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:30.332675 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:30.332675 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:30.333609 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:46:30.333609 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:46:30.333609 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:46:30.333609 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:46:30.333609 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:46:30.333609 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:46:30.333609 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:46:30.333609 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:46:30.333609 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 553/1104] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 28 00:46:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:30.338754 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95e633-533c-454e-bd80-df31d5b4ee6c None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:30.443260 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95e633-533c-454e-bd80-df31d5b4ee6c None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:30.478904 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b174f6-95cd-4b09-8c2b-9dc9396c7d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:30.479516 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b174f6-95cd-4b09-8c2b-9dc9396c7d3f None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:30.479825 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b174f6-95cd-4b09-8c2b-9dc9396c7d3f None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:30.480096 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b174f6-95cd-4b09-8c2b-9dc9396c7d3f None admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:30.480792 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b174f6-95cd-4b09-8c2b-9dc9396c7d3f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:30.481093 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b174f6-95cd-4b09-8c2b-9dc9396c7d3f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:30.482515 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b174f6-95cd-4b09-8c2b-9dc9396c7d3f None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:30.494886 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 552/1105] 10.222.0.49 () {56 vars in 1148 bytes} [Sun Aug 28 00:46:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:30.501200 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15164ee2-2a13-49f7-8383-564ce4ed31f2 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:30.534815 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:30.606925 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15164ee2-2a13-49f7-8383-564ce4ed31f2 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:30.643358 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a293c3c1-0648-4b9a-83de-1a4703fee691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:30.644007 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293c3c1-0648-4b9a-83de-1a4703fee691 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:30.644284 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293c3c1-0648-4b9a-83de-1a4703fee691 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:30.644557 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293c3c1-0648-4b9a-83de-1a4703fee691 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:30.645290 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a293c3c1-0648-4b9a-83de-1a4703fee691 None admin] RBAC: Adding query filter params (role.id=0113a36accc54c15b333655ed6b73d82, scope.project.id=6d6e897c6391486e9c44e9277a3ee823, user.id=3dc0655c8156457a8fcb006c9fe85eb9) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:30.645595 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a293c3c1-0648-4b9a-83de-1a4703fee691 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:30.647041 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a293c3c1-0648-4b9a-83de-1a4703fee691 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:30.654759 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 554/1106] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 28 00:46:30 2022] GET /identity/v3/role_assignments?user.id=3dc0655c8156457a8fcb006c9fe85eb9&scope.project.id=6d6e897c6391486e9c44e9277a3ee823&role.id=0113a36accc54c15b333655ed6b73d82 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:46:31.042253 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d9a10c-a10e-483b-ab4d-293f0ee40cd6 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:31.042808 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d9a10c-a10e-483b-ab4d-293f0ee40cd6 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:31.042808 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d9a10c-a10e-483b-ab4d-293f0ee40cd6 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:31.044219 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 553/1107] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:46:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:31.049925 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4f3c0-16e4-4e7b-b69a-e8fdc0c66c90 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:31.050412 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4f3c0-16e4-4e7b-b69a-e8fdc0c66c90 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:31.050412 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4f3c0-16e4-4e7b-b69a-e8fdc0c66c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:31.069911 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-c7c4f3c0-16e4-4e7b-b69a-e8fdc0c66c90 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:31.071489 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-c7c4f3c0-16e4-4e7b-b69a-e8fdc0c66c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:31.143144 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 555/1108] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:46:31.414158 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d9a10c-a10e-483b-ab4d-293f0ee40cd6 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:31.429502 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:31.519998 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d9a10c-a10e-483b-ab4d-293f0ee40cd6 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:31.553026 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f23b4b-7181-46d1-a3a1-d6652dfc45f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:31.553645 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f23b4b-7181-46d1-a3a1-d6652dfc45f6 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:31.553918 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f23b4b-7181-46d1-a3a1-d6652dfc45f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:31.554183 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f23b4b-7181-46d1-a3a1-d6652dfc45f6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:31.555710 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f23b4b-7181-46d1-a3a1-d6652dfc45f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:31.558377 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f23b4b-7181-46d1-a3a1-d6652dfc45f6 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:31.560964 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 554/1109] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:46:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:31.566910 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c4f3c0-16e4-4e7b-b69a-e8fdc0c66c90 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:31.592560 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:31.672210 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c4f3c0-16e4-4e7b-b69a-e8fdc0c66c90 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:31.708683 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5073ea-b153-4868-af9a-39890c9a8ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:31.709287 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5073ea-b153-4868-af9a-39890c9a8ce9 None admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:31.709557 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5073ea-b153-4868-af9a-39890c9a8ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:31.709820 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5073ea-b153-4868-af9a-39890c9a8ce9 None admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:31.710485 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5073ea-b153-4868-af9a-39890c9a8ce9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:31.711945 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5073ea-b153-4868-af9a-39890c9a8ce9 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:31.734354 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 556/1110] 10.222.0.49 () {60 vars in 1132 bytes} [Sun Aug 28 00:46:31 2022] POST /identity/v3/users => generated 286 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:46:33.673143 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d0b4c-ed34-47de-972b-1ef72624785b None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:33.673683 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d0b4c-ed34-47de-972b-1ef72624785b None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:33.673683 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d0b4c-ed34-47de-972b-1ef72624785b None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:33.675039 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 555/1111] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:46:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:33.680757 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c021801-42ad-4337-927c-56b4a45a1c22 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:33.681167 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c021801-42ad-4337-927c-56b4a45a1c22 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:33.681310 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c021801-42ad-4337-927c-56b4a45a1c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:33.700931 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-3c021801-42ad-4337-927c-56b4a45a1c22 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:33.702138 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-3c021801-42ad-4337-927c-56b4a45a1c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:33.780591 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 557/1112] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:46:34.053906 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5d0b4c-ed34-47de-972b-1ef72624785b None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:34.137802 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:34.159277 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5d0b4c-ed34-47de-972b-1ef72624785b None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:34.195271 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5210e44e-3252-4dcd-b82c-43cd6976bf84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:34.195949 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5210e44e-3252-4dcd-b82c-43cd6976bf84 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:34.196302 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5210e44e-3252-4dcd-b82c-43cd6976bf84 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:34.196578 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5210e44e-3252-4dcd-b82c-43cd6976bf84 None admin] PATH_INFO: `/v3/roles/5bcf10de71e7404aaef4d7878053be82` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:34.197997 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5210e44e-3252-4dcd-b82c-43cd6976bf84 None admin] RBAC: Authorizing `identity:get_role(role_id=5bcf10de71e7404aaef4d7878053be82)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:34.199369 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5210e44e-3252-4dcd-b82c-43cd6976bf84 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:34.200776 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 556/1113] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 28 00:46:34 2022] GET /identity/v3/roles/5bcf10de71e7404aaef4d7878053be82 => generated 223 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:34.207417 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c021801-42ad-4337-927c-56b4a45a1c22 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:34.219216 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:34.306961 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c021801-42ad-4337-927c-56b4a45a1c22 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:34.345125 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fa8172-fc31-4d2e-bf77-beea6de1e6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:34.345752 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa8172-fc31-4d2e-bf77-beea6de1e6d4 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:34.346030 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa8172-fc31-4d2e-bf77-beea6de1e6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:34.346299 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa8172-fc31-4d2e-bf77-beea6de1e6d4 None admin] PATH_INFO: `/v3/users/890404559f8245448bcf44c0b6aec498` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:34.360049 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fa8172-fc31-4d2e-bf77-beea6de1e6d4 None admin] RBAC: Authorizing `identity:get_user(user_id=890404559f8245448bcf44c0b6aec498)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:34.361509 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fa8172-fc31-4d2e-bf77-beea6de1e6d4 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:34.363193 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 558/1114] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 28 00:46:34 2022] GET /identity/v3/users/890404559f8245448bcf44c0b6aec498 => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:34.369168 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5210e44e-3252-4dcd-b82c-43cd6976bf84 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:34.482220 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5210e44e-3252-4dcd-b82c-43cd6976bf84 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:34.540442 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e50d96-d8ae-4515-8ab5-eb3b8d911a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:34.541093 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e50d96-d8ae-4515-8ab5-eb3b8d911a85 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:34.541378 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e50d96-d8ae-4515-8ab5-eb3b8d911a85 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:34.541647 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e50d96-d8ae-4515-8ab5-eb3b8d911a85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:34.562035 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:34.618604 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e50d96-d8ae-4515-8ab5-eb3b8d911a85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:34.620106 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e50d96-d8ae-4515-8ab5-eb3b8d911a85 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:34.719777 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 557/1115] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 28 00:46:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:46:34.725805 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fa8172-fc31-4d2e-bf77-beea6de1e6d4 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:34.794518 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:34.838807 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fa8172-fc31-4d2e-bf77-beea6de1e6d4 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:34.876401 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06656c42-94c9-4c90-ba8a-ef09bf7cce51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:34.877028 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06656c42-94c9-4c90-ba8a-ef09bf7cce51 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:34.877303 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06656c42-94c9-4c90-ba8a-ef09bf7cce51 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:34.877569 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06656c42-94c9-4c90-ba8a-ef09bf7cce51 None admin] PATH_INFO: `/v3/projects/cc822eb8ca9d437888658e2e69e96c98` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:34.878718 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06656c42-94c9-4c90-ba8a-ef09bf7cce51 None admin] RBAC: Authorizing `identity:get_project(project_id=cc822eb8ca9d437888658e2e69e96c98)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:34.880187 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06656c42-94c9-4c90-ba8a-ef09bf7cce51 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:34.881819 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 559/1116] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 28 00:46:34 2022] GET /identity/v3/projects/cc822eb8ca9d437888658e2e69e96c98 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:34.888314 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e50d96-d8ae-4515-8ab5-eb3b8d911a85 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:34.939288 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:34.991865 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e50d96-d8ae-4515-8ab5-eb3b8d911a85 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:35.029308 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5083aaef-26c7-4bef-a717-d40c5483a13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:35.029922 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083aaef-26c7-4bef-a717-d40c5483a13d None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:35.030199 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083aaef-26c7-4bef-a717-d40c5483a13d None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:35.030465 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083aaef-26c7-4bef-a717-d40c5483a13d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:35.031196 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5083aaef-26c7-4bef-a717-d40c5483a13d None admin] RBAC: Adding query filter params (role.id=5bcf10de71e7404aaef4d7878053be82, scope.project.id=cc822eb8ca9d437888658e2e69e96c98, user.id=890404559f8245448bcf44c0b6aec498) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:35.031491 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5083aaef-26c7-4bef-a717-d40c5483a13d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:35.032957 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5083aaef-26c7-4bef-a717-d40c5483a13d None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:35.038711 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 558/1117] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 28 00:46:34 2022] GET /identity/v3/role_assignments?user.id=890404559f8245448bcf44c0b6aec498&scope.project.id=cc822eb8ca9d437888658e2e69e96c98&role.id=5bcf10de71e7404aaef4d7878053be82 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:36.899283 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c945e-ab8f-4020-9785-baa6f5cdb3f6 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:36.899884 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c945e-ab8f-4020-9785-baa6f5cdb3f6 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:36.899884 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c945e-ab8f-4020-9785-baa6f5cdb3f6 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:36.901181 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 560/1118] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:46:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:36.906489 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aedb9ad-df78-46ab-abf7-9cdb0cba33cf None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:36.907035 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aedb9ad-df78-46ab-abf7-9cdb0cba33cf None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:36.907035 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aedb9ad-df78-46ab-abf7-9cdb0cba33cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:36.926140 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-7aedb9ad-df78-46ab-abf7-9cdb0cba33cf None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:36.927395 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-7aedb9ad-df78-46ab-abf7-9cdb0cba33cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:37.000577 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 559/1119] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:46:37.269077 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c945e-ab8f-4020-9785-baa6f5cdb3f6 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:37.377966 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c945e-ab8f-4020-9785-baa6f5cdb3f6 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:37.414557 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6eaf08-e4ba-4ac5-9282-284863e83e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:37.415257 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6eaf08-e4ba-4ac5-9282-284863e83e6b None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:37.415530 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6eaf08-e4ba-4ac5-9282-284863e83e6b None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:37.415826 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6eaf08-e4ba-4ac5-9282-284863e83e6b None admin] PATH_INFO: `/v3/roles/5bcf10de71e7404aaef4d7878053be82` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:37.417433 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6eaf08-e4ba-4ac5-9282-284863e83e6b None admin] RBAC: Authorizing `identity:get_role(role_id=5bcf10de71e7404aaef4d7878053be82)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:37.418857 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6eaf08-e4ba-4ac5-9282-284863e83e6b None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:37.420325 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 561/1120] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 28 00:46:37 2022] GET /identity/v3/roles/5bcf10de71e7404aaef4d7878053be82 => generated 223 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:37.426437 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aedb9ad-df78-46ab-abf7-9cdb0cba33cf None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:37.473045 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:37.533634 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aedb9ad-df78-46ab-abf7-9cdb0cba33cf None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:37.567606 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df4b04-f878-46e5-9c5f-d0a75dcc131a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:37.568278 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df4b04-f878-46e5-9c5f-d0a75dcc131a None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:37.568552 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df4b04-f878-46e5-9c5f-d0a75dcc131a None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:37.568826 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4df4b04-f878-46e5-9c5f-d0a75dcc131a None admin] PATH_INFO: `/v3/users/890404559f8245448bcf44c0b6aec498` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:37.569977 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4df4b04-f878-46e5-9c5f-d0a75dcc131a None admin] RBAC: Authorizing `identity:get_user(user_id=890404559f8245448bcf44c0b6aec498)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:37.571464 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4df4b04-f878-46e5-9c5f-d0a75dcc131a None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:37.573274 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 560/1121] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 28 00:46:37 2022] GET /identity/v3/users/890404559f8245448bcf44c0b6aec498 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:37.579448 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6eaf08-e4ba-4ac5-9282-284863e83e6b None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:37.583899 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:37.683191 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6eaf08-e4ba-4ac5-9282-284863e83e6b None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:37.719053 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44467925-8944-4be0-8f88-afbd0fee7d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:37.719697 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44467925-8944-4be0-8f88-afbd0fee7d83 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:37.720028 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44467925-8944-4be0-8f88-afbd0fee7d83 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:37.720296 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44467925-8944-4be0-8f88-afbd0fee7d83 None admin] PATH_INFO: `/v3/projects/cc822eb8ca9d437888658e2e69e96c98` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:37.721539 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44467925-8944-4be0-8f88-afbd0fee7d83 None admin] RBAC: Authorizing `identity:get_project(project_id=cc822eb8ca9d437888658e2e69e96c98)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:37.723017 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44467925-8944-4be0-8f88-afbd0fee7d83 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:37.724687 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 562/1122] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 28 00:46:37 2022] GET /identity/v3/projects/cc822eb8ca9d437888658e2e69e96c98 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:37.731918 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df4b04-f878-46e5-9c5f-d0a75dcc131a None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:37.837097 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4df4b04-f878-46e5-9c5f-d0a75dcc131a None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:37.848361 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:37.874154 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa333e5-7ca6-4669-af64-71b981e46de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:37.874825 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa333e5-7ca6-4669-af64-71b981e46de9 None admin] REQUEST_METHOD: `PUT` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:37.875105 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa333e5-7ca6-4669-af64-71b981e46de9 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:37.875377 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa333e5-7ca6-4669-af64-71b981e46de9 None admin] PATH_INFO: `/v3/projects/cc822eb8ca9d437888658e2e69e96c98/users/890404559f8245448bcf44c0b6aec498/roles/5bcf10de71e7404aaef4d7878053be82` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:37.877658 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa333e5-7ca6-4669-af64-71b981e46de9 None admin] RBAC: Authorizing `identity:create_grant(project_id=cc822eb8ca9d437888658e2e69e96c98, user_id=890404559f8245448bcf44c0b6aec498, role_id=5bcf10de71e7404aaef4d7878053be82)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:37.879102 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa333e5-7ca6-4669-af64-71b981e46de9 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:37.894775 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 561/1123] 10.222.0.49 () {58 vars in 1439 bytes} [Sun Aug 28 00:46:37 2022] PUT /identity/v3/projects/cc822eb8ca9d437888658e2e69e96c98/users/890404559f8245448bcf44c0b6aec498/roles/5bcf10de71e7404aaef4d7878053be82 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:46:39.740366 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32fc9cf-c8c9-4698-b6dc-ea57c6a42421 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:39.740968 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32fc9cf-c8c9-4698-b6dc-ea57c6a42421 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:39.740968 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32fc9cf-c8c9-4698-b6dc-ea57c6a42421 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:39.742258 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 563/1124] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:46:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:39.747896 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259a4b2-8c8b-4f59-836c-31f7a72d9b9b None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:39.748373 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259a4b2-8c8b-4f59-836c-31f7a72d9b9b None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:39.748470 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259a4b2-8c8b-4f59-836c-31f7a72d9b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:39.767551 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-6259a4b2-8c8b-4f59-836c-31f7a72d9b9b None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:39.768781 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-6259a4b2-8c8b-4f59-836c-31f7a72d9b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:39.841022 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 562/1125] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:46:40.102306 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32fc9cf-c8c9-4698-b6dc-ea57c6a42421 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:40.177703 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:40.211959 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32fc9cf-c8c9-4698-b6dc-ea57c6a42421 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:40.248120 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10684d4-d78e-46d3-919c-80a5ac039306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:40.248747 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10684d4-d78e-46d3-919c-80a5ac039306 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:40.249022 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10684d4-d78e-46d3-919c-80a5ac039306 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:40.249286 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10684d4-d78e-46d3-919c-80a5ac039306 None admin] PATH_INFO: `/v3/roles/5bcf10de71e7404aaef4d7878053be82` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:40.250675 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10684d4-d78e-46d3-919c-80a5ac039306 None admin] RBAC: Authorizing `identity:get_role(role_id=5bcf10de71e7404aaef4d7878053be82)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:40.252073 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10684d4-d78e-46d3-919c-80a5ac039306 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:40.253427 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 564/1126] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 28 00:46:40 2022] GET /identity/v3/roles/5bcf10de71e7404aaef4d7878053be82 => generated 223 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:40.259515 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259a4b2-8c8b-4f59-836c-31f7a72d9b9b None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:40.356222 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:40.359276 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259a4b2-8c8b-4f59-836c-31f7a72d9b9b None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:40.395616 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28bde26-d0e4-4e5e-93fe-6ef6b312aae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:40.396275 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28bde26-d0e4-4e5e-93fe-6ef6b312aae9 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:40.396554 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28bde26-d0e4-4e5e-93fe-6ef6b312aae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:40.396829 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28bde26-d0e4-4e5e-93fe-6ef6b312aae9 None admin] PATH_INFO: `/v3/users/890404559f8245448bcf44c0b6aec498` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:40.397990 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28bde26-d0e4-4e5e-93fe-6ef6b312aae9 None admin] RBAC: Authorizing `identity:get_user(user_id=890404559f8245448bcf44c0b6aec498)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:40.399467 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28bde26-d0e4-4e5e-93fe-6ef6b312aae9 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:40.401091 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 563/1127] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 28 00:46:40 2022] GET /identity/v3/users/890404559f8245448bcf44c0b6aec498 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:40.407087 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10684d4-d78e-46d3-919c-80a5ac039306 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:40.511443 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10684d4-d78e-46d3-919c-80a5ac039306 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:40.546767 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f595b0f1-2cd2-4a76-96e1-2c22cb3f5995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:40.547382 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595b0f1-2cd2-4a76-96e1-2c22cb3f5995 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:40.547704 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595b0f1-2cd2-4a76-96e1-2c22cb3f5995 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:40.547962 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595b0f1-2cd2-4a76-96e1-2c22cb3f5995 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:40.559982 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:40.626638 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f595b0f1-2cd2-4a76-96e1-2c22cb3f5995 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:40.628067 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f595b0f1-2cd2-4a76-96e1-2c22cb3f5995 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:40.734846 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 565/1128] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 28 00:46:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:46:40.741004 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28bde26-d0e4-4e5e-93fe-6ef6b312aae9 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:40.846380 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28bde26-d0e4-4e5e-93fe-6ef6b312aae9 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:40.881869 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11920478-df5e-4708-a17a-0721008d9f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:40.882407 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11920478-df5e-4708-a17a-0721008d9f76 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:40.882685 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11920478-df5e-4708-a17a-0721008d9f76 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:40.882950 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11920478-df5e-4708-a17a-0721008d9f76 None admin] PATH_INFO: `/v3/projects/cc822eb8ca9d437888658e2e69e96c98` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:40.884204 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11920478-df5e-4708-a17a-0721008d9f76 None admin] RBAC: Authorizing `identity:get_project(project_id=cc822eb8ca9d437888658e2e69e96c98)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:40.885643 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11920478-df5e-4708-a17a-0721008d9f76 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:40.887322 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 564/1129] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 28 00:46:40 2022] GET /identity/v3/projects/cc822eb8ca9d437888658e2e69e96c98 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:40.893706 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f595b0f1-2cd2-4a76-96e1-2c22cb3f5995 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:40.937250 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:41.000252 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f595b0f1-2cd2-4a76-96e1-2c22cb3f5995 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:41.036852 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf1f60-58bd-47d2-8600-ae55bf53e4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:41.037480 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf1f60-58bd-47d2-8600-ae55bf53e4db None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:41.037758 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf1f60-58bd-47d2-8600-ae55bf53e4db None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:41.038038 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf1f60-58bd-47d2-8600-ae55bf53e4db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:41.038754 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbf1f60-58bd-47d2-8600-ae55bf53e4db None admin] RBAC: Adding query filter params (role.id=5bcf10de71e7404aaef4d7878053be82, scope.project.id=cc822eb8ca9d437888658e2e69e96c98, user.id=890404559f8245448bcf44c0b6aec498) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:41.039060 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbf1f60-58bd-47d2-8600-ae55bf53e4db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:41.040566 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbf1f60-58bd-47d2-8600-ae55bf53e4db None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:41.047106 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 566/1130] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 28 00:46:40 2022] GET /identity/v3/role_assignments?user.id=890404559f8245448bcf44c0b6aec498&scope.project.id=cc822eb8ca9d437888658e2e69e96c98&role.id=5bcf10de71e7404aaef4d7878053be82 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:43.019499 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165be8b-75a3-4b8b-b346-8f8a6d493451 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:43.020187 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165be8b-75a3-4b8b-b346-8f8a6d493451 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:43.020187 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165be8b-75a3-4b8b-b346-8f8a6d493451 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:43.021316 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 565/1131] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:46:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:43.027204 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b848b1-a1ef-4787-90c5-51c47d69c203 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:43.027733 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b848b1-a1ef-4787-90c5-51c47d69c203 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:43.027859 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b848b1-a1ef-4787-90c5-51c47d69c203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:43.047178 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-45b848b1-a1ef-4787-90c5-51c47d69c203 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:43.048431 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-45b848b1-a1ef-4787-90c5-51c47d69c203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:43.120565 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 567/1132] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:46:43.390078 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165be8b-75a3-4b8b-b346-8f8a6d493451 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:43.432600 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:43.502599 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165be8b-75a3-4b8b-b346-8f8a6d493451 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:43.538889 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5eb9a-e452-46a1-adc4-dee7ae4d481f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:43.539541 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5eb9a-e452-46a1-adc4-dee7ae4d481f None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:43.539878 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5eb9a-e452-46a1-adc4-dee7ae4d481f None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:43.540147 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5eb9a-e452-46a1-adc4-dee7ae4d481f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:43.541316 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc5eb9a-e452-46a1-adc4-dee7ae4d481f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:43.542780 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc5eb9a-e452-46a1-adc4-dee7ae4d481f None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:43.544407 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 566/1133] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:46:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:43.550526 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b848b1-a1ef-4787-90c5-51c47d69c203 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:43.586808 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:43.661337 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b848b1-a1ef-4787-90c5-51c47d69c203 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:43.699131 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d06c8e-2461-47b2-a615-f2c38b25a082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:43.699781 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d06c8e-2461-47b2-a615-f2c38b25a082 None admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:43.700061 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d06c8e-2461-47b2-a615-f2c38b25a082 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:43.700332 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d06c8e-2461-47b2-a615-f2c38b25a082 None admin] PATH_INFO: `/v3/projects` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:43.700998 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d06c8e-2461-47b2-a615-f2c38b25a082 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:43.702453 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d06c8e-2461-47b2-a615-f2c38b25a082 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:43.741306 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 568/1134] 10.222.0.49 () {60 vars in 1141 bytes} [Sun Aug 28 00:46:43 2022] POST /identity/v3/projects => generated 311 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:46:45.746048 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373901e-6b86-4e47-8c82-8e543e873720 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:45.746681 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373901e-6b86-4e47-8c82-8e543e873720 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:45.746681 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373901e-6b86-4e47-8c82-8e543e873720 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:45.748260 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 567/1135] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:46:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:45.754790 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70bd582-3c25-41aa-aaa5-fa56ad646c6d None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:45.755429 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70bd582-3c25-41aa-aaa5-fa56ad646c6d None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:45.755429 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70bd582-3c25-41aa-aaa5-fa56ad646c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:45.775824 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-a70bd582-3c25-41aa-aaa5-fa56ad646c6d None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:45.777086 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-a70bd582-3c25-41aa-aaa5-fa56ad646c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:45.852005 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 569/1136] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:46:46.125511 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1373901e-6b86-4e47-8c82-8e543e873720 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:46.251469 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1373901e-6b86-4e47-8c82-8e543e873720 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:46.255549 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:46.290435 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5892f58-0d67-4c7d-90ac-8b81fef8b543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:46.291070 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5892f58-0d67-4c7d-90ac-8b81fef8b543 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:46.291342 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5892f58-0d67-4c7d-90ac-8b81fef8b543 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:46.291610 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5892f58-0d67-4c7d-90ac-8b81fef8b543 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:46.292846 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5892f58-0d67-4c7d-90ac-8b81fef8b543 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:46.294289 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5892f58-0d67-4c7d-90ac-8b81fef8b543 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:46.295919 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 568/1137] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:46:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:46.302554 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70bd582-3c25-41aa-aaa5-fa56ad646c6d None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:46.321615 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:46.412724 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70bd582-3c25-41aa-aaa5-fa56ad646c6d None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:46.449023 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee3138-cab2-4051-8ebe-9d39b7f8d8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:46.449635 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee3138-cab2-4051-8ebe-9d39b7f8d8bb None admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:46.449906 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee3138-cab2-4051-8ebe-9d39b7f8d8bb None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:46.450168 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee3138-cab2-4051-8ebe-9d39b7f8d8bb None admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:46.450834 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceee3138-cab2-4051-8ebe-9d39b7f8d8bb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:46.452313 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceee3138-cab2-4051-8ebe-9d39b7f8d8bb None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:46.477225 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 570/1138] 10.222.0.49 () {60 vars in 1132 bytes} [Sun Aug 28 00:46:46 2022] POST /identity/v3/users => generated 286 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:46:48.464530 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035c329-24c1-45ff-82b2-cd67df355976 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:48.465411 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035c329-24c1-45ff-82b2-cd67df355976 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:48.465411 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035c329-24c1-45ff-82b2-cd67df355976 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:48.466917 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 569/1139] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:46:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:48.472931 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee79a5-e0b6-4e9d-9ad1-31e46b2ee378 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:48.473483 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee79a5-e0b6-4e9d-9ad1-31e46b2ee378 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:48.473483 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee79a5-e0b6-4e9d-9ad1-31e46b2ee378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:48.492436 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-97ee79a5-e0b6-4e9d-9ad1-31e46b2ee378 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:48.493720 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-97ee79a5-e0b6-4e9d-9ad1-31e46b2ee378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:48.568421 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 571/1140] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:46:48.836520 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a035c329-24c1-45ff-82b2-cd67df355976 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:48.945356 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a035c329-24c1-45ff-82b2-cd67df355976 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:48.982441 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9815b5-c338-4f89-bf10-2df1bef89344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:48.982991 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9815b5-c338-4f89-bf10-2df1bef89344 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:48.983272 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9815b5-c338-4f89-bf10-2df1bef89344 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:48.983524 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9815b5-c338-4f89-bf10-2df1bef89344 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:48.994976 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9815b5-c338-4f89-bf10-2df1bef89344 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:46:48.999921 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-2a9815b5-c338-4f89-bf10-2df1bef89344 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:46:48.999921 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:48.999921 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:48.999921 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:48.999921 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:48.999921 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:48.999921 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:48.999921 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:48.999921 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:48.999921 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:48.999921 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:48.999921 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:48.999921 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:46:48.999921 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:46:48.999921 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:46:48.999921 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:46:49.001643 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:46:49.001643 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:46:49.001643 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:46:49.001643 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:46:49.001643 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:49.001643 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:49.001643 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:49.001643 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:49.001643 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:49.001643 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:49.001643 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:49.001643 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:49.001643 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:49.001643 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:49.001643 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:49.001643 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:49.003006 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:49.003006 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:49.003006 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:49.003006 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:49.003006 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:46:49.003006 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:46:49.003006 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:46:49.003006 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:46:49.003006 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:46:49.003006 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:46:49.003006 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:46:49.003006 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:46:49.003006 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 570/1141] 10.222.0.49 () {56 vars in 1096 bytes} [Sun Aug 28 00:46:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:49.007521 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee79a5-e0b6-4e9d-9ad1-31e46b2ee378 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:49.009914 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:49.118447 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee79a5-e0b6-4e9d-9ad1-31e46b2ee378 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:49.154103 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f816b-6f46-4f50-9e9e-1ffbd7875c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:49.154716 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f816b-6f46-4f50-9e9e-1ffbd7875c30 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:49.154993 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f816b-6f46-4f50-9e9e-1ffbd7875c30 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:49.155261 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f816b-6f46-4f50-9e9e-1ffbd7875c30 None admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:49.155970 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5f816b-6f46-4f50-9e9e-1ffbd7875c30 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:49.156274 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5f816b-6f46-4f50-9e9e-1ffbd7875c30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:49.157663 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5f816b-6f46-4f50-9e9e-1ffbd7875c30 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:49.166550 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 572/1142] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 28 00:46:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:49.174408 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9815b5-c338-4f89-bf10-2df1bef89344 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:49.209724 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:49.284978 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9815b5-c338-4f89-bf10-2df1bef89344 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:49.320399 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf28c00-ffcd-4133-991e-d81cfd36aa99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:49.321114 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf28c00-ffcd-4133-991e-d81cfd36aa99 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:49.321414 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf28c00-ffcd-4133-991e-d81cfd36aa99 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:49.321760 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf28c00-ffcd-4133-991e-d81cfd36aa99 None admin] PATH_INFO: `/v3/users/9b681f1ef59e4ec3ad64127dc2c70232` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:49.335823 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf28c00-ffcd-4133-991e-d81cfd36aa99 None admin] RBAC: Authorizing `identity:get_user(user_id=9b681f1ef59e4ec3ad64127dc2c70232)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:49.337412 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf28c00-ffcd-4133-991e-d81cfd36aa99 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:49.339141 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 571/1143] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 28 00:46:49 2022] GET /identity/v3/users/9b681f1ef59e4ec3ad64127dc2c70232 => generated 286 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:49.345401 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f816b-6f46-4f50-9e9e-1ffbd7875c30 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:49.412022 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:49.454208 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f816b-6f46-4f50-9e9e-1ffbd7875c30 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:49.492581 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb501f84-caf3-4f43-9aa9-84edc2d2b156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:49.493330 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb501f84-caf3-4f43-9aa9-84edc2d2b156 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:49.493467 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb501f84-caf3-4f43-9aa9-84edc2d2b156 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:49.493732 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb501f84-caf3-4f43-9aa9-84edc2d2b156 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:49.570440 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb501f84-caf3-4f43-9aa9-84edc2d2b156 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:49.571903 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb501f84-caf3-4f43-9aa9-84edc2d2b156 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:49.641759 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:49.686688 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 573/1144] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 28 00:46:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:46:49.693143 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf28c00-ffcd-4133-991e-d81cfd36aa99 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:49.795852 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:49.807689 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf28c00-ffcd-4133-991e-d81cfd36aa99 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:49.843271 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969fa2ec-879d-4373-9e87-458d97238995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:49.843855 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969fa2ec-879d-4373-9e87-458d97238995 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:49.844131 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969fa2ec-879d-4373-9e87-458d97238995 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:49.844398 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969fa2ec-879d-4373-9e87-458d97238995 None admin] PATH_INFO: `/v3/projects/03f099ce33cb4b4589e2c2928f290c9f` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:49.845517 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969fa2ec-879d-4373-9e87-458d97238995 None admin] RBAC: Authorizing `identity:get_project(project_id=03f099ce33cb4b4589e2c2928f290c9f)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:49.846945 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969fa2ec-879d-4373-9e87-458d97238995 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:49.848639 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 572/1145] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 28 00:46:49 2022] GET /identity/v3/projects/03f099ce33cb4b4589e2c2928f290c9f => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:49.855725 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb501f84-caf3-4f43-9aa9-84edc2d2b156 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:49.961952 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb501f84-caf3-4f43-9aa9-84edc2d2b156 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:50.000623 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6255c4d0-9b89-4a39-88e1-fb153885a2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:50.001363 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255c4d0-9b89-4a39-88e1-fb153885a2da None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:50.001641 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255c4d0-9b89-4a39-88e1-fb153885a2da None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:50.001907 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255c4d0-9b89-4a39-88e1-fb153885a2da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:50.002648 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6255c4d0-9b89-4a39-88e1-fb153885a2da None admin] RBAC: Adding query filter params (role.id=2e4889bb71f9434392c0baba59f2534e, scope.project.id=03f099ce33cb4b4589e2c2928f290c9f, user.id=9b681f1ef59e4ec3ad64127dc2c70232) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:50.002952 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6255c4d0-9b89-4a39-88e1-fb153885a2da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:50.004435 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6255c4d0-9b89-4a39-88e1-fb153885a2da None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:50.010328 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 574/1146] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 28 00:46:49 2022] GET /identity/v3/role_assignments?user.id=9b681f1ef59e4ec3ad64127dc2c70232&scope.project.id=03f099ce33cb4b4589e2c2928f290c9f&role.id=2e4889bb71f9434392c0baba59f2534e => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:51.948576 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee096dd-ad35-4bc5-8981-92b3ba531823 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:51.949174 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee096dd-ad35-4bc5-8981-92b3ba531823 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:51.949174 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee096dd-ad35-4bc5-8981-92b3ba531823 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:51.950447 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 573/1147] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:46:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:51.956620 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141579d-b9f3-46ec-a04c-eda1a42b17f4 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:51.957112 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141579d-b9f3-46ec-a04c-eda1a42b17f4 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:51.957112 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141579d-b9f3-46ec-a04c-eda1a42b17f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:51.976033 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-a141579d-b9f3-46ec-a04c-eda1a42b17f4 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:51.977256 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-a141579d-b9f3-46ec-a04c-eda1a42b17f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:52.002885 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:52.050647 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 575/1148] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:46:52.315881 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee096dd-ad35-4bc5-8981-92b3ba531823 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:52.426562 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee096dd-ad35-4bc5-8981-92b3ba531823 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:52.462419 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b89288c-a7f5-4f06-8ba9-01ebd069c462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:52.463048 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89288c-a7f5-4f06-8ba9-01ebd069c462 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:52.463326 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89288c-a7f5-4f06-8ba9-01ebd069c462 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:52.463599 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89288c-a7f5-4f06-8ba9-01ebd069c462 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:52.475105 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b89288c-a7f5-4f06-8ba9-01ebd069c462 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:46:52.480201 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-0b89288c-a7f5-4f06-8ba9-01ebd069c462 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:46:52.480201 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:52.480201 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:52.480201 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:52.480201 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:52.480201 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:52.480201 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:52.480201 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:52.480201 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:52.480201 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:52.480201 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:52.480201 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:52.480201 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:46:52.480201 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:46:52.480201 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:46:52.480201 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:46:52.481997 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:46:52.481997 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:46:52.481997 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:46:52.481997 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:46:52.481997 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:52.481997 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:52.481997 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:52.481997 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:52.481997 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:52.481997 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:52.481997 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:52.481997 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:52.481997 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:52.481997 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:52.481997 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:52.481997 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:52.483693 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:52.483693 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:52.483693 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:52.483693 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:52.483693 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:46:52.483693 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:46:52.483693 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:46:52.483693 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:46:52.483693 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:46:52.483693 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:46:52.483693 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:46:52.483693 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:46:52.483693 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 574/1149] 10.222.0.49 () {56 vars in 1096 bytes} [Sun Aug 28 00:46:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:52.487822 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a141579d-b9f3-46ec-a04c-eda1a42b17f4 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:52.594177 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a141579d-b9f3-46ec-a04c-eda1a42b17f4 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:52.632047 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a2428c-ae56-4784-9658-c360bbfd3616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:52.632657 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2428c-ae56-4784-9658-c360bbfd3616 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:52.633011 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2428c-ae56-4784-9658-c360bbfd3616 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:52.633314 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2428c-ae56-4784-9658-c360bbfd3616 None admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:52.633991 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a2428c-ae56-4784-9658-c360bbfd3616 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:52.634294 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a2428c-ae56-4784-9658-c360bbfd3616 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:52.635695 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a2428c-ae56-4784-9658-c360bbfd3616 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:52.644293 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 576/1150] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 28 00:46:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:52.650340 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b89288c-a7f5-4f06-8ba9-01ebd069c462 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:52.669941 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:52.754001 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b89288c-a7f5-4f06-8ba9-01ebd069c462 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:52.787398 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e410ed7-532d-40a5-98e1-073840f9da12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:52.788073 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e410ed7-532d-40a5-98e1-073840f9da12 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:52.788346 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e410ed7-532d-40a5-98e1-073840f9da12 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:52.788609 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e410ed7-532d-40a5-98e1-073840f9da12 None admin] PATH_INFO: `/v3/users/9b681f1ef59e4ec3ad64127dc2c70232` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:52.791121 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e410ed7-532d-40a5-98e1-073840f9da12 None admin] RBAC: Authorizing `identity:get_user(user_id=9b681f1ef59e4ec3ad64127dc2c70232)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:52.792575 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e410ed7-532d-40a5-98e1-073840f9da12 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:52.794167 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 575/1151] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 28 00:46:52 2022] GET /identity/v3/users/9b681f1ef59e4ec3ad64127dc2c70232 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:52.800417 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a2428c-ae56-4784-9658-c360bbfd3616 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:52.824520 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:52.909462 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a2428c-ae56-4784-9658-c360bbfd3616 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:52.943936 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d0ec0-f0fd-4d2c-9f5f-0c4fe2c04c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:52.944589 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d0ec0-f0fd-4d2c-9f5f-0c4fe2c04c04 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:52.944868 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d0ec0-f0fd-4d2c-9f5f-0c4fe2c04c04 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:52.945136 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d0ec0-f0fd-4d2c-9f5f-0c4fe2c04c04 None admin] PATH_INFO: `/v3/projects/03f099ce33cb4b4589e2c2928f290c9f` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:52.946299 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02d0ec0-f0fd-4d2c-9f5f-0c4fe2c04c04 None admin] RBAC: Authorizing `identity:get_project(project_id=03f099ce33cb4b4589e2c2928f290c9f)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:52.947768 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02d0ec0-f0fd-4d2c-9f5f-0c4fe2c04c04 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:52.949457 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 577/1152] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 28 00:46:52 2022] GET /identity/v3/projects/03f099ce33cb4b4589e2c2928f290c9f => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:52.955969 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e410ed7-532d-40a5-98e1-073840f9da12 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:53.057617 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:53.073531 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e410ed7-532d-40a5-98e1-073840f9da12 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:53.109127 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae51cb5-597e-44fa-a26a-9f312a49657f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:53.109792 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae51cb5-597e-44fa-a26a-9f312a49657f None admin] REQUEST_METHOD: `PUT` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:53.110070 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae51cb5-597e-44fa-a26a-9f312a49657f None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:53.110343 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae51cb5-597e-44fa-a26a-9f312a49657f None admin] PATH_INFO: `/v3/projects/03f099ce33cb4b4589e2c2928f290c9f/users/9b681f1ef59e4ec3ad64127dc2c70232/roles/2e4889bb71f9434392c0baba59f2534e` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:53.112424 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae51cb5-597e-44fa-a26a-9f312a49657f None admin] RBAC: Authorizing `identity:create_grant(project_id=03f099ce33cb4b4589e2c2928f290c9f, user_id=9b681f1ef59e4ec3ad64127dc2c70232, role_id=2e4889bb71f9434392c0baba59f2534e)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:53.113898 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae51cb5-597e-44fa-a26a-9f312a49657f None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:53.130279 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 576/1153] 10.222.0.49 () {58 vars in 1439 bytes} [Sun Aug 28 00:46:52 2022] PUT /identity/v3/projects/03f099ce33cb4b4589e2c2928f290c9f/users/9b681f1ef59e4ec3ad64127dc2c70232/roles/2e4889bb71f9434392c0baba59f2534e => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:46:55.019522 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ac0db-e6e6-49a1-8a3c-a88f84277d1c None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:55.020081 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ac0db-e6e6-49a1-8a3c-a88f84277d1c None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:55.020081 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ac0db-e6e6-49a1-8a3c-a88f84277d1c None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:55.021364 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 578/1154] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:46:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:55.026823 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59864f9f-7857-462b-9a27-869850d00f15 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:55.027253 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59864f9f-7857-462b-9a27-869850d00f15 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:55.027381 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59864f9f-7857-462b-9a27-869850d00f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:55.046549 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-59864f9f-7857-462b-9a27-869850d00f15 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:55.047763 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-59864f9f-7857-462b-9a27-869850d00f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:55.117566 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 577/1155] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:46:55.385694 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ac0db-e6e6-49a1-8a3c-a88f84277d1c None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:55.482084 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:55.497768 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ac0db-e6e6-49a1-8a3c-a88f84277d1c None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:55.533609 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c9ea50-10af-466b-bcc0-c98ebeba013b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:55.534249 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c9ea50-10af-466b-bcc0-c98ebeba013b None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:55.534524 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c9ea50-10af-466b-bcc0-c98ebeba013b None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:55.534813 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c9ea50-10af-466b-bcc0-c98ebeba013b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:55.546222 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c9ea50-10af-466b-bcc0-c98ebeba013b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:46:55.551031 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-75c9ea50-10af-466b-bcc0-c98ebeba013b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:46:55.551031 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:55.551031 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:55.551031 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:55.551031 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:55.551031 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:55.551031 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:55.551031 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:55.551031 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:55.551031 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:55.551031 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:55.551031 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:55.551031 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:46:55.551031 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:46:55.551031 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:46:55.551031 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:46:55.552186 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:46:55.552186 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:46:55.552186 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:46:55.552186 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:46:55.552186 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:55.552186 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:55.552186 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:55.552186 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:55.552186 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:55.552186 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:55.552186 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:55.552186 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:55.552186 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:55.552186 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:55.552186 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:55.552186 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:55.553635 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:55.553635 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:55.553635 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:55.553635 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:55.553635 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:46:55.553635 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:46:55.553635 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:46:55.553635 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:46:55.553635 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:46:55.553635 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:46:55.553635 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:46:55.553635 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:46:55.553635 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 579/1156] 10.222.0.49 () {56 vars in 1096 bytes} [Sun Aug 28 00:46:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:55.558742 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59864f9f-7857-462b-9a27-869850d00f15 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:55.636446 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:55.660379 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59864f9f-7857-462b-9a27-869850d00f15 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:55.695041 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f171a9df-4d0c-44a2-8c61-fecccc4790cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:55.695695 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171a9df-4d0c-44a2-8c61-fecccc4790cf None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:55.695990 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171a9df-4d0c-44a2-8c61-fecccc4790cf None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:55.696256 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f171a9df-4d0c-44a2-8c61-fecccc4790cf None admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:55.696918 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f171a9df-4d0c-44a2-8c61-fecccc4790cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:55.697213 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f171a9df-4d0c-44a2-8c61-fecccc4790cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:55.698574 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f171a9df-4d0c-44a2-8c61-fecccc4790cf None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:55.707255 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 578/1157] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 28 00:46:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:55.713313 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c9ea50-10af-466b-bcc0-c98ebeba013b None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:55.817516 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c9ea50-10af-466b-bcc0-c98ebeba013b None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:55.853964 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2297a41-2569-4f77-a8df-a1c9cef69a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:55.854585 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2297a41-2569-4f77-a8df-a1c9cef69a44 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:55.854861 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2297a41-2569-4f77-a8df-a1c9cef69a44 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:55.855129 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2297a41-2569-4f77-a8df-a1c9cef69a44 None admin] PATH_INFO: `/v3/users/9b681f1ef59e4ec3ad64127dc2c70232` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:55.856277 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2297a41-2569-4f77-a8df-a1c9cef69a44 None admin] RBAC: Authorizing `identity:get_user(user_id=9b681f1ef59e4ec3ad64127dc2c70232)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:55.857692 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2297a41-2569-4f77-a8df-a1c9cef69a44 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:55.859320 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 580/1158] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 28 00:46:55 2022] GET /identity/v3/users/9b681f1ef59e4ec3ad64127dc2c70232 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:55.865628 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f171a9df-4d0c-44a2-8c61-fecccc4790cf None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:55.972912 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f171a9df-4d0c-44a2-8c61-fecccc4790cf None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:56.011845 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591302a6-4889-46a0-96ad-faaf42184870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:56.012466 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591302a6-4889-46a0-96ad-faaf42184870 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:56.012744 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591302a6-4889-46a0-96ad-faaf42184870 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:56.012995 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591302a6-4889-46a0-96ad-faaf42184870 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:56.022078 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:56.086193 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591302a6-4889-46a0-96ad-faaf42184870 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:56.087710 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591302a6-4889-46a0-96ad-faaf42184870 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:56.192385 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 579/1159] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 28 00:46:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:46:56.199004 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2297a41-2569-4f77-a8df-a1c9cef69a44 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:56.218020 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:56.307415 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2297a41-2569-4f77-a8df-a1c9cef69a44 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:56.343404 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ac24b9-e0c9-4d41-8d27-a69abeec4f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:56.344060 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac24b9-e0c9-4d41-8d27-a69abeec4f15 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:56.344338 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac24b9-e0c9-4d41-8d27-a69abeec4f15 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:56.344605 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac24b9-e0c9-4d41-8d27-a69abeec4f15 None admin] PATH_INFO: `/v3/projects/03f099ce33cb4b4589e2c2928f290c9f` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:56.345752 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ac24b9-e0c9-4d41-8d27-a69abeec4f15 None admin] RBAC: Authorizing `identity:get_project(project_id=03f099ce33cb4b4589e2c2928f290c9f)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:56.347186 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ac24b9-e0c9-4d41-8d27-a69abeec4f15 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:56.348866 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 581/1160] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 28 00:46:56 2022] GET /identity/v3/projects/03f099ce33cb4b4589e2c2928f290c9f => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:56.355225 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591302a6-4889-46a0-96ad-faaf42184870 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:56.395654 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:56.460270 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591302a6-4889-46a0-96ad-faaf42184870 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:56.496354 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187ccf71-9fcd-4c2a-b109-69a7a0881d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:56.496960 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ccf71-9fcd-4c2a-b109-69a7a0881d86 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:56.497239 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ccf71-9fcd-4c2a-b109-69a7a0881d86 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:56.497512 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ccf71-9fcd-4c2a-b109-69a7a0881d86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:56.498242 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187ccf71-9fcd-4c2a-b109-69a7a0881d86 None admin] RBAC: Adding query filter params (role.id=2e4889bb71f9434392c0baba59f2534e, scope.project.id=03f099ce33cb4b4589e2c2928f290c9f, user.id=9b681f1ef59e4ec3ad64127dc2c70232) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:56.498550 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187ccf71-9fcd-4c2a-b109-69a7a0881d86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:56.500017 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187ccf71-9fcd-4c2a-b109-69a7a0881d86 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:56.506466 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 580/1161] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 28 00:46:56 2022] GET /identity/v3/role_assignments?user.id=9b681f1ef59e4ec3ad64127dc2c70232&scope.project.id=03f099ce33cb4b4589e2c2928f290c9f&role.id=2e4889bb71f9434392c0baba59f2534e => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:46:58.405396 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f59f9c-10be-449f-85d6-7cf69e7700cd None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:58.406117 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f59f9c-10be-449f-85d6-7cf69e7700cd None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:58.406117 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f59f9c-10be-449f-85d6-7cf69e7700cd None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:58.407277 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 582/1162] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:46:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:46:58.412688 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad7182-87c7-4de3-a6a7-54045f6ddbe0 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:58.413169 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad7182-87c7-4de3-a6a7-54045f6ddbe0 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:58.413273 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad7182-87c7-4de3-a6a7-54045f6ddbe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:58.432233 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-e7ad7182-87c7-4de3-a6a7-54045f6ddbe0 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:46:58.433432 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-e7ad7182-87c7-4de3-a6a7-54045f6ddbe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:46:58.503399 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 581/1163] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:46:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:46:58.762229 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f59f9c-10be-449f-85d6-7cf69e7700cd None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:58.860377 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:58.877850 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f59f9c-10be-449f-85d6-7cf69e7700cd None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:58.911494 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08a586d-e2a0-4da7-b164-52bbbadb0e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:58.912116 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a586d-e2a0-4da7-b164-52bbbadb0e5f None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:58.912390 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a586d-e2a0-4da7-b164-52bbbadb0e5f None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:58.912656 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a586d-e2a0-4da7-b164-52bbbadb0e5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:58.983364 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08a586d-e2a0-4da7-b164-52bbbadb0e5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:58.984775 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08a586d-e2a0-4da7-b164-52bbbadb0e5f None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:59.070199 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:59.088301 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 583/1164] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 28 00:46:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:46:59.094489 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad7182-87c7-4de3-a6a7-54045f6ddbe0 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:59.128657 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:46:59.209254 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad7182-87c7-4de3-a6a7-54045f6ddbe0 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:59.243743 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e1dc8e-d0e1-4042-8e81-dd1be5f724d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:59.244294 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1dc8e-d0e1-4042-8e81-dd1be5f724d8 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:59.244570 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1dc8e-d0e1-4042-8e81-dd1be5f724d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:59.244842 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1dc8e-d0e1-4042-8e81-dd1be5f724d8 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:59.252245 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e1dc8e-d0e1-4042-8e81-dd1be5f724d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:59.253726 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e1dc8e-d0e1-4042-8e81-dd1be5f724d8 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:59.265490 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-62e1dc8e-d0e1-4042-8e81-dd1be5f724d8 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 28 00:46:59.265490 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:59.265490 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 28 00:46:59.265490 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 28 00:46:59.265490 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:46:59.265490 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:46:59.265490 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:46:59.265490 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:46:59.265490 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 28 00:46:59.265490 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:46:59.265490 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:46:59.265490 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:46:59.265490 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:46:59.265490 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:46:59.265490 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:46:59.265490 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:46:59.265490 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:46:59.266821 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:46:59.266821 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:46:59.266821 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:46:59.266821 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:46:59.266821 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:46:59.266821 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:46:59.266821 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:46:59.266821 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:46:59.266821 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:46:59.266821 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:46:59.266821 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:46:59.266821 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:46:59.266821 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:46:59.266821 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:46:59.266821 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:46:59.266821 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:46:59.267791 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:46:59.267791 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:46:59.267791 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:46:59.267791 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:46:59.267791 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:46:59.267791 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:46:59.267791 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:46:59.267791 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:46:59.267791 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:46:59.267791 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:46:59.267791 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 28 00:46:59.267791 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:46:59.267791 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 28 00:46:59.267791 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:46:59.267791 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 582/1165] 10.222.0.49 () {56 vars in 1117 bytes} [Sun Aug 28 00:46:59 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:46:59.276536 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08a586d-e2a0-4da7-b164-52bbbadb0e5f None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:46:59.379318 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08a586d-e2a0-4da7-b164-52bbbadb0e5f None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:46:59.414897 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c4071-8705-4afe-824a-ba92ce217bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:46:59.416028 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c4071-8705-4afe-824a-ba92ce217bac None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:46:59.416028 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c4071-8705-4afe-824a-ba92ce217bac None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:46:59.416028 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c4071-8705-4afe-824a-ba92ce217bac None admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:46:59.416703 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892c4071-8705-4afe-824a-ba92ce217bac None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:46:59.417003 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892c4071-8705-4afe-824a-ba92ce217bac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:46:59.418382 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892c4071-8705-4afe-824a-ba92ce217bac None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:46:59.425896 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 584/1166] 10.222.0.49 () {56 vars in 1115 bytes} [Sun Aug 28 00:46:59 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:01.300647 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b784872b-0341-4fc2-903b-8c5e787f371a None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:01.301246 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b784872b-0341-4fc2-903b-8c5e787f371a None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:01.301246 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b784872b-0341-4fc2-903b-8c5e787f371a None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:01.302544 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 583/1167] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:47:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:47:01.308291 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a906d97-d20a-4d50-b839-91d5366a1fa3 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:01.308818 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a906d97-d20a-4d50-b839-91d5366a1fa3 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:01.308818 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a906d97-d20a-4d50-b839-91d5366a1fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:01.328623 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-2a906d97-d20a-4d50-b839-91d5366a1fa3 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:01.330171 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-2a906d97-d20a-4d50-b839-91d5366a1fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:01.378924 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:01.403152 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 585/1168] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:47:01.664206 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b784872b-0341-4fc2-903b-8c5e787f371a None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:01.766976 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:01.777605 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b784872b-0341-4fc2-903b-8c5e787f371a None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:01.813641 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee369952-6364-4ff6-abf8-53039195671f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:01.814260 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee369952-6364-4ff6-abf8-53039195671f None admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:01.814538 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee369952-6364-4ff6-abf8-53039195671f None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:01.814806 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee369952-6364-4ff6-abf8-53039195671f None admin] PATH_INFO: `/v3/domains` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:01.815492 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee369952-6364-4ff6-abf8-53039195671f None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:01.816894 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee369952-6364-4ff6-abf8-53039195671f None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:01.837154 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 584/1169] 10.222.0.49 () {60 vars in 1138 bytes} [Sun Aug 28 00:47:01 2022] POST /identity/v3/domains => generated 267 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:47:03.764600 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42adee6d-b24a-43f3-ab83-e369d811026f None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:03.765192 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42adee6d-b24a-43f3-ab83-e369d811026f None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:03.765192 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42adee6d-b24a-43f3-ab83-e369d811026f None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:03.766471 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 586/1170] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:47:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:47:03.771936 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb46f8-91ea-45f1-b8e9-4e550767476b None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:03.772403 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb46f8-91ea-45f1-b8e9-4e550767476b None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:03.772503 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb46f8-91ea-45f1-b8e9-4e550767476b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:03.791213 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-ceeb46f8-91ea-45f1-b8e9-4e550767476b None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:03.792433 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-ceeb46f8-91ea-45f1-b8e9-4e550767476b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:03.861367 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 585/1171] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:47:04.124568 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42adee6d-b24a-43f3-ab83-e369d811026f None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:04.254057 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42adee6d-b24a-43f3-ab83-e369d811026f None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:04.289774 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1018ce6c-fed3-4a93-871c-4d9d41e18dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:04.290402 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018ce6c-fed3-4a93-871c-4d9d41e18dcb None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:04.290683 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018ce6c-fed3-4a93-871c-4d9d41e18dcb None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:04.290958 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018ce6c-fed3-4a93-871c-4d9d41e18dcb None admin] PATH_INFO: `/v3/domains/2c367f844b2145a0ad54c34c73d10a13` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:04.302260 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1018ce6c-fed3-4a93-871c-4d9d41e18dcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=2c367f844b2145a0ad54c34c73d10a13)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:04.303755 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1018ce6c-fed3-4a93-871c-4d9d41e18dcb None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:04.305428 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 587/1172] 10.222.0.49 () {56 vars in 1183 bytes} [Sun Aug 28 00:47:04 2022] GET /identity/v3/domains/2c367f844b2145a0ad54c34c73d10a13 => generated 267 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:04.311581 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeb46f8-91ea-45f1-b8e9-4e550767476b None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:04.395074 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:04.413421 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeb46f8-91ea-45f1-b8e9-4e550767476b None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:04.447147 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678e3b18-515b-4251-8170-dd0b5814c1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:04.447759 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e3b18-515b-4251-8170-dd0b5814c1be None admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:04.448035 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e3b18-515b-4251-8170-dd0b5814c1be None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:04.448329 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e3b18-515b-4251-8170-dd0b5814c1be None admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:04.448979 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678e3b18-515b-4251-8170-dd0b5814c1be None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:04.450402 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678e3b18-515b-4251-8170-dd0b5814c1be None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:04.479165 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 586/1173] 10.222.0.49 () {60 vars in 1141 bytes} [Sun Aug 28 00:47:04 2022] POST /identity/v3/projects => generated 361 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:47:06.417665 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49876779-cad0-4fa7-96be-c0c621930fac None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:06.418252 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49876779-cad0-4fa7-96be-c0c621930fac None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:06.418252 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49876779-cad0-4fa7-96be-c0c621930fac None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:06.419584 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 588/1174] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:47:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:47:06.425816 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a45ec-b10b-4532-a727-c0b140dc9c5b None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:06.426384 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a45ec-b10b-4532-a727-c0b140dc9c5b None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:06.426384 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a45ec-b10b-4532-a727-c0b140dc9c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:06.446169 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-a48a45ec-b10b-4532-a727-c0b140dc9c5b None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:06.447380 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-a48a45ec-b10b-4532-a727-c0b140dc9c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:06.525490 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 587/1175] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:47:06.793481 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49876779-cad0-4fa7-96be-c0c621930fac None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:06.838431 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:06.902455 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49876779-cad0-4fa7-96be-c0c621930fac None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:06.939789 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7846100-f026-4803-97cc-8be084a1feb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:06.940411 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7846100-f026-4803-97cc-8be084a1feb0 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:06.940682 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7846100-f026-4803-97cc-8be084a1feb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:06.940948 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7846100-f026-4803-97cc-8be084a1feb0 None admin] PATH_INFO: `/v3/domains/2c367f844b2145a0ad54c34c73d10a13` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:06.942095 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7846100-f026-4803-97cc-8be084a1feb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=2c367f844b2145a0ad54c34c73d10a13)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:06.943533 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7846100-f026-4803-97cc-8be084a1feb0 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:06.945214 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 589/1176] 10.222.0.49 () {56 vars in 1183 bytes} [Sun Aug 28 00:47:06 2022] GET /identity/v3/domains/2c367f844b2145a0ad54c34c73d10a13 => generated 267 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:06.951308 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a45ec-b10b-4532-a727-c0b140dc9c5b None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:07.014908 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:07.054786 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a45ec-b10b-4532-a727-c0b140dc9c5b None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:07.091292 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbcddbd-a1c5-4411-a9b5-03c611287a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:07.091925 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbcddbd-a1c5-4411-a9b5-03c611287a08 None admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:07.092200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbcddbd-a1c5-4411-a9b5-03c611287a08 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:07.092464 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbcddbd-a1c5-4411-a9b5-03c611287a08 None admin] PATH_INFO: `/v3/users` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:07.093113 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbcddbd-a1c5-4411-a9b5-03c611287a08 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:07.094547 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbcddbd-a1c5-4411-a9b5-03c611287a08 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:07.117289 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 588/1177] 10.222.0.49 () {60 vars in 1132 bytes} [Sun Aug 28 00:47:06 2022] POST /identity/v3/users => generated 311 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:47:09.076733 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e8c91-331d-4434-b21c-6800ec08ac0d None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:09.077282 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e8c91-331d-4434-b21c-6800ec08ac0d None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:09.077282 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390e8c91-331d-4434-b21c-6800ec08ac0d None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:09.078515 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 590/1178] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:47:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:47:09.084544 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d8973-7039-4b76-aa92-6ef6b957da26 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:09.085058 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d8973-7039-4b76-aa92-6ef6b957da26 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:09.085058 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d8973-7039-4b76-aa92-6ef6b957da26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:09.104634 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-d87d8973-7039-4b76-aa92-6ef6b957da26 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:09.105835 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-d87d8973-7039-4b76-aa92-6ef6b957da26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:09.178334 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 589/1179] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:47:09.442211 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390e8c91-331d-4434-b21c-6800ec08ac0d None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:09.550273 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390e8c91-331d-4434-b21c-6800ec08ac0d None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:09.558232 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:09.587700 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad2dd5d-1e60-455e-be1a-3053507c9db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:09.588414 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad2dd5d-1e60-455e-be1a-3053507c9db2 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:09.588732 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad2dd5d-1e60-455e-be1a-3053507c9db2 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:09.589049 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad2dd5d-1e60-455e-be1a-3053507c9db2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:09.600455 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad2dd5d-1e60-455e-be1a-3053507c9db2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:47:09.605320 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-6ad2dd5d-1e60-455e-be1a-3053507c9db2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:47:09.605320 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:09.605320 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:09.605320 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:09.605320 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:09.605320 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:09.605320 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:09.605320 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:09.605320 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:09.605320 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:09.605320 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:09.605320 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:09.605320 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:47:09.605320 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:47:09.605320 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:47:09.605320 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:47:09.606493 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:47:09.606493 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:47:09.606493 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:47:09.606493 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:47:09.606493 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:09.606493 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:09.606493 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:09.606493 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:09.606493 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:09.606493 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:09.606493 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:09.606493 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:09.606493 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:09.606493 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:09.606493 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:09.606493 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:09.607352 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:09.607352 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:09.607352 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:09.607352 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:09.607352 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:47:09.607352 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:47:09.607352 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:47:09.607352 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:47:09.607352 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:47:09.607352 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:47:09.607352 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:47:09.607352 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:47:09.607352 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 591/1180] 10.222.0.49 () {56 vars in 1096 bytes} [Sun Aug 28 00:47:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:09.612719 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87d8973-7039-4b76-aa92-6ef6b957da26 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:09.663364 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:09.716513 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87d8973-7039-4b76-aa92-6ef6b957da26 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:09.751543 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308299e2-304e-4c93-af3e-98007e88d45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:09.752190 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308299e2-304e-4c93-af3e-98007e88d45d None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:09.752469 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308299e2-304e-4c93-af3e-98007e88d45d None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:09.752739 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308299e2-304e-4c93-af3e-98007e88d45d None admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:09.753409 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308299e2-304e-4c93-af3e-98007e88d45d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:09.753716 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308299e2-304e-4c93-af3e-98007e88d45d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:09.755087 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308299e2-304e-4c93-af3e-98007e88d45d None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:09.763838 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 590/1181] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 28 00:47:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:09.769827 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad2dd5d-1e60-455e-be1a-3053507c9db2 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:09.885945 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad2dd5d-1e60-455e-be1a-3053507c9db2 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:09.920707 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f337f9a6-461a-428b-820f-f1fdc3cb187f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:09.921336 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337f9a6-461a-428b-820f-f1fdc3cb187f None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:09.921610 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337f9a6-461a-428b-820f-f1fdc3cb187f None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:09.921880 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337f9a6-461a-428b-820f-f1fdc3cb187f None admin] PATH_INFO: `/v3/users/9d7606c0be7f4612a62e0064eee709fd` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:09.936155 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f337f9a6-461a-428b-820f-f1fdc3cb187f None admin] RBAC: Authorizing `identity:get_user(user_id=9d7606c0be7f4612a62e0064eee709fd)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:09.937615 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f337f9a6-461a-428b-820f-f1fdc3cb187f None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:09.939299 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 592/1182] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 28 00:47:09 2022] GET /identity/v3/users/9d7606c0be7f4612a62e0064eee709fd => generated 311 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:09.946265 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308299e2-304e-4c93-af3e-98007e88d45d None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:10.053494 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308299e2-304e-4c93-af3e-98007e88d45d None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:10.067018 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:10.090891 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8b8774-033f-48f0-8762-4a643bb6aabc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:10.091595 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b8774-033f-48f0-8762-4a643bb6aabc None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:10.091806 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b8774-033f-48f0-8762-4a643bb6aabc None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:10.092101 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b8774-033f-48f0-8762-4a643bb6aabc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:10.167015 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8b8774-033f-48f0-8762-4a643bb6aabc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:10.168502 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8b8774-033f-48f0-8762-4a643bb6aabc None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:10.274247 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 591/1183] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 28 00:47:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:47:10.280661 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f337f9a6-461a-428b-820f-f1fdc3cb187f None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:10.308477 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:10.385956 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f337f9a6-461a-428b-820f-f1fdc3cb187f None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:10.423359 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72e81bf-d2a9-4899-ab31-7d0140765b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:10.424054 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e81bf-d2a9-4899-ab31-7d0140765b41 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:10.424328 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e81bf-d2a9-4899-ab31-7d0140765b41 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:10.424599 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e81bf-d2a9-4899-ab31-7d0140765b41 None admin] PATH_INFO: `/v3/projects/baf39bf29da5468391c4801b8a250a1b` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:10.425916 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72e81bf-d2a9-4899-ab31-7d0140765b41 None admin] RBAC: Authorizing `identity:get_project(project_id=baf39bf29da5468391c4801b8a250a1b)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:10.427385 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72e81bf-d2a9-4899-ab31-7d0140765b41 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:10.429137 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 593/1184] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 28 00:47:10 2022] GET /identity/v3/projects/baf39bf29da5468391c4801b8a250a1b => generated 361 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:10.435585 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8b8774-033f-48f0-8762-4a643bb6aabc None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:10.449725 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:10.538941 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8b8774-033f-48f0-8762-4a643bb6aabc None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:10.574507 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11081cb-2549-4ebe-a4c4-948de6f2254b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:10.575030 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11081cb-2549-4ebe-a4c4-948de6f2254b None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:10.575302 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11081cb-2549-4ebe-a4c4-948de6f2254b None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:10.575571 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11081cb-2549-4ebe-a4c4-948de6f2254b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:10.576374 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11081cb-2549-4ebe-a4c4-948de6f2254b None admin] RBAC: Adding query filter params (role.id=2e4889bb71f9434392c0baba59f2534e, scope.project.id=baf39bf29da5468391c4801b8a250a1b, user.id=9d7606c0be7f4612a62e0064eee709fd) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:10.576682 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11081cb-2549-4ebe-a4c4-948de6f2254b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:10.578122 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11081cb-2549-4ebe-a4c4-948de6f2254b None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:10.583979 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 592/1185] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 28 00:47:10 2022] GET /identity/v3/role_assignments?user.id=9d7606c0be7f4612a62e0064eee709fd&scope.project.id=baf39bf29da5468391c4801b8a250a1b&role.id=2e4889bb71f9434392c0baba59f2534e => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:12.464371 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4b951-d021-4540-996a-7db2a596440b None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:12.464955 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4b951-d021-4540-996a-7db2a596440b None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:12.464955 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4b951-d021-4540-996a-7db2a596440b None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:12.466200 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 594/1186] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:47:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:47:12.472121 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a54e8f-f6ea-452d-ac3f-2894490df98d None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:12.472575 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a54e8f-f6ea-452d-ac3f-2894490df98d None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:12.472663 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a54e8f-f6ea-452d-ac3f-2894490df98d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:12.491925 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-83a54e8f-f6ea-452d-ac3f-2894490df98d None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:12.493122 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-83a54e8f-f6ea-452d-ac3f-2894490df98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:12.560550 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 593/1187] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:47:12.823932 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db4b951-d021-4540-996a-7db2a596440b None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:12.923345 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:12.934060 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db4b951-d021-4540-996a-7db2a596440b None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:12.971909 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791368ed-e383-4692-9262-fbed23fe9d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:12.972569 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791368ed-e383-4692-9262-fbed23fe9d3c None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:12.972840 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791368ed-e383-4692-9262-fbed23fe9d3c None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:12.973112 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791368ed-e383-4692-9262-fbed23fe9d3c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:12.983767 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791368ed-e383-4692-9262-fbed23fe9d3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:47:12.988549 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-791368ed-e383-4692-9262-fbed23fe9d3c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:47:12.988549 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:12.988549 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:12.988549 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:12.988549 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:12.988549 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:12.988549 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:12.988549 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:12.988549 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:12.988549 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:12.988549 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:12.988549 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:12.988549 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:47:12.988549 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:47:12.988549 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:47:12.988549 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:47:12.989499 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:47:12.989499 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:47:12.989499 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:47:12.989499 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:47:12.989499 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:12.989499 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:12.989499 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:12.989499 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:12.989499 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:12.989499 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:12.989499 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:12.989499 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:12.989499 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:12.989499 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:12.989499 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:12.989499 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:12.990586 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:12.990586 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:12.990586 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:12.990586 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:12.990586 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:47:12.990586 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:47:12.990586 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:47:12.990586 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:47:12.990586 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:47:12.990586 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:47:12.990586 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:47:12.990586 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:47:12.990586 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 595/1188] 10.222.0.49 () {56 vars in 1096 bytes} [Sun Aug 28 00:47:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:12.995952 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a54e8f-f6ea-452d-ac3f-2894490df98d None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:13.004362 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:13.111939 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a54e8f-f6ea-452d-ac3f-2894490df98d None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:13.149873 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c6bc5f-ef8b-49c5-8303-d3c06acd84b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:13.150524 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c6bc5f-ef8b-49c5-8303-d3c06acd84b7 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:13.150798 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c6bc5f-ef8b-49c5-8303-d3c06acd84b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:13.151084 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c6bc5f-ef8b-49c5-8303-d3c06acd84b7 None admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:13.151916 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c6bc5f-ef8b-49c5-8303-d3c06acd84b7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:13.152217 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c6bc5f-ef8b-49c5-8303-d3c06acd84b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:13.153639 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c6bc5f-ef8b-49c5-8303-d3c06acd84b7 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:13.162577 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 594/1189] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 28 00:47:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:13.168964 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791368ed-e383-4692-9262-fbed23fe9d3c None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:13.274011 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791368ed-e383-4692-9262-fbed23fe9d3c None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:13.309423 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a055f9a4-ea1a-41e3-8910-d3841f4db8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:13.310053 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055f9a4-ea1a-41e3-8910-d3841f4db8c9 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:13.310330 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055f9a4-ea1a-41e3-8910-d3841f4db8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:13.310598 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055f9a4-ea1a-41e3-8910-d3841f4db8c9 None admin] PATH_INFO: `/v3/users/9d7606c0be7f4612a62e0064eee709fd` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:13.311797 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a055f9a4-ea1a-41e3-8910-d3841f4db8c9 None admin] RBAC: Authorizing `identity:get_user(user_id=9d7606c0be7f4612a62e0064eee709fd)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:13.313244 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a055f9a4-ea1a-41e3-8910-d3841f4db8c9 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:13.314833 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 596/1190] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 28 00:47:13 2022] GET /identity/v3/users/9d7606c0be7f4612a62e0064eee709fd => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:13.320950 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c6bc5f-ef8b-49c5-8303-d3c06acd84b7 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:13.393067 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:13.430204 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c6bc5f-ef8b-49c5-8303-d3c06acd84b7 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:13.465765 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26efbff8-ab2d-4aa4-a131-8767234e3929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:13.466392 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26efbff8-ab2d-4aa4-a131-8767234e3929 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:13.466698 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26efbff8-ab2d-4aa4-a131-8767234e3929 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:13.466972 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26efbff8-ab2d-4aa4-a131-8767234e3929 None admin] PATH_INFO: `/v3/projects/baf39bf29da5468391c4801b8a250a1b` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:13.468148 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26efbff8-ab2d-4aa4-a131-8767234e3929 None admin] RBAC: Authorizing `identity:get_project(project_id=baf39bf29da5468391c4801b8a250a1b)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:13.469598 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26efbff8-ab2d-4aa4-a131-8767234e3929 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:13.471234 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 595/1191] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 28 00:47:13 2022] GET /identity/v3/projects/baf39bf29da5468391c4801b8a250a1b => generated 361 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:13.477550 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a055f9a4-ea1a-41e3-8910-d3841f4db8c9 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:13.501346 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:13.580750 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a055f9a4-ea1a-41e3-8910-d3841f4db8c9 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:13.617337 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e89df93-2bd4-41df-ae29-e79358216786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:13.618007 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89df93-2bd4-41df-ae29-e79358216786 None admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:13.618285 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89df93-2bd4-41df-ae29-e79358216786 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:13.618554 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89df93-2bd4-41df-ae29-e79358216786 None admin] PATH_INFO: `/v3/projects/baf39bf29da5468391c4801b8a250a1b/users/9d7606c0be7f4612a62e0064eee709fd/roles/2e4889bb71f9434392c0baba59f2534e` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:13.620522 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e89df93-2bd4-41df-ae29-e79358216786 None admin] RBAC: Authorizing `identity:create_grant(project_id=baf39bf29da5468391c4801b8a250a1b, user_id=9d7606c0be7f4612a62e0064eee709fd, role_id=2e4889bb71f9434392c0baba59f2534e)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:13.621976 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e89df93-2bd4-41df-ae29-e79358216786 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:13.636208 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 597/1192] 10.222.0.49 () {58 vars in 1439 bytes} [Sun Aug 28 00:47:13 2022] PUT /identity/v3/projects/baf39bf29da5468391c4801b8a250a1b/users/9d7606c0be7f4612a62e0064eee709fd/roles/2e4889bb71f9434392c0baba59f2534e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:47:15.511527 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9beb752-3731-473f-a871-7d3441117b69 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:15.512164 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9beb752-3731-473f-a871-7d3441117b69 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:15.512164 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9beb752-3731-473f-a871-7d3441117b69 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:15.513427 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 596/1193] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:47:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:47:15.518873 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84bace5-edd1-482f-b224-b4aee34f8e1f None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:15.519350 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84bace5-edd1-482f-b224-b4aee34f8e1f None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:15.519440 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84bace5-edd1-482f-b224-b4aee34f8e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:15.539022 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-f84bace5-edd1-482f-b224-b4aee34f8e1f None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:47:15.540442 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-f84bace5-edd1-482f-b224-b4aee34f8e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:47:15.611837 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 598/1194] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:47:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:47:15.872987 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9beb752-3731-473f-a871-7d3441117b69 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:15.976381 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9beb752-3731-473f-a871-7d3441117b69 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:16.011378 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6464216f-244e-4f98-a27f-d87b32868c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:16.012029 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464216f-244e-4f98-a27f-d87b32868c45 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:16.012297 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464216f-244e-4f98-a27f-d87b32868c45 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:16.012559 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6464216f-244e-4f98-a27f-d87b32868c45 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:16.015385 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:16.023938 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6464216f-244e-4f98-a27f-d87b32868c45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:47:16.028640 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-6464216f-244e-4f98-a27f-d87b32868c45 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:47:16.028640 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:47:16.028640 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:47:16.028640 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:47:16.028640 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:47:16.028640 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:47:16.028640 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:47:16.028640 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:47:16.028640 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:47:16.028640 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:47:16.028640 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:47:16.028640 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:47:16.028640 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:47:16.028640 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:47:16.028640 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:47:16.028640 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:47:16.029720 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:47:16.029720 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:47:16.029720 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:47:16.029720 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:47:16.029720 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:47:16.029720 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:47:16.029720 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:47:16.029720 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:47:16.029720 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:47:16.029720 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:47:16.029720 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:47:16.029720 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:47:16.029720 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:47:16.029720 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:47:16.029720 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:47:16.029720 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:47:16.030638 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:47:16.030638 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:47:16.030638 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:47:16.030638 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:47:16.030638 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:47:16.030638 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:47:16.030638 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:47:16.030638 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:47:16.030638 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:47:16.030638 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:47:16.030638 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:47:16.030638 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:47:16.030638 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 597/1195] 10.222.0.49 () {56 vars in 1096 bytes} [Sun Aug 28 00:47:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:47:16.035946 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84bace5-edd1-482f-b224-b4aee34f8e1f None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:16.048153 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:16.138157 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84bace5-edd1-482f-b224-b4aee34f8e1f None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:16.172559 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223023fe-26bf-46fc-9819-2d68ce0188dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:16.173139 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223023fe-26bf-46fc-9819-2d68ce0188dc None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:16.173440 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223023fe-26bf-46fc-9819-2d68ce0188dc None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:16.173700 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223023fe-26bf-46fc-9819-2d68ce0188dc None admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:16.174363 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223023fe-26bf-46fc-9819-2d68ce0188dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:16.174681 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223023fe-26bf-46fc-9819-2d68ce0188dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:16.176072 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223023fe-26bf-46fc-9819-2d68ce0188dc None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:16.184224 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 599/1196] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 28 00:47:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:16.190238 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6464216f-244e-4f98-a27f-d87b32868c45 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:16.293815 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6464216f-244e-4f98-a27f-d87b32868c45 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:16.331920 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab663b06-58cc-4c19-8eb8-5cb6f4f1faf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:16.332566 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab663b06-58cc-4c19-8eb8-5cb6f4f1faf7 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:16.332843 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab663b06-58cc-4c19-8eb8-5cb6f4f1faf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:16.333115 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab663b06-58cc-4c19-8eb8-5cb6f4f1faf7 None admin] PATH_INFO: `/v3/users/9d7606c0be7f4612a62e0064eee709fd` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:16.334348 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab663b06-58cc-4c19-8eb8-5cb6f4f1faf7 None admin] RBAC: Authorizing `identity:get_user(user_id=9d7606c0be7f4612a62e0064eee709fd)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:16.335961 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab663b06-58cc-4c19-8eb8-5cb6f4f1faf7 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:16.337731 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 598/1197] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 28 00:47:16 2022] GET /identity/v3/users/9d7606c0be7f4612a62e0064eee709fd => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:16.350904 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223023fe-26bf-46fc-9819-2d68ce0188dc None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:16.423244 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:16.454006 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223023fe-26bf-46fc-9819-2d68ce0188dc None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:16.490391 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a590e1a6-6933-4219-a3a5-5d46510be6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:16.490995 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590e1a6-6933-4219-a3a5-5d46510be6f4 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:16.491269 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590e1a6-6933-4219-a3a5-5d46510be6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:16.491627 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590e1a6-6933-4219-a3a5-5d46510be6f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:16.557948 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a590e1a6-6933-4219-a3a5-5d46510be6f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:16.559339 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a590e1a6-6933-4219-a3a5-5d46510be6f4 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:16.632765 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:16.664649 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 600/1198] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 28 00:47:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:47:16.670943 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab663b06-58cc-4c19-8eb8-5cb6f4f1faf7 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:16.738212 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:16.776543 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab663b06-58cc-4c19-8eb8-5cb6f4f1faf7 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:16.812012 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9bfb03-b772-4a61-b1ba-3b134a53afd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:16.812654 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9bfb03-b772-4a61-b1ba-3b134a53afd2 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:16.812927 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9bfb03-b772-4a61-b1ba-3b134a53afd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:16.813192 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9bfb03-b772-4a61-b1ba-3b134a53afd2 None admin] PATH_INFO: `/v3/projects/baf39bf29da5468391c4801b8a250a1b` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:16.814460 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9bfb03-b772-4a61-b1ba-3b134a53afd2 None admin] RBAC: Authorizing `identity:get_project(project_id=baf39bf29da5468391c4801b8a250a1b)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:16.815927 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9bfb03-b772-4a61-b1ba-3b134a53afd2 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:16.817581 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 599/1199] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 28 00:47:16 2022] GET /identity/v3/projects/baf39bf29da5468391c4801b8a250a1b => generated 361 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:47:16.824300 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a590e1a6-6933-4219-a3a5-5d46510be6f4 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:47:16.928587 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a590e1a6-6933-4219-a3a5-5d46510be6f4 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:47:16.965485 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4a1229-0ce0-4239-a938-537bd64d773c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:47:16.966086 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a1229-0ce0-4239-a938-537bd64d773c None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:47:16.966363 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a1229-0ce0-4239-a938-537bd64d773c None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:47:16.966638 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a1229-0ce0-4239-a938-537bd64d773c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:47:16.967365 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4a1229-0ce0-4239-a938-537bd64d773c None admin] RBAC: Adding query filter params (role.id=2e4889bb71f9434392c0baba59f2534e, scope.project.id=baf39bf29da5468391c4801b8a250a1b, user.id=9d7606c0be7f4612a62e0064eee709fd) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:47:16.967713 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4a1229-0ce0-4239-a938-537bd64d773c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:47:16.969142 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4a1229-0ce0-4239-a938-537bd64d773c None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:47:16.975180 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 601/1200] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 28 00:47:16 2022] GET /identity/v3/role_assignments?user.id=9d7606c0be7f4612a62e0064eee709fd&scope.project.id=baf39bf29da5468391c4801b8a250a1b&role.id=2e4889bb71f9434392c0baba59f2534e => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:47:26.806893 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=34 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:47:26.972728 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=82 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:13.920250 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0bc104-c1e2-4f94-b54e-35a2e9e7590d None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:13.920844 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0bc104-c1e2-4f94-b54e-35a2e9e7590d None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:13.921412 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0bc104-c1e2-4f94-b54e-35a2e9e7590d None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:13.924328 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 600/1201] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:48:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:48:13.930341 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b070c4-2ff0-4953-b886-446ea56f1189 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:13.930880 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b070c4-2ff0-4953-b886-446ea56f1189 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:13.930880 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b070c4-2ff0-4953-b886-446ea56f1189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:13.960637 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-74b070c4-2ff0-4953-b886-446ea56f1189 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:48:13.961870 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-74b070c4-2ff0-4953-b886-446ea56f1189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:14.076531 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 602/1202] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:48:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:48:14.383812 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0bc104-c1e2-4f94-b54e-35a2e9e7590d None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:14.577145 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0bc104-c1e2-4f94-b54e-35a2e9e7590d None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:14.628709 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c666fb-e887-454f-8cfe-6c100d82d262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:14.629738 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c666fb-e887-454f-8cfe-6c100d82d262 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:14.630256 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c666fb-e887-454f-8cfe-6c100d82d262 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:14.630717 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c666fb-e887-454f-8cfe-6c100d82d262 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:14.650960 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c666fb-e887-454f-8cfe-6c100d82d262 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:14.653567 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c666fb-e887-454f-8cfe-6c100d82d262 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:14.681371 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-93c666fb-e887-454f-8cfe-6c100d82d262 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:48:14.681371 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:48:14.681371 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:48:14.681371 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:48:14.681371 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:48:14.681371 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:48:14.681371 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:48:14.681371 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:48:14.681371 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:48:14.681371 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:48:14.681371 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:48:14.681371 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:48:14.681371 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:48:14.681371 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:48:14.681371 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:48:14.681371 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:48:14.682535 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:48:14.682535 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:48:14.682535 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:48:14.682535 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:48:14.682535 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:48:14.682535 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:48:14.682535 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:48:14.682535 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:48:14.682535 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:48:14.682535 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:48:14.682535 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:48:14.682535 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:48:14.682535 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:48:14.682535 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:48:14.682535 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:48:14.682535 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:48:14.682535 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:48:14.683547 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:48:14.683547 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:48:14.683547 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:48:14.683779 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 601/1203] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:48:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:48:14.693682 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b070c4-2ff0-4953-b886-446ea56f1189 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:14.923192 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b070c4-2ff0-4953-b886-446ea56f1189 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:14.975993 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:14.985396 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c23987-8a7c-47f7-a27c-f8338a99e7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:14.986508 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c23987-8a7c-47f7-a27c-f8338a99e7cf None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:14.987007 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c23987-8a7c-47f7-a27c-f8338a99e7cf None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:14.987491 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c23987-8a7c-47f7-a27c-f8338a99e7cf None admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:14.988951 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c23987-8a7c-47f7-a27c-f8338a99e7cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:48:14.989656 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c23987-8a7c-47f7-a27c-f8338a99e7cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:14.991538 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c23987-8a7c-47f7-a27c-f8338a99e7cf None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:15.009557 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 603/1204] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:48:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:48:15.018607 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c666fb-e887-454f-8cfe-6c100d82d262 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:15.128579 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:15.232124 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c666fb-e887-454f-8cfe-6c100d82d262 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:15.295146 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f63988-6b5f-4c82-84a3-86c58b47a4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:15.297297 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f63988-6b5f-4c82-84a3-86c58b47a4e5 None admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:15.298133 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f63988-6b5f-4c82-84a3-86c58b47a4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:15.298854 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f63988-6b5f-4c82-84a3-86c58b47a4e5 None admin] PATH_INFO: `/v3/users` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:15.300564 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f63988-6b5f-4c82-84a3-86c58b47a4e5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:15.304233 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f63988-6b5f-4c82-84a3-86c58b47a4e5 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:15.344784 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 602/1205] 10.222.0.49 () {60 vars in 1132 bytes} [Sun Aug 28 00:48:15 2022] POST /identity/v3/users => generated 251 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:48:17.755777 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c2434-4de0-46bd-80dd-acedf7d904b5 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:17.756308 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c2434-4de0-46bd-80dd-acedf7d904b5 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:17.756701 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c2434-4de0-46bd-80dd-acedf7d904b5 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:17.759286 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 604/1206] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:48:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:48:17.768400 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f7db84-4db6-4373-8e56-a53fdd6a5558 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:17.768924 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f7db84-4db6-4373-8e56-a53fdd6a5558 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:17.769422 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f7db84-4db6-4373-8e56-a53fdd6a5558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:17.796571 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-a9f7db84-4db6-4373-8e56-a53fdd6a5558 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:48:17.797856 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-a9f7db84-4db6-4373-8e56-a53fdd6a5558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:17.915374 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 603/1207] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:48:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:48:18.262474 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c2434-4de0-46bd-80dd-acedf7d904b5 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:18.446900 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c2434-4de0-46bd-80dd-acedf7d904b5 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:18.492024 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631f5279-708d-4273-8e4a-ad092b54bf9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:18.492763 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f5279-708d-4273-8e4a-ad092b54bf9a None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:18.499698 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f5279-708d-4273-8e4a-ad092b54bf9a None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:18.499698 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f5279-708d-4273-8e4a-ad092b54bf9a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:18.508406 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631f5279-708d-4273-8e4a-ad092b54bf9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:48:18.516091 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-631f5279-708d-4273-8e4a-ad092b54bf9a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:48:18.516091 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:48:18.516091 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:48:18.516091 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:48:18.516091 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:48:18.516091 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:48:18.516091 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:48:18.516091 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:48:18.516091 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:48:18.516091 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:48:18.516091 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:48:18.516091 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:48:18.516091 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:48:18.516091 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:48:18.516091 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:48:18.516091 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:48:18.518636 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:48:18.518636 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:48:18.518636 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:48:18.518636 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:48:18.518636 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:48:18.518636 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:48:18.518636 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:48:18.518636 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:48:18.518636 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:48:18.518636 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:48:18.518636 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:48:18.518636 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:48:18.518636 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:48:18.518636 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:48:18.518636 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:48:18.518636 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:48:18.520733 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:48:18.520733 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:48:18.520733 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:48:18.520733 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:48:18.520733 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:48:18.520733 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:48:18.520733 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:48:18.520733 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:48:18.520733 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:48:18.520733 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:48:18.520733 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:48:18.520733 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:48:18.523716 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 605/1208] 10.222.0.49 () {56 vars in 1102 bytes} [Sun Aug 28 00:48:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:48:18.523963 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f7db84-4db6-4373-8e56-a53fdd6a5558 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:18.583230 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:18.729976 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f7db84-4db6-4373-8e56-a53fdd6a5558 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:18.812919 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a334e-fdcf-4c75-8b59-7bd347edd4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:18.812919 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a334e-fdcf-4c75-8b59-7bd347edd4fe None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:18.812919 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a334e-fdcf-4c75-8b59-7bd347edd4fe None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:18.812919 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a334e-fdcf-4c75-8b59-7bd347edd4fe None admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:18.813839 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663a334e-fdcf-4c75-8b59-7bd347edd4fe None admin] RBAC: Adding query filter params (name=service) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:48:18.813839 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663a334e-fdcf-4c75-8b59-7bd347edd4fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:18.814215 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663a334e-fdcf-4c75-8b59-7bd347edd4fe None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:18.835734 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 604/1209] 10.222.0.49 () {56 vars in 1103 bytes} [Sun Aug 28 00:48:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:48:18.837913 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631f5279-708d-4273-8e4a-ad092b54bf9a None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:18.903711 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:18.969304 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631f5279-708d-4273-8e4a-ad092b54bf9a None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:19.017941 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4424ca62-72b4-496e-9d8c-5832dfce9882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:19.020134 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424ca62-72b4-496e-9d8c-5832dfce9882 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:19.020134 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424ca62-72b4-496e-9d8c-5832dfce9882 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:19.020134 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424ca62-72b4-496e-9d8c-5832dfce9882 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:19.041212 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4424ca62-72b4-496e-9d8c-5832dfce9882 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:19.044606 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4424ca62-72b4-496e-9d8c-5832dfce9882 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:19.080724 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-4424ca62-72b4-496e-9d8c-5832dfce9882 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:48:19.080724 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:48:19.080724 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:48:19.080724 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:48:19.080724 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:48:19.080724 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:48:19.080724 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:48:19.080724 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:48:19.080724 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:48:19.080724 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:48:19.080724 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:48:19.080724 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:48:19.080724 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:48:19.080724 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:48:19.080724 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:48:19.080724 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:48:19.082800 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:48:19.082800 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:48:19.082800 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:48:19.082800 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:48:19.082800 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:48:19.082800 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:48:19.082800 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:48:19.082800 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:48:19.082800 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:48:19.082800 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:48:19.082800 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:48:19.082800 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:48:19.082800 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:48:19.082800 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:48:19.082800 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:48:19.082800 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:48:19.082800 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:48:19.084751 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:48:19.084751 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:48:19.084751 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:48:19.091705 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 606/1210] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:48:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:48:19.092356 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a334e-fdcf-4c75-8b59-7bd347edd4fe None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:19.328324 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:19.337464 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a334e-fdcf-4c75-8b59-7bd347edd4fe None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:19.398446 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c458b3-2f37-4d45-8437-c796561c9783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:19.399415 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c458b3-2f37-4d45-8437-c796561c9783 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:19.399905 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c458b3-2f37-4d45-8437-c796561c9783 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:19.400365 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c458b3-2f37-4d45-8437-c796561c9783 None admin] PATH_INFO: `/v3/domains` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:19.401191 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c458b3-2f37-4d45-8437-c796561c9783 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:48:19.401646 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c458b3-2f37-4d45-8437-c796561c9783 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:19.403338 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c458b3-2f37-4d45-8437-c796561c9783 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:19.422801 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 605/1211] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:48:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:48:19.424161 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4424ca62-72b4-496e-9d8c-5832dfce9882 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:19.630423 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4424ca62-72b4-496e-9d8c-5832dfce9882 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:19.630423 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:19.691177 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e432a4-5d09-48f6-82a3-f31946991364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:19.692784 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e432a4-5d09-48f6-82a3-f31946991364 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:19.693525 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e432a4-5d09-48f6-82a3-f31946991364 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:19.694207 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e432a4-5d09-48f6-82a3-f31946991364 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:19.709395 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e432a4-5d09-48f6-82a3-f31946991364 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:19.711005 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e432a4-5d09-48f6-82a3-f31946991364 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:19.739498 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-e2e432a4-5d09-48f6-82a3-f31946991364 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 28 00:48:19.739498 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:48:19.739498 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:48:19.739498 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:48:19.739498 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:48:19.739498 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:48:19.739498 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:48:19.739498 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:48:19.739498 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:48:19.739498 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:48:19.739498 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:48:19.739498 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:48:19.739498 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:48:19.739498 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:48:19.739498 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:48:19.739498 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:48:19.740712 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:48:19.740712 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:48:19.740712 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:48:19.740712 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:48:19.740712 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:48:19.740712 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:48:19.740712 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:48:19.740712 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:48:19.740712 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:48:19.740712 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:48:19.740712 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:48:19.740712 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:48:19.740712 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:48:19.740712 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:48:19.740712 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:48:19.740712 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:48:19.740712 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:48:19.740712 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:48:19.741865 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:48:19.741865 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:48:19.741865 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:48:19.741865 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:48:19.741865 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:48:19.741865 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:48:19.741865 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:48:19.741865 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:48:19.741865 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 28 00:48:19.741865 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:48:19.743732 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 607/1212] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:48:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:48:19.749088 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c458b3-2f37-4d45-8437-c796561c9783 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:19.917847 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c458b3-2f37-4d45-8437-c796561c9783 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:19.971202 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38327ffc-0640-4fc5-840b-f0e452c1f909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:19.972382 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38327ffc-0640-4fc5-840b-f0e452c1f909 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:19.972851 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38327ffc-0640-4fc5-840b-f0e452c1f909 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:19.973440 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38327ffc-0640-4fc5-840b-f0e452c1f909 None admin] PATH_INFO: `/v3/users` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:19.975012 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38327ffc-0640-4fc5-840b-f0e452c1f909 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:48:19.975368 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38327ffc-0640-4fc5-840b-f0e452c1f909 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:19.978012 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38327ffc-0640-4fc5-840b-f0e452c1f909 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:20.000421 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 606/1213] 10.222.0.49 () {56 vars in 1143 bytes} [Sun Aug 28 00:48:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:48:20.009452 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e432a4-5d09-48f6-82a3-f31946991364 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:20.151878 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e432a4-5d09-48f6-82a3-f31946991364 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:20.204411 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b7370d-57ee-452f-aa6e-bb26e009af4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:20.205302 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7370d-57ee-452f-aa6e-bb26e009af4d None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:20.205706 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7370d-57ee-452f-aa6e-bb26e009af4d None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:20.206209 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7370d-57ee-452f-aa6e-bb26e009af4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:20.250828 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:20.304247 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b7370d-57ee-452f-aa6e-bb26e009af4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:20.306953 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b7370d-57ee-452f-aa6e-bb26e009af4d None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:20.465058 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 608/1214] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 28 00:48:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 28 00:48:20.472919 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38327ffc-0640-4fc5-840b-f0e452c1f909 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:20.502192 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:20.631388 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38327ffc-0640-4fc5-840b-f0e452c1f909 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:20.673111 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d082bc60-052f-401a-9631-158b8321d008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:20.673789 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082bc60-052f-401a-9631-158b8321d008 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:20.674067 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082bc60-052f-401a-9631-158b8321d008 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:20.674330 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d082bc60-052f-401a-9631-158b8321d008 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:20.691967 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d082bc60-052f-401a-9631-158b8321d008 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:20.694744 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d082bc60-052f-401a-9631-158b8321d008 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:20.715279 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-d082bc60-052f-401a-9631-158b8321d008 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:48:20.715279 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:48:20.715279 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:48:20.715279 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:48:20.715279 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:48:20.715279 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:48:20.715279 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:48:20.715279 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:48:20.715279 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:48:20.715279 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:48:20.715279 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:48:20.715279 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:48:20.715279 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:48:20.715279 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:48:20.715279 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:48:20.715279 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:48:20.718013 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:48:20.718013 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:48:20.718013 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:48:20.718013 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:48:20.718013 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:48:20.718013 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:48:20.718013 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:48:20.718013 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:48:20.718013 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:48:20.718013 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:48:20.718013 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:48:20.718013 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:48:20.718013 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:48:20.718013 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:48:20.718013 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:48:20.718013 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:48:20.718013 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:48:20.722549 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:48:20.722549 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:48:20.722549 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:48:20.722549 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 607/1215] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:48:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:48:20.728464 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b7370d-57ee-452f-aa6e-bb26e009af4d None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:20.807627 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:20.881917 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b7370d-57ee-452f-aa6e-bb26e009af4d None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:20.946461 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a4af05-2753-4e13-9f6a-84785ccb3a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:20.947864 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4af05-2753-4e13-9f6a-84785ccb3a85 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:20.948354 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4af05-2753-4e13-9f6a-84785ccb3a85 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:20.948734 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4af05-2753-4e13-9f6a-84785ccb3a85 None admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:20.949533 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a4af05-2753-4e13-9f6a-84785ccb3a85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:48:20.950004 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a4af05-2753-4e13-9f6a-84785ccb3a85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:20.953080 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a4af05-2753-4e13-9f6a-84785ccb3a85 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:20.973703 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 609/1216] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:48:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:48:20.979819 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d082bc60-052f-401a-9631-158b8321d008 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:21.102695 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:21.159879 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d082bc60-052f-401a-9631-158b8321d008 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:21.226684 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7232e-77bb-4b79-94de-e52d6295d1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:21.228135 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7232e-77bb-4b79-94de-e52d6295d1c4 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:21.228713 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7232e-77bb-4b79-94de-e52d6295d1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:21.229295 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7232e-77bb-4b79-94de-e52d6295d1c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:21.244601 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab7232e-77bb-4b79-94de-e52d6295d1c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:21.247420 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab7232e-77bb-4b79-94de-e52d6295d1c4 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:21.271200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-bab7232e-77bb-4b79-94de-e52d6295d1c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:48:21.271200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:48:21.271200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:48:21.271200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:48:21.271200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:48:21.271200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:48:21.271200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:48:21.271200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:48:21.271200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:48:21.271200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:48:21.271200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:48:21.271200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:48:21.271200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:48:21.271200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:48:21.271200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:48:21.273619 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:48:21.273619 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:48:21.273619 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:48:21.273619 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:48:21.273619 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:48:21.273619 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:48:21.273619 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:48:21.273619 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:48:21.273619 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:48:21.273619 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:48:21.273619 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:48:21.273619 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:48:21.273619 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:48:21.273619 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:48:21.273619 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:48:21.273619 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:48:21.273619 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:48:21.274645 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:48:21.274645 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:48:21.274645 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:48:21.274645 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:48:21.274645 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:48:21.274645 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:48:21.274645 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:48:21.274645 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:48:21.274645 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 608/1217] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 28 00:48:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:48:21.282972 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a4af05-2753-4e13-9f6a-84785ccb3a85 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:21.447904 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a4af05-2753-4e13-9f6a-84785ccb3a85 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:21.479031 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:21.495183 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d22c37-143b-4020-8acb-fbe5b63d9a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:21.496058 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d22c37-143b-4020-8acb-fbe5b63d9a8c None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:21.496440 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d22c37-143b-4020-8acb-fbe5b63d9a8c None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:21.496811 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d22c37-143b-4020-8acb-fbe5b63d9a8c None admin] PATH_INFO: `/v3/projects` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:21.497669 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d22c37-143b-4020-8acb-fbe5b63d9a8c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:48:21.498132 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d22c37-143b-4020-8acb-fbe5b63d9a8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:21.500267 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d22c37-143b-4020-8acb-fbe5b63d9a8c None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:21.514192 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 610/1218] 10.222.0.49 () {56 vars in 1148 bytes} [Sun Aug 28 00:48:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:48:21.520765 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7232e-77bb-4b79-94de-e52d6295d1c4 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:21.678706 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7232e-77bb-4b79-94de-e52d6295d1c4 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:21.722882 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:21.732749 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd8cd3d-f00e-4864-85c7-3cdb7d293585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:21.733676 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8cd3d-f00e-4864-85c7-3cdb7d293585 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:21.734051 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8cd3d-f00e-4864-85c7-3cdb7d293585 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:21.734604 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd8cd3d-f00e-4864-85c7-3cdb7d293585 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:21.736118 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd8cd3d-f00e-4864-85c7-3cdb7d293585 None admin] RBAC: Adding query filter params (role.id=ab658a45d85b49319c5add69c508b564, scope.project.id=6d6e897c6391486e9c44e9277a3ee823, user.id=8f4fc1d11f5641b0b5f301b234282aa9) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:48:21.737100 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd8cd3d-f00e-4864-85c7-3cdb7d293585 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:21.740916 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd8cd3d-f00e-4864-85c7-3cdb7d293585 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:21.763710 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 609/1219] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 28 00:48:21 2022] GET /identity/v3/role_assignments?user.id=8f4fc1d11f5641b0b5f301b234282aa9&scope.project.id=6d6e897c6391486e9c44e9277a3ee823&role.id=ab658a45d85b49319c5add69c508b564 => generated 259 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:48:23.797518 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4dd5b-841f-419d-acf0-d2b5c7d0a166 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:23.798575 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4dd5b-841f-419d-acf0-d2b5c7d0a166 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:23.798575 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4dd5b-841f-419d-acf0-d2b5c7d0a166 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:23.800547 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 611/1220] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:48:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:48:23.806579 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc1112-0d09-4f14-b192-e253f7d8cf30 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:23.807166 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc1112-0d09-4f14-b192-e253f7d8cf30 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:23.807166 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc1112-0d09-4f14-b192-e253f7d8cf30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:23.826548 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-d0bc1112-0d09-4f14-b192-e253f7d8cf30 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:48:23.827906 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-d0bc1112-0d09-4f14-b192-e253f7d8cf30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:23.915717 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 610/1221] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:48:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:48:24.222616 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b4dd5b-841f-419d-acf0-d2b5c7d0a166 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:24.347138 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b4dd5b-841f-419d-acf0-d2b5c7d0a166 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:24.390000 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b1ad92-2070-4407-9d50-967b3e00bc52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:24.390700 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b1ad92-2070-4407-9d50-967b3e00bc52 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:24.390991 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b1ad92-2070-4407-9d50-967b3e00bc52 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:24.391229 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b1ad92-2070-4407-9d50-967b3e00bc52 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:24.404815 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b1ad92-2070-4407-9d50-967b3e00bc52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:48:24.410039 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-08b1ad92-2070-4407-9d50-967b3e00bc52 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:48:24.410039 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:48:24.410039 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:48:24.410039 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:48:24.410039 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:48:24.410039 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:48:24.410039 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:48:24.410039 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:48:24.410039 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:48:24.410039 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:48:24.410039 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:48:24.410039 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:48:24.410039 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:48:24.410039 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:48:24.410039 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:48:24.410039 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:48:24.412147 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:48:24.412147 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:48:24.412147 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:48:24.412147 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:48:24.412147 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:48:24.412147 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:48:24.412147 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:48:24.412147 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:48:24.412147 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:48:24.412147 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:48:24.412147 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:48:24.412147 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:48:24.412147 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:48:24.412147 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:48:24.412147 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:48:24.412147 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:48:24.413897 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:48:24.413897 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:48:24.413897 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:48:24.413897 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:48:24.413897 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:48:24.413897 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:48:24.413897 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:48:24.413897 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:48:24.413897 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:48:24.413897 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:48:24.413897 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:48:24.413897 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:48:24.413897 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 612/1222] 10.222.0.49 () {56 vars in 1102 bytes} [Sun Aug 28 00:48:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:48:24.420949 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc1112-0d09-4f14-b192-e253f7d8cf30 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:24.553062 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc1112-0d09-4f14-b192-e253f7d8cf30 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:24.580461 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:24.593276 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183df54f-23a1-4ccd-bb57-516ee9b0673d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:24.593973 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183df54f-23a1-4ccd-bb57-516ee9b0673d None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:24.594252 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183df54f-23a1-4ccd-bb57-516ee9b0673d None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:24.594519 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183df54f-23a1-4ccd-bb57-516ee9b0673d None admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:24.595224 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183df54f-23a1-4ccd-bb57-516ee9b0673d None admin] RBAC: Adding query filter params (name=service) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:48:24.595544 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183df54f-23a1-4ccd-bb57-516ee9b0673d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:24.596945 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183df54f-23a1-4ccd-bb57-516ee9b0673d None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:24.606111 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 611/1223] 10.222.0.49 () {56 vars in 1103 bytes} [Sun Aug 28 00:48:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:48:24.614674 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b1ad92-2070-4407-9d50-967b3e00bc52 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:24.666823 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:24.749634 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b1ad92-2070-4407-9d50-967b3e00bc52 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:24.804304 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d446dbcb-0b72-4b3d-bf82-9469b311ec5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:24.805401 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446dbcb-0b72-4b3d-bf82-9469b311ec5c None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:24.805566 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446dbcb-0b72-4b3d-bf82-9469b311ec5c None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:24.805833 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446dbcb-0b72-4b3d-bf82-9469b311ec5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:24.821934 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d446dbcb-0b72-4b3d-bf82-9469b311ec5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:24.823595 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d446dbcb-0b72-4b3d-bf82-9469b311ec5c None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:24.848041 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-d446dbcb-0b72-4b3d-bf82-9469b311ec5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:48:24.848041 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:48:24.848041 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:48:24.848041 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:48:24.848041 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:48:24.848041 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:48:24.848041 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:48:24.848041 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:48:24.848041 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:48:24.848041 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:48:24.848041 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:48:24.848041 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:48:24.848041 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:48:24.848041 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:48:24.848041 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:48:24.848041 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:48:24.849292 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:48:24.849292 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:48:24.849292 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:48:24.849292 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:48:24.849292 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:48:24.849292 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:48:24.849292 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:48:24.849292 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:48:24.849292 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:48:24.849292 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:48:24.849292 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:48:24.849292 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:48:24.849292 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:48:24.849292 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:48:24.849292 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:48:24.849292 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:48:24.849292 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:48:24.850350 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:48:24.850350 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:48:24.850350 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:48:24.850350 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 613/1224] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:48:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:48:24.857989 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183df54f-23a1-4ccd-bb57-516ee9b0673d None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:24.993852 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183df54f-23a1-4ccd-bb57-516ee9b0673d None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:25.032928 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba7ee4b-4772-43f7-ae54-91296824ed81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:25.033944 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba7ee4b-4772-43f7-ae54-91296824ed81 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:25.034449 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba7ee4b-4772-43f7-ae54-91296824ed81 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:25.034935 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba7ee4b-4772-43f7-ae54-91296824ed81 None admin] PATH_INFO: `/v3/domains` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:25.036142 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba7ee4b-4772-43f7-ae54-91296824ed81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:48:25.036664 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba7ee4b-4772-43f7-ae54-91296824ed81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:25.039125 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba7ee4b-4772-43f7-ae54-91296824ed81 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:25.058627 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 612/1225] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:48:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:48:25.067019 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d446dbcb-0b72-4b3d-bf82-9469b311ec5c None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:25.207263 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:25.217832 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d446dbcb-0b72-4b3d-bf82-9469b311ec5c None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:25.260413 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bb85e0-8769-4c88-812a-c7e1f167cd31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:25.261532 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb85e0-8769-4c88-812a-c7e1f167cd31 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:25.262041 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb85e0-8769-4c88-812a-c7e1f167cd31 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:25.262541 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb85e0-8769-4c88-812a-c7e1f167cd31 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:25.278907 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bb85e0-8769-4c88-812a-c7e1f167cd31 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:25.281849 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bb85e0-8769-4c88-812a-c7e1f167cd31 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:25.306069 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-26bb85e0-8769-4c88-812a-c7e1f167cd31 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 28 00:48:25.306069 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:48:25.306069 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:48:25.306069 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:48:25.306069 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:48:25.306069 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:48:25.306069 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:48:25.306069 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:48:25.306069 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:48:25.306069 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:48:25.306069 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:48:25.306069 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:48:25.306069 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:48:25.306069 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:48:25.306069 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:48:25.306069 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:48:25.307624 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:48:25.307624 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:48:25.307624 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:48:25.307624 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:48:25.307624 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:48:25.307624 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:48:25.307624 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:48:25.307624 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:48:25.307624 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:48:25.307624 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:48:25.307624 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:48:25.307624 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:48:25.307624 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:48:25.307624 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:48:25.307624 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:48:25.307624 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:48:25.307624 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:48:25.307624 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:48:25.309389 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:48:25.309389 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:48:25.309389 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:48:25.309389 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:48:25.309389 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:48:25.309389 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:48:25.309389 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:48:25.309389 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:48:25.309389 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 28 00:48:25.309389 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:48:25.309389 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 614/1226] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:48:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:48:25.314625 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba7ee4b-4772-43f7-ae54-91296824ed81 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:25.375372 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:25.449750 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba7ee4b-4772-43f7-ae54-91296824ed81 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:25.500345 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b8497-c62d-4323-b516-0f93a2f72956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:25.500926 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b8497-c62d-4323-b516-0f93a2f72956 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:25.501214 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b8497-c62d-4323-b516-0f93a2f72956 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:25.501460 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b8497-c62d-4323-b516-0f93a2f72956 None admin] PATH_INFO: `/v3/users` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:25.502198 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607b8497-c62d-4323-b516-0f93a2f72956 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:48:25.502512 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607b8497-c62d-4323-b516-0f93a2f72956 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:25.503944 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607b8497-c62d-4323-b516-0f93a2f72956 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:25.530113 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 613/1227] 10.222.0.49 () {56 vars in 1143 bytes} [Sun Aug 28 00:48:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:48:25.536520 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bb85e0-8769-4c88-812a-c7e1f167cd31 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:25.662514 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bb85e0-8769-4c88-812a-c7e1f167cd31 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:25.704838 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1320bc84-ccde-4a1f-95e2-493cfa3b342c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:25.705601 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320bc84-ccde-4a1f-95e2-493cfa3b342c None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:25.706049 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320bc84-ccde-4a1f-95e2-493cfa3b342c None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:25.706331 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320bc84-ccde-4a1f-95e2-493cfa3b342c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:25.720011 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1320bc84-ccde-4a1f-95e2-493cfa3b342c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:25.721756 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1320bc84-ccde-4a1f-95e2-493cfa3b342c None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:25.741705 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-1320bc84-ccde-4a1f-95e2-493cfa3b342c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:48:25.741705 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:48:25.741705 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:48:25.741705 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:48:25.741705 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:48:25.741705 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:48:25.741705 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:48:25.741705 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:48:25.741705 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:48:25.741705 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:48:25.741705 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:48:25.741705 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:48:25.741705 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:48:25.741705 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:48:25.741705 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:48:25.741705 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:48:25.743136 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:48:25.743136 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:48:25.743136 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:48:25.743136 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:48:25.743136 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:48:25.743136 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:48:25.743136 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:48:25.743136 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:48:25.743136 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:48:25.743136 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:48:25.743136 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:48:25.743136 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:48:25.743136 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:48:25.743136 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:48:25.743136 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:48:25.743136 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:48:25.743136 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:48:25.744292 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:48:25.744292 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:48:25.744292 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:48:25.744292 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 615/1228] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:48:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:48:25.749484 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b8497-c62d-4323-b516-0f93a2f72956 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:25.869908 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b8497-c62d-4323-b516-0f93a2f72956 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:25.873863 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:25.917617 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bcdb1b-bf68-4c34-ae96-6eb9fc9c6078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:25.918329 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bcdb1b-bf68-4c34-ae96-6eb9fc9c6078 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:25.918747 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bcdb1b-bf68-4c34-ae96-6eb9fc9c6078 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:25.919205 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bcdb1b-bf68-4c34-ae96-6eb9fc9c6078 None admin] PATH_INFO: `/v3/domains` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:25.920131 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bcdb1b-bf68-4c34-ae96-6eb9fc9c6078 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:48:25.920551 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bcdb1b-bf68-4c34-ae96-6eb9fc9c6078 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:25.922154 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bcdb1b-bf68-4c34-ae96-6eb9fc9c6078 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:25.938487 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 614/1229] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:48:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:48:25.945652 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1320bc84-ccde-4a1f-95e2-493cfa3b342c None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:25.958376 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:26.087393 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1320bc84-ccde-4a1f-95e2-493cfa3b342c None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:26.126433 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d3a71-ad4d-49e9-a596-a5a7dacfc439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:26.127184 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d3a71-ad4d-49e9-a596-a5a7dacfc439 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:26.127504 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d3a71-ad4d-49e9-a596-a5a7dacfc439 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:26.127815 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d3a71-ad4d-49e9-a596-a5a7dacfc439 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:26.136569 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47d3a71-ad4d-49e9-a596-a5a7dacfc439 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:26.138190 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47d3a71-ad4d-49e9-a596-a5a7dacfc439 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:26.150936 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-f47d3a71-ad4d-49e9-a596-a5a7dacfc439 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:48:26.150936 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:48:26.150936 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:48:26.150936 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:48:26.150936 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:48:26.150936 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:48:26.150936 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:48:26.150936 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:48:26.150936 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:48:26.150936 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:48:26.150936 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:48:26.150936 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:48:26.150936 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:48:26.150936 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:48:26.150936 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:48:26.152978 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:48:26.152978 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:48:26.152978 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:48:26.152978 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:48:26.152978 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:48:26.152978 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:48:26.152978 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:48:26.152978 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:48:26.152978 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:48:26.152978 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:48:26.152978 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:48:26.152978 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:48:26.152978 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:48:26.152978 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:48:26.152978 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:48:26.152978 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:48:26.152978 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:48:26.154948 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:48:26.154948 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:48:26.154948 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:48:26.154948 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:48:26.154948 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:48:26.154948 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:48:26.154948 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:48:26.154948 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:48:26.154948 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 616/1230] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 28 00:48:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:48:26.158377 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bcdb1b-bf68-4c34-ae96-6eb9fc9c6078 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:26.322296 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bcdb1b-bf68-4c34-ae96-6eb9fc9c6078 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:26.383020 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b78fed6-096a-4d3a-82f9-7c4014ab52df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:26.383564 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78fed6-096a-4d3a-82f9-7c4014ab52df None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:26.383905 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78fed6-096a-4d3a-82f9-7c4014ab52df None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:26.384209 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78fed6-096a-4d3a-82f9-7c4014ab52df None admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:26.384998 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b78fed6-096a-4d3a-82f9-7c4014ab52df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:48:26.385344 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b78fed6-096a-4d3a-82f9-7c4014ab52df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:26.387332 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b78fed6-096a-4d3a-82f9-7c4014ab52df None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:26.412432 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 615/1231] 10.222.0.49 () {56 vars in 1148 bytes} [Sun Aug 28 00:48:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:48:26.420271 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d3a71-ad4d-49e9-a596-a5a7dacfc439 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:26.508647 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:26.555148 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d3a71-ad4d-49e9-a596-a5a7dacfc439 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:26.593532 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a6fade-84c3-40fc-a433-ae9e98e29e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:26.594116 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a6fade-84c3-40fc-a433-ae9e98e29e52 None admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:26.594389 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a6fade-84c3-40fc-a433-ae9e98e29e52 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:26.594657 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a6fade-84c3-40fc-a433-ae9e98e29e52 None admin] PATH_INFO: `/v3/projects/6d6e897c6391486e9c44e9277a3ee823/users/8f4fc1d11f5641b0b5f301b234282aa9/roles/ab658a45d85b49319c5add69c508b564` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:26.610534 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a6fade-84c3-40fc-a433-ae9e98e29e52 None admin] RBAC: Authorizing `identity:create_grant(project_id=6d6e897c6391486e9c44e9277a3ee823, user_id=8f4fc1d11f5641b0b5f301b234282aa9, role_id=ab658a45d85b49319c5add69c508b564)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:26.612032 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a6fade-84c3-40fc-a433-ae9e98e29e52 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:26.626466 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 617/1232] 10.222.0.49 () {58 vars in 1439 bytes} [Sun Aug 28 00:48:26 2022] PUT /identity/v3/projects/6d6e897c6391486e9c44e9277a3ee823/users/8f4fc1d11f5641b0b5f301b234282aa9/roles/ab658a45d85b49319c5add69c508b564 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:48:28.557657 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7275a0-a8de-41d8-ab7c-8fb71d20a618 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:28.558258 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7275a0-a8de-41d8-ab7c-8fb71d20a618 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:28.558258 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7275a0-a8de-41d8-ab7c-8fb71d20a618 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:28.559569 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 616/1233] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:48:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:48:28.565277 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059912cf-e3be-477f-9fb5-5b9e04433e41 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:28.565889 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059912cf-e3be-477f-9fb5-5b9e04433e41 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:28.565889 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059912cf-e3be-477f-9fb5-5b9e04433e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:28.588791 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-059912cf-e3be-477f-9fb5-5b9e04433e41 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:48:28.590198 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-059912cf-e3be-477f-9fb5-5b9e04433e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:28.673786 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 618/1234] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:48:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 28 00:48:28.969829 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7275a0-a8de-41d8-ab7c-8fb71d20a618 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:29.000232 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:29.101624 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7275a0-a8de-41d8-ab7c-8fb71d20a618 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:29.154148 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d04140-3f91-44f5-8e75-14f683e50978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:29.155171 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d04140-3f91-44f5-8e75-14f683e50978 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:29.155554 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d04140-3f91-44f5-8e75-14f683e50978 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:29.155980 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d04140-3f91-44f5-8e75-14f683e50978 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:29.171616 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d04140-3f91-44f5-8e75-14f683e50978 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:48:29.177008 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-80d04140-3f91-44f5-8e75-14f683e50978 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:48:29.177008 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:48:29.177008 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:48:29.177008 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:48:29.177008 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:48:29.177008 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:48:29.177008 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:48:29.177008 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:48:29.177008 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:48:29.177008 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:48:29.177008 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:48:29.177008 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:48:29.177008 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:48:29.177008 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:48:29.177008 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:48:29.177008 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:48:29.178192 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:48:29.178192 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:48:29.178192 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:48:29.178192 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:48:29.178192 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:48:29.178192 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:48:29.178192 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:48:29.178192 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:48:29.178192 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:48:29.178192 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:48:29.178192 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:48:29.178192 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:48:29.178192 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:48:29.178192 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:48:29.178192 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:48:29.178192 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:48:29.179167 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:48:29.179167 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:48:29.179167 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:48:29.179167 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:48:29.179167 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:48:29.179167 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:48:29.179167 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:48:29.179167 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:48:29.179167 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:48:29.179167 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:48:29.179167 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 28 00:48:29.179167 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:48:29.179167 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 617/1235] 10.222.0.49 () {56 vars in 1102 bytes} [Sun Aug 28 00:48:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:48:29.184713 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059912cf-e3be-477f-9fb5-5b9e04433e41 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:29.253298 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:29.317778 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059912cf-e3be-477f-9fb5-5b9e04433e41 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:29.365163 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77656539-d7bb-496e-95c6-3ac83c3d0786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:29.366104 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77656539-d7bb-496e-95c6-3ac83c3d0786 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:29.366404 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77656539-d7bb-496e-95c6-3ac83c3d0786 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:29.366725 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77656539-d7bb-496e-95c6-3ac83c3d0786 None admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:29.367602 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77656539-d7bb-496e-95c6-3ac83c3d0786 None admin] RBAC: Adding query filter params (name=service) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:48:29.368179 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77656539-d7bb-496e-95c6-3ac83c3d0786 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:29.370682 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77656539-d7bb-496e-95c6-3ac83c3d0786 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:29.381362 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 619/1236] 10.222.0.49 () {56 vars in 1103 bytes} [Sun Aug 28 00:48:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:48:29.388550 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d04140-3f91-44f5-8e75-14f683e50978 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:29.496821 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:29.515314 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d04140-3f91-44f5-8e75-14f683e50978 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:29.550757 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86415a93-261f-4d22-b12f-14136f263a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:29.551438 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86415a93-261f-4d22-b12f-14136f263a66 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:29.551726 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86415a93-261f-4d22-b12f-14136f263a66 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:29.551996 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86415a93-261f-4d22-b12f-14136f263a66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:29.562070 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86415a93-261f-4d22-b12f-14136f263a66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:29.563617 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86415a93-261f-4d22-b12f-14136f263a66 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:29.579740 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-86415a93-261f-4d22-b12f-14136f263a66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:48:29.579740 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:48:29.579740 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:48:29.579740 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:48:29.579740 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:48:29.579740 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:48:29.579740 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:48:29.579740 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:48:29.579740 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:48:29.579740 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:48:29.579740 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:48:29.579740 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:48:29.579740 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:48:29.579740 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:48:29.579740 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:48:29.579740 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:48:29.580994 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:48:29.580994 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:48:29.580994 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:48:29.580994 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:48:29.580994 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:48:29.580994 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:48:29.580994 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:48:29.580994 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:48:29.580994 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:48:29.580994 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:48:29.580994 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:48:29.580994 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:48:29.580994 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:48:29.580994 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:48:29.580994 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:48:29.580994 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:48:29.580994 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:48:29.582224 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:48:29.582224 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:48:29.582224 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:48:29.582224 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 618/1237] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:48:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:48:29.587292 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77656539-d7bb-496e-95c6-3ac83c3d0786 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:29.698997 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77656539-d7bb-496e-95c6-3ac83c3d0786 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:29.710036 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:29.745180 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780f7cc-70d7-4216-9d51-178f68915772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:29.745795 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780f7cc-70d7-4216-9d51-178f68915772 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:29.746095 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780f7cc-70d7-4216-9d51-178f68915772 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:29.746361 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780f7cc-70d7-4216-9d51-178f68915772 None admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:29.747011 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8780f7cc-70d7-4216-9d51-178f68915772 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:48:29.747307 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8780f7cc-70d7-4216-9d51-178f68915772 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:29.748792 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8780f7cc-70d7-4216-9d51-178f68915772 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:29.762006 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 620/1238] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:48:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:48:29.768072 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86415a93-261f-4d22-b12f-14136f263a66 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:29.875006 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86415a93-261f-4d22-b12f-14136f263a66 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:29.911562 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e113e9d-a0ec-40ef-9cc1-89ea8a7aa21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:29.912278 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e113e9d-a0ec-40ef-9cc1-89ea8a7aa21c None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:29.912557 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e113e9d-a0ec-40ef-9cc1-89ea8a7aa21c None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:29.912829 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e113e9d-a0ec-40ef-9cc1-89ea8a7aa21c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:29.915596 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:29.921460 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e113e9d-a0ec-40ef-9cc1-89ea8a7aa21c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:29.922916 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e113e9d-a0ec-40ef-9cc1-89ea8a7aa21c None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:29.935692 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-5e113e9d-a0ec-40ef-9cc1-89ea8a7aa21c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 28 00:48:29.935692 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:48:29.935692 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:48:29.935692 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:48:29.935692 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:48:29.935692 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:48:29.935692 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:48:29.935692 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:48:29.935692 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:48:29.935692 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:48:29.935692 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:48:29.935692 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:48:29.935692 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:48:29.935692 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:48:29.935692 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:48:29.935692 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:48:29.937422 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:48:29.937422 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:48:29.937422 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:48:29.937422 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:48:29.937422 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:48:29.937422 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:48:29.937422 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:48:29.937422 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:48:29.937422 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:48:29.937422 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:48:29.937422 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:48:29.937422 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:48:29.937422 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:48:29.937422 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:48:29.937422 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:48:29.937422 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:48:29.937422 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:48:29.937422 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:48:29.938921 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:48:29.938921 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:48:29.938921 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:48:29.938921 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:48:29.938921 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:48:29.938921 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:48:29.938921 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:48:29.938921 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:48:29.938921 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 28 00:48:29.938921 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:48:29.938921 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 619/1239] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:48:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 28 00:48:29.946470 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780f7cc-70d7-4216-9d51-178f68915772 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:30.051468 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780f7cc-70d7-4216-9d51-178f68915772 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:30.089441 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fd136a-0a33-4fbb-8869-dad76c7d00ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:30.090086 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd136a-0a33-4fbb-8869-dad76c7d00ad None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:30.090362 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd136a-0a33-4fbb-8869-dad76c7d00ad None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:30.090629 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd136a-0a33-4fbb-8869-dad76c7d00ad None admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:30.091392 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fd136a-0a33-4fbb-8869-dad76c7d00ad None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:48:30.091719 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fd136a-0a33-4fbb-8869-dad76c7d00ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:30.093150 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fd136a-0a33-4fbb-8869-dad76c7d00ad None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:30.113371 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 621/1240] 10.222.0.49 () {56 vars in 1143 bytes} [Sun Aug 28 00:48:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:48:30.121494 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e113e9d-a0ec-40ef-9cc1-89ea8a7aa21c None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:30.250317 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e113e9d-a0ec-40ef-9cc1-89ea8a7aa21c None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:30.289404 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f83fcc-e3fe-4e00-989c-d547d5b108d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:30.290018 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f83fcc-e3fe-4e00-989c-d547d5b108d7 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:30.290298 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f83fcc-e3fe-4e00-989c-d547d5b108d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:30.290567 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f83fcc-e3fe-4e00-989c-d547d5b108d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:30.372335 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:30.383059 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f83fcc-e3fe-4e00-989c-d547d5b108d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:30.385110 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f83fcc-e3fe-4e00-989c-d547d5b108d7 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:30.494981 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 620/1241] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 28 00:48:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:48:30.501309 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fd136a-0a33-4fbb-8869-dad76c7d00ad None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:30.528759 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:30.611485 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fd136a-0a33-4fbb-8869-dad76c7d00ad None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:30.646695 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5b619b-5edd-444d-b4ed-77dd904ed95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:30.647215 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b619b-5edd-444d-b4ed-77dd904ed95c None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:30.647490 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b619b-5edd-444d-b4ed-77dd904ed95c None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:30.647793 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b619b-5edd-444d-b4ed-77dd904ed95c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:30.658171 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5b619b-5edd-444d-b4ed-77dd904ed95c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:30.659626 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5b619b-5edd-444d-b4ed-77dd904ed95c None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:30.674845 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-4f5b619b-5edd-444d-b4ed-77dd904ed95c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:48:30.674845 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:48:30.674845 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:48:30.674845 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:48:30.674845 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:48:30.674845 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:48:30.674845 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:48:30.674845 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:48:30.674845 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:48:30.674845 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:48:30.674845 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:48:30.674845 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:48:30.674845 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:48:30.674845 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:48:30.674845 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:48:30.674845 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:48:30.676218 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:48:30.676218 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:48:30.676218 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:48:30.676218 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:48:30.676218 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:48:30.676218 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:48:30.676218 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:48:30.676218 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:48:30.676218 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:48:30.676218 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:48:30.676218 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:48:30.676218 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:48:30.676218 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:48:30.676218 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:48:30.676218 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:48:30.676218 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:48:30.676218 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:48:30.677237 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:48:30.677237 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:48:30.677237 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:48:30.677237 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 622/1242] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:48:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:48:30.682278 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f83fcc-e3fe-4e00-989c-d547d5b108d7 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:30.789182 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:30.795393 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f83fcc-e3fe-4e00-989c-d547d5b108d7 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:30.831385 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7713a09-3e79-456f-8381-e51f837d2759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:30.832103 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7713a09-3e79-456f-8381-e51f837d2759 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:30.832380 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7713a09-3e79-456f-8381-e51f837d2759 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:30.832699 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7713a09-3e79-456f-8381-e51f837d2759 None admin] PATH_INFO: `/v3/domains` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:30.833341 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7713a09-3e79-456f-8381-e51f837d2759 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:48:30.833687 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7713a09-3e79-456f-8381-e51f837d2759 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:30.835134 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7713a09-3e79-456f-8381-e51f837d2759 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:30.847293 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 621/1243] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:48:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:48:30.853850 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5b619b-5edd-444d-b4ed-77dd904ed95c None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:30.938805 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:30.965749 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5b619b-5edd-444d-b4ed-77dd904ed95c None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:31.006076 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6872276-ebf1-40ed-9abb-7ec606240e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:31.006712 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6872276-ebf1-40ed-9abb-7ec606240e47 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:31.006988 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6872276-ebf1-40ed-9abb-7ec606240e47 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:31.007275 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6872276-ebf1-40ed-9abb-7ec606240e47 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:31.014714 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6872276-ebf1-40ed-9abb-7ec606240e47 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:31.016369 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6872276-ebf1-40ed-9abb-7ec606240e47 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:31.028208 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-c6872276-ebf1-40ed-9abb-7ec606240e47 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:48:31.028208 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:48:31.028208 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:48:31.028208 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:48:31.028208 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:48:31.028208 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:48:31.028208 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:48:31.028208 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:48:31.028208 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:48:31.028208 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:48:31.028208 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:48:31.028208 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:48:31.028208 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:48:31.028208 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:48:31.028208 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:48:31.029366 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:48:31.029366 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:48:31.029366 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:48:31.029366 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:48:31.029366 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:48:31.029366 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:48:31.029366 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:48:31.029366 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:48:31.029366 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:48:31.029366 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:48:31.029366 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:48:31.029366 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:48:31.029366 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:48:31.029366 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:48:31.029366 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:48:31.029366 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:48:31.029366 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:48:31.030834 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:48:31.030834 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:48:31.030834 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:48:31.030834 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:48:31.030834 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:48:31.030834 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:48:31.030834 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:48:31.030834 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:48:31.030834 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 623/1244] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 28 00:48:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:48:31.036009 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7713a09-3e79-456f-8381-e51f837d2759 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:31.153067 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7713a09-3e79-456f-8381-e51f837d2759 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:31.192678 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7312a0b-07f0-4802-ad05-cf7b2faced01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:31.193274 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7312a0b-07f0-4802-ad05-cf7b2faced01 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:31.193557 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7312a0b-07f0-4802-ad05-cf7b2faced01 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:31.193830 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7312a0b-07f0-4802-ad05-cf7b2faced01 None admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:31.194634 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7312a0b-07f0-4802-ad05-cf7b2faced01 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:48:31.194993 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7312a0b-07f0-4802-ad05-cf7b2faced01 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:31.196695 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7312a0b-07f0-4802-ad05-cf7b2faced01 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:31.213828 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 622/1245] 10.222.0.49 () {56 vars in 1148 bytes} [Sun Aug 28 00:48:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:48:31.220641 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6872276-ebf1-40ed-9abb-7ec606240e47 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:31.357911 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6872276-ebf1-40ed-9abb-7ec606240e47 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:31.401360 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb0d2b7-432d-4481-90ae-6766956fb74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:31.402079 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0d2b7-432d-4481-90ae-6766956fb74a None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:31.402396 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0d2b7-432d-4481-90ae-6766956fb74a None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:31.402703 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0d2b7-432d-4481-90ae-6766956fb74a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:31.403499 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb0d2b7-432d-4481-90ae-6766956fb74a None admin] RBAC: Adding query filter params (role.id=ab658a45d85b49319c5add69c508b564, scope.project.id=6d6e897c6391486e9c44e9277a3ee823, user.id=8f4fc1d11f5641b0b5f301b234282aa9) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:48:31.403872 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb0d2b7-432d-4481-90ae-6766956fb74a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:31.405592 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb0d2b7-432d-4481-90ae-6766956fb74a None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:31.414315 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 624/1246] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 28 00:48:31 2022] GET /identity/v3/role_assignments?user.id=8f4fc1d11f5641b0b5f301b234282aa9&scope.project.id=6d6e897c6391486e9c44e9277a3ee823&role.id=ab658a45d85b49319c5add69c508b564 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:48:33.481853 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad99d64-e408-4935-ad49-9edf9a1f44ed None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:33.482535 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad99d64-e408-4935-ad49-9edf9a1f44ed None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:33.482535 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad99d64-e408-4935-ad49-9edf9a1f44ed None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:33.483735 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 623/1247] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:48:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:48:33.492387 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca40cba3-5348-414b-940f-7e3c59e217fa None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:33.493209 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca40cba3-5348-414b-940f-7e3c59e217fa None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:33.493394 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca40cba3-5348-414b-940f-7e3c59e217fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:33.502077 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:33.516306 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-ca40cba3-5348-414b-940f-7e3c59e217fa None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:48:33.517776 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-ca40cba3-5348-414b-940f-7e3c59e217fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:33.601982 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 625/1248] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:48:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:48:33.879303 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad99d64-e408-4935-ad49-9edf9a1f44ed None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:33.901497 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:33.996444 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad99d64-e408-4935-ad49-9edf9a1f44ed None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:34.033327 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd4c56-7117-436f-a5a9-0323e3930a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:34.033953 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd4c56-7117-436f-a5a9-0323e3930a0c None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:34.034225 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd4c56-7117-436f-a5a9-0323e3930a0c None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:34.034491 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd4c56-7117-436f-a5a9-0323e3930a0c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:34.046144 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cd4c56-7117-436f-a5a9-0323e3930a0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:48:34.051054 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-66cd4c56-7117-436f-a5a9-0323e3930a0c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:48:34.051054 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:48:34.051054 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:48:34.051054 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:48:34.051054 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:48:34.051054 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:48:34.051054 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:48:34.051054 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:48:34.051054 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:48:34.051054 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:48:34.051054 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:48:34.051054 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:48:34.051054 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:48:34.051054 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:48:34.051054 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:48:34.051054 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:48:34.052378 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:48:34.052378 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:48:34.052378 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:48:34.052378 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:48:34.052378 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:48:34.052378 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:48:34.052378 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:48:34.052378 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:48:34.052378 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:48:34.052378 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:48:34.052378 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:48:34.052378 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:48:34.052378 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:48:34.052378 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:48:34.052378 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:48:34.052378 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:48:34.053240 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:48:34.053240 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:48:34.053240 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:48:34.053240 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:48:34.053240 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:48:34.053240 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:48:34.053240 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:48:34.053240 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:48:34.053240 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:48:34.053240 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:48:34.053240 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:48:34.053240 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:48:34.055914 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 624/1249] 10.222.0.49 () {56 vars in 1096 bytes} [Sun Aug 28 00:48:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:48:34.058830 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca40cba3-5348-414b-940f-7e3c59e217fa None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:34.175722 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca40cba3-5348-414b-940f-7e3c59e217fa None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:34.212755 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:34.219521 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43447b3a-55ec-405c-8d51-0ebd618fdcfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:34.220293 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43447b3a-55ec-405c-8d51-0ebd618fdcfa None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:34.220609 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43447b3a-55ec-405c-8d51-0ebd618fdcfa None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:34.220954 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43447b3a-55ec-405c-8d51-0ebd618fdcfa None admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:34.221756 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43447b3a-55ec-405c-8d51-0ebd618fdcfa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:48:34.222342 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43447b3a-55ec-405c-8d51-0ebd618fdcfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:34.224378 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43447b3a-55ec-405c-8d51-0ebd618fdcfa None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:34.234734 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 626/1250] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 28 00:48:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:48:34.241126 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd4c56-7117-436f-a5a9-0323e3930a0c None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:34.330063 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:34.358958 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd4c56-7117-436f-a5a9-0323e3930a0c None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:34.401046 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f1742b-ceef-4b9e-8b6e-0152f7bcd2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:34.401650 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1742b-ceef-4b9e-8b6e-0152f7bcd2e4 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:34.401942 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1742b-ceef-4b9e-8b6e-0152f7bcd2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:34.402187 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1742b-ceef-4b9e-8b6e-0152f7bcd2e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:34.413326 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f1742b-ceef-4b9e-8b6e-0152f7bcd2e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:34.414830 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f1742b-ceef-4b9e-8b6e-0152f7bcd2e4 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:34.430399 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-46f1742b-ceef-4b9e-8b6e-0152f7bcd2e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:48:34.430399 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:48:34.430399 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:48:34.430399 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:48:34.430399 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:48:34.430399 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:48:34.430399 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:48:34.430399 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:48:34.430399 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:48:34.430399 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:48:34.430399 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:48:34.430399 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:48:34.430399 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:48:34.430399 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:48:34.430399 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:48:34.430399 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:48:34.431595 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:48:34.431595 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:48:34.431595 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:48:34.431595 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:48:34.431595 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:48:34.431595 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:48:34.431595 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:48:34.431595 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:48:34.431595 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:48:34.431595 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:48:34.431595 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:48:34.431595 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:48:34.431595 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:48:34.431595 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:48:34.431595 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:48:34.431595 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:48:34.431595 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:48:34.432837 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:48:34.432837 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:48:34.432837 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:48:34.432837 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 625/1251] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:48:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:48:34.438074 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43447b3a-55ec-405c-8d51-0ebd618fdcfa None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:34.552730 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43447b3a-55ec-405c-8d51-0ebd618fdcfa None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:34.591744 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77637ad-afcf-4ea5-a28e-c01c9477e278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:34.592364 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77637ad-afcf-4ea5-a28e-c01c9477e278 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:34.592644 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77637ad-afcf-4ea5-a28e-c01c9477e278 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:34.592912 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77637ad-afcf-4ea5-a28e-c01c9477e278 None admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:34.593562 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77637ad-afcf-4ea5-a28e-c01c9477e278 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:48:34.593865 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77637ad-afcf-4ea5-a28e-c01c9477e278 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:34.595245 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77637ad-afcf-4ea5-a28e-c01c9477e278 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:34.608624 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 627/1252] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:48:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:48:34.615423 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f1742b-ceef-4b9e-8b6e-0152f7bcd2e4 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:34.727096 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f1742b-ceef-4b9e-8b6e-0152f7bcd2e4 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:34.754624 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:34.767062 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d83c0c-d711-49f7-97ce-27aa8d7dd9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:34.767739 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d83c0c-d711-49f7-97ce-27aa8d7dd9fc None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:34.768017 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d83c0c-d711-49f7-97ce-27aa8d7dd9fc None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:34.768294 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d83c0c-d711-49f7-97ce-27aa8d7dd9fc None admin] PATH_INFO: `/v3/users/placement` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:34.776500 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d83c0c-d711-49f7-97ce-27aa8d7dd9fc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:34.777963 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d83c0c-d711-49f7-97ce-27aa8d7dd9fc None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:34.789723 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-64d83c0c-d711-49f7-97ce-27aa8d7dd9fc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 28 00:48:34.789723 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:48:34.789723 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:48:34.789723 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:48:34.789723 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:48:34.789723 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:48:34.789723 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:48:34.789723 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:48:34.789723 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:48:34.789723 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:48:34.789723 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:48:34.789723 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:48:34.789723 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:48:34.789723 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:48:34.789723 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:48:34.789723 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:48:34.790817 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:48:34.790817 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:48:34.790817 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:48:34.790817 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:48:34.790817 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:48:34.790817 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:48:34.790817 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:48:34.790817 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:48:34.790817 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:48:34.790817 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:48:34.790817 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:48:34.790817 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:48:34.790817 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:48:34.790817 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:48:34.790817 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:48:34.790817 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:48:34.790817 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:48:34.790817 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:48:34.791842 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:48:34.791842 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:48:34.791842 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:48:34.791842 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:48:34.791842 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:48:34.791842 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:48:34.791842 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:48:34.791842 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:48:34.791842 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 28 00:48:34.791842 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:48:34.791842 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 626/1253] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:48:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:48:34.797127 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77637ad-afcf-4ea5-a28e-c01c9477e278 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:34.859049 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:34.916983 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77637ad-afcf-4ea5-a28e-c01c9477e278 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:34.962460 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5b066-1b0f-4cf9-83be-9fd96965ea94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:34.963083 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5b066-1b0f-4cf9-83be-9fd96965ea94 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:34.963361 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5b066-1b0f-4cf9-83be-9fd96965ea94 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:34.963635 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5b066-1b0f-4cf9-83be-9fd96965ea94 None admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:34.964473 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed5b066-1b0f-4cf9-83be-9fd96965ea94 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:48:34.964816 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed5b066-1b0f-4cf9-83be-9fd96965ea94 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:34.966359 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed5b066-1b0f-4cf9-83be-9fd96965ea94 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:34.990774 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 628/1254] 10.222.0.49 () {56 vars in 1143 bytes} [Sun Aug 28 00:48:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:48:34.996264 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d83c0c-d711-49f7-97ce-27aa8d7dd9fc None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:35.122407 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d83c0c-d711-49f7-97ce-27aa8d7dd9fc None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:35.164428 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c87d2f-5229-40da-ac7d-ba7450eb599f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:35.165135 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c87d2f-5229-40da-ac7d-ba7450eb599f None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:35.165469 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c87d2f-5229-40da-ac7d-ba7450eb599f None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:35.165778 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c87d2f-5229-40da-ac7d-ba7450eb599f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:35.237428 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:35.254585 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c87d2f-5229-40da-ac7d-ba7450eb599f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:35.256213 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c87d2f-5229-40da-ac7d-ba7450eb599f None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:35.386691 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 627/1255] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 28 00:48:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:48:35.393805 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5b066-1b0f-4cf9-83be-9fd96965ea94 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:35.514765 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5b066-1b0f-4cf9-83be-9fd96965ea94 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:35.531762 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:35.554503 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df1ac29-8cec-426a-b869-3143f53e2375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:35.555216 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1ac29-8cec-426a-b869-3143f53e2375 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:35.555601 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1ac29-8cec-426a-b869-3143f53e2375 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:35.555974 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1ac29-8cec-426a-b869-3143f53e2375 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:35.568687 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df1ac29-8cec-426a-b869-3143f53e2375 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:35.570196 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df1ac29-8cec-426a-b869-3143f53e2375 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:35.587727 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-5df1ac29-8cec-426a-b869-3143f53e2375 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:48:35.587727 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:48:35.587727 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:48:35.587727 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:48:35.587727 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:48:35.587727 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:48:35.587727 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:48:35.587727 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:48:35.587727 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:48:35.587727 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:48:35.587727 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:48:35.587727 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:48:35.587727 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:48:35.587727 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:48:35.587727 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:48:35.587727 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:48:35.589001 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:48:35.589001 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:48:35.589001 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:48:35.589001 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:48:35.589001 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:48:35.589001 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:48:35.589001 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:48:35.589001 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:48:35.589001 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:48:35.589001 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:48:35.589001 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:48:35.589001 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:48:35.589001 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:48:35.589001 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:48:35.589001 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:48:35.589001 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:48:35.589001 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:48:35.590188 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:48:35.590188 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:48:35.590188 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:48:35.590188 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 629/1256] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:48:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:48:35.594953 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c87d2f-5229-40da-ac7d-ba7450eb599f None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:35.691757 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:35.705717 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c87d2f-5229-40da-ac7d-ba7450eb599f None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:35.753908 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e2b58-b1fc-4e34-ac81-0049d28a76ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:35.754500 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e2b58-b1fc-4e34-ac81-0049d28a76ac None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:35.754779 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e2b58-b1fc-4e34-ac81-0049d28a76ac None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:35.755045 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e2b58-b1fc-4e34-ac81-0049d28a76ac None admin] PATH_INFO: `/v3/domains` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:35.755742 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4e2b58-b1fc-4e34-ac81-0049d28a76ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:48:35.756063 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4e2b58-b1fc-4e34-ac81-0049d28a76ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:35.757423 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4e2b58-b1fc-4e34-ac81-0049d28a76ac None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:35.774178 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 628/1257] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:48:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:48:35.782111 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df1ac29-8cec-426a-b869-3143f53e2375 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:35.920574 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df1ac29-8cec-426a-b869-3143f53e2375 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:35.965206 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928faa39-2830-4d54-b470-48c2598f30d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:35.965922 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928faa39-2830-4d54-b470-48c2598f30d2 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:35.966197 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928faa39-2830-4d54-b470-48c2598f30d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:35.966470 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928faa39-2830-4d54-b470-48c2598f30d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:35.975020 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928faa39-2830-4d54-b470-48c2598f30d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:35.976760 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928faa39-2830-4d54-b470-48c2598f30d2 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:35.992973 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-928faa39-2830-4d54-b470-48c2598f30d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:48:35.992973 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:48:35.992973 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:48:35.992973 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:48:35.992973 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:48:35.992973 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:48:35.992973 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:48:35.992973 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:48:35.992973 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:48:35.992973 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:48:35.992973 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:48:35.992973 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:48:35.992973 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:48:35.992973 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:48:35.992973 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:48:35.995067 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:48:35.995067 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:48:35.995067 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:48:35.995067 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:48:35.995067 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:48:35.995067 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:48:35.995067 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:48:35.995067 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:48:35.995067 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:48:35.995067 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:48:35.995067 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:48:35.995067 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:48:35.995067 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:48:35.995067 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:48:35.995067 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:48:35.995067 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:48:35.995067 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:48:35.996366 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:48:35.996366 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:48:35.996366 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:48:35.996366 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:48:35.996366 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:48:35.996366 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:48:35.996366 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:48:35.996366 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:48:35.996366 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 630/1258] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 28 00:48:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:48:36.002079 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e2b58-b1fc-4e34-ac81-0049d28a76ac None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:36.142194 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e2b58-b1fc-4e34-ac81-0049d28a76ac None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:36.191683 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fd155a-f023-4f96-a169-0e867c8f645d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:36.192370 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd155a-f023-4f96-a169-0e867c8f645d None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:36.192656 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd155a-f023-4f96-a169-0e867c8f645d None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:36.192937 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd155a-f023-4f96-a169-0e867c8f645d None admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:36.193722 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fd155a-f023-4f96-a169-0e867c8f645d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:48:36.194031 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fd155a-f023-4f96-a169-0e867c8f645d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:36.195510 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fd155a-f023-4f96-a169-0e867c8f645d None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:36.209299 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 629/1259] 10.222.0.49 () {56 vars in 1148 bytes} [Sun Aug 28 00:48:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:48:36.216795 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928faa39-2830-4d54-b470-48c2598f30d2 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:36.260577 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:36.348300 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928faa39-2830-4d54-b470-48c2598f30d2 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:36.386480 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ffbd57-725f-42e8-95f6-a0b5a105ea07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:36.387169 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ffbd57-725f-42e8-95f6-a0b5a105ea07 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:36.387510 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ffbd57-725f-42e8-95f6-a0b5a105ea07 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:36.387734 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ffbd57-725f-42e8-95f6-a0b5a105ea07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:36.388578 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ffbd57-725f-42e8-95f6-a0b5a105ea07 None admin] RBAC: Adding query filter params (role.id=2e4889bb71f9434392c0baba59f2534e, scope.project.id=6d6e897c6391486e9c44e9277a3ee823, user.id=8f4fc1d11f5641b0b5f301b234282aa9) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:48:36.388886 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ffbd57-725f-42e8-95f6-a0b5a105ea07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:36.390384 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ffbd57-725f-42e8-95f6-a0b5a105ea07 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:36.396649 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 631/1260] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 28 00:48:36 2022] GET /identity/v3/role_assignments?user.id=8f4fc1d11f5641b0b5f301b234282aa9&scope.project.id=6d6e897c6391486e9c44e9277a3ee823&role.id=2e4889bb71f9434392c0baba59f2534e => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:48:38.353759 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87143b1-3e81-4952-8acb-c4ec990bc7a9 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:38.354353 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87143b1-3e81-4952-8acb-c4ec990bc7a9 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:38.354353 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87143b1-3e81-4952-8acb-c4ec990bc7a9 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:38.355652 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 630/1261] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:48:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:48:38.361616 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a6cb8-28b3-48f7-a1d2-a4f43e88c5bc None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:38.362194 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a6cb8-28b3-48f7-a1d2-a4f43e88c5bc None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:38.362194 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a6cb8-28b3-48f7-a1d2-a4f43e88c5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:38.382507 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-7a1a6cb8-28b3-48f7-a1d2-a4f43e88c5bc None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:48:38.383778 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-7a1a6cb8-28b3-48f7-a1d2-a4f43e88c5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:38.461956 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 632/1262] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:48:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:48:38.723853 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87143b1-3e81-4952-8acb-c4ec990bc7a9 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:38.735839 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:38.836608 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87143b1-3e81-4952-8acb-c4ec990bc7a9 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:38.878778 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13976009-a59c-4c41-b869-2aa57934c390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:38.879511 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13976009-a59c-4c41-b869-2aa57934c390 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:38.879819 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13976009-a59c-4c41-b869-2aa57934c390 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:38.880090 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13976009-a59c-4c41-b869-2aa57934c390 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:38.890860 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13976009-a59c-4c41-b869-2aa57934c390 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:48:38.895722 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-13976009-a59c-4c41-b869-2aa57934c390 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:48:38.895722 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:48:38.895722 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:48:38.895722 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:48:38.895722 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:48:38.895722 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:48:38.895722 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:48:38.895722 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:48:38.895722 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:48:38.895722 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:48:38.895722 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:48:38.895722 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:48:38.895722 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:48:38.895722 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:48:38.895722 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:48:38.895722 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:48:38.896840 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:48:38.896840 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:48:38.896840 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:48:38.896840 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:48:38.896840 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:48:38.896840 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:48:38.896840 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:48:38.896840 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:48:38.896840 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:48:38.896840 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:48:38.896840 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:48:38.896840 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:48:38.896840 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:48:38.896840 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:48:38.896840 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:48:38.896840 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:48:38.897984 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:48:38.897984 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:48:38.897984 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:48:38.897984 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:48:38.897984 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:48:38.897984 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:48:38.897984 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:48:38.897984 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:48:38.897984 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:48:38.897984 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:48:38.897984 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:48:38.897984 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:48:38.897984 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 631/1263] 10.222.0.49 () {56 vars in 1096 bytes} [Sun Aug 28 00:48:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:48:38.903163 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a6cb8-28b3-48f7-a1d2-a4f43e88c5bc None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:38.921536 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:39.007562 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a6cb8-28b3-48f7-a1d2-a4f43e88c5bc None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:39.042358 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4dded-29de-49a9-a1aa-2ef495b736cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:39.042967 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4dded-29de-49a9-a1aa-2ef495b736cc None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:39.043246 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4dded-29de-49a9-a1aa-2ef495b736cc None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:39.043515 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4dded-29de-49a9-a1aa-2ef495b736cc None admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:39.044218 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb4dded-29de-49a9-a1aa-2ef495b736cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:48:39.044519 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb4dded-29de-49a9-a1aa-2ef495b736cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:39.045893 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb4dded-29de-49a9-a1aa-2ef495b736cc None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:39.054313 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 633/1264] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 28 00:48:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:48:39.060412 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13976009-a59c-4c41-b869-2aa57934c390 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:39.131559 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:39.164662 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13976009-a59c-4c41-b869-2aa57934c390 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:39.201465 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d556ab8-4912-4da8-817d-eb1320858d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:39.202305 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d556ab8-4912-4da8-817d-eb1320858d1d None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:39.202709 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d556ab8-4912-4da8-817d-eb1320858d1d None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:39.203590 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d556ab8-4912-4da8-817d-eb1320858d1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:39.215254 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d556ab8-4912-4da8-817d-eb1320858d1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:39.216639 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d556ab8-4912-4da8-817d-eb1320858d1d None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:39.233231 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-6d556ab8-4912-4da8-817d-eb1320858d1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:48:39.233231 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:48:39.233231 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:48:39.233231 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:48:39.233231 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:48:39.233231 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:48:39.233231 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:48:39.233231 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:48:39.233231 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:48:39.233231 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:48:39.233231 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:48:39.233231 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:48:39.233231 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:48:39.233231 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:48:39.233231 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:48:39.233231 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:48:39.234740 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:48:39.234740 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:48:39.234740 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:48:39.234740 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:48:39.234740 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:48:39.234740 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:48:39.234740 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:48:39.234740 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:48:39.234740 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:48:39.234740 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:48:39.234740 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:48:39.234740 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:48:39.234740 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:48:39.234740 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:48:39.234740 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:48:39.234740 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:48:39.234740 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:48:39.235869 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:48:39.235869 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:48:39.235869 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:48:39.239931 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 632/1265] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:48:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:48:39.241321 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4dded-29de-49a9-a1aa-2ef495b736cc None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:39.333234 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:39.354195 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb4dded-29de-49a9-a1aa-2ef495b736cc None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:39.389981 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d3b08-6da7-4ce5-9369-523bde37f874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:39.390690 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d3b08-6da7-4ce5-9369-523bde37f874 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:39.390824 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d3b08-6da7-4ce5-9369-523bde37f874 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:39.391118 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d3b08-6da7-4ce5-9369-523bde37f874 None admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:39.391808 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35d3b08-6da7-4ce5-9369-523bde37f874 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:48:39.392138 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35d3b08-6da7-4ce5-9369-523bde37f874 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:39.393512 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35d3b08-6da7-4ce5-9369-523bde37f874 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:39.406396 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 634/1266] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:48:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:48:39.412514 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d556ab8-4912-4da8-817d-eb1320858d1d None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:39.517719 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d556ab8-4912-4da8-817d-eb1320858d1d None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:39.537666 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:39.552704 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a81113a-eedf-4533-9147-23b8803a2891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:39.553336 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81113a-eedf-4533-9147-23b8803a2891 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:39.553614 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81113a-eedf-4533-9147-23b8803a2891 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:39.553884 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a81113a-eedf-4533-9147-23b8803a2891 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:39.561876 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a81113a-eedf-4533-9147-23b8803a2891 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:39.563317 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a81113a-eedf-4533-9147-23b8803a2891 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:39.574662 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-7a81113a-eedf-4533-9147-23b8803a2891 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 28 00:48:39.574662 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:48:39.574662 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:48:39.574662 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:48:39.574662 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:48:39.574662 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:48:39.574662 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:48:39.574662 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:48:39.574662 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:48:39.574662 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:48:39.574662 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:48:39.574662 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:48:39.574662 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:48:39.574662 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:48:39.574662 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:48:39.574662 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:48:39.575862 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:48:39.575862 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:48:39.575862 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:48:39.575862 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:48:39.575862 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:48:39.575862 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:48:39.575862 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:48:39.575862 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:48:39.575862 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:48:39.575862 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:48:39.575862 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:48:39.575862 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:48:39.575862 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:48:39.575862 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:48:39.575862 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:48:39.575862 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:48:39.575862 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:48:39.575862 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:48:39.576858 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:48:39.576858 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:48:39.576858 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:48:39.576858 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:48:39.576858 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:48:39.576858 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:48:39.576858 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:48:39.576858 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:48:39.576858 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 28 00:48:39.576858 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:48:39.576858 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 633/1267] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:48:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:48:39.582493 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d3b08-6da7-4ce5-9369-523bde37f874 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:39.685092 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d3b08-6da7-4ce5-9369-523bde37f874 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:39.721893 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0022775-bf1e-4fff-bca5-009d397fb142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:39.722514 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0022775-bf1e-4fff-bca5-009d397fb142 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:39.722794 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0022775-bf1e-4fff-bca5-009d397fb142 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:39.723194 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0022775-bf1e-4fff-bca5-009d397fb142 None admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:39.723985 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0022775-bf1e-4fff-bca5-009d397fb142 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:48:39.724303 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0022775-bf1e-4fff-bca5-009d397fb142 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:39.725741 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0022775-bf1e-4fff-bca5-009d397fb142 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:39.735259 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:39.745366 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 635/1268] 10.222.0.49 () {56 vars in 1143 bytes} [Sun Aug 28 00:48:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:48:39.751455 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a81113a-eedf-4533-9147-23b8803a2891 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:39.862094 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a81113a-eedf-4533-9147-23b8803a2891 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:39.898296 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29756ec-40ea-4331-a614-dddaf58641a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:39.898912 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29756ec-40ea-4331-a614-dddaf58641a1 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:39.899185 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29756ec-40ea-4331-a614-dddaf58641a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:39.899454 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29756ec-40ea-4331-a614-dddaf58641a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:39.910680 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29756ec-40ea-4331-a614-dddaf58641a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:39.912168 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29756ec-40ea-4331-a614-dddaf58641a1 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:39.926923 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-c29756ec-40ea-4331-a614-dddaf58641a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:48:39.926923 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:48:39.926923 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:48:39.926923 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:48:39.926923 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:48:39.926923 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:48:39.926923 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:48:39.926923 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:48:39.926923 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:48:39.926923 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:48:39.926923 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:48:39.926923 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:48:39.926923 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:48:39.926923 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:48:39.926923 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:48:39.926923 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:48:39.928098 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:48:39.928098 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:48:39.928098 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:48:39.928098 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:48:39.928098 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:48:39.928098 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:48:39.928098 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:48:39.928098 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:48:39.928098 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:48:39.928098 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:48:39.928098 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:48:39.928098 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:48:39.928098 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:48:39.928098 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:48:39.928098 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:48:39.928098 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:48:39.928098 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:48:39.929081 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:48:39.929081 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:48:39.929081 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:48:39.929081 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 634/1269] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:48:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:48:39.934429 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0022775-bf1e-4fff-bca5-009d397fb142 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:40.042097 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0022775-bf1e-4fff-bca5-009d397fb142 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:40.076752 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d8ede2-2e9f-4b62-b45c-21ca77090780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:40.077348 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d8ede2-2e9f-4b62-b45c-21ca77090780 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:40.077623 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d8ede2-2e9f-4b62-b45c-21ca77090780 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:40.077887 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d8ede2-2e9f-4b62-b45c-21ca77090780 None admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:40.078822 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d8ede2-2e9f-4b62-b45c-21ca77090780 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:48:40.079120 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d8ede2-2e9f-4b62-b45c-21ca77090780 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:40.080504 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d8ede2-2e9f-4b62-b45c-21ca77090780 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:40.091758 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 636/1270] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:48:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:48:40.097650 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29756ec-40ea-4331-a614-dddaf58641a1 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:40.130721 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:40.202201 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29756ec-40ea-4331-a614-dddaf58641a1 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:40.241735 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40848663-63d9-4b15-9b32-6654745594f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:40.242366 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40848663-63d9-4b15-9b32-6654745594f7 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:40.242645 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40848663-63d9-4b15-9b32-6654745594f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:40.242917 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40848663-63d9-4b15-9b32-6654745594f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:40.249703 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40848663-63d9-4b15-9b32-6654745594f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:40.251164 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40848663-63d9-4b15-9b32-6654745594f7 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:40.263121 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-40848663-63d9-4b15-9b32-6654745594f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:48:40.263121 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:48:40.263121 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:48:40.263121 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:48:40.263121 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:48:40.263121 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:48:40.263121 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:48:40.263121 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:48:40.263121 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:48:40.263121 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:48:40.263121 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:48:40.263121 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:48:40.263121 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:48:40.263121 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:48:40.263121 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:48:40.264246 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:48:40.264246 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:48:40.264246 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:48:40.264246 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:48:40.264246 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:48:40.264246 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:48:40.264246 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:48:40.264246 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:48:40.264246 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:48:40.264246 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:48:40.264246 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:48:40.264246 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:48:40.264246 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:48:40.264246 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:48:40.264246 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:48:40.264246 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:48:40.264246 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:48:40.265583 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:48:40.265583 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:48:40.265583 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:48:40.265583 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:48:40.265583 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:48:40.265583 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:48:40.265583 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:48:40.265583 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:48:40.265583 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 635/1271] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 28 00:48:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:48:40.270267 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d8ede2-2e9f-4b62-b45c-21ca77090780 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:40.330770 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:40.374553 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d8ede2-2e9f-4b62-b45c-21ca77090780 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:40.409763 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dafa30-6308-4891-9fa7-00a11b4d55ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:40.410521 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dafa30-6308-4891-9fa7-00a11b4d55ef None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:40.410789 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dafa30-6308-4891-9fa7-00a11b4d55ef None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:40.411058 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dafa30-6308-4891-9fa7-00a11b4d55ef None admin] PATH_INFO: `/v3/projects` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:40.411797 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dafa30-6308-4891-9fa7-00a11b4d55ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:48:40.412101 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dafa30-6308-4891-9fa7-00a11b4d55ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:40.413561 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dafa30-6308-4891-9fa7-00a11b4d55ef None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:40.425891 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 637/1272] 10.222.0.49 () {56 vars in 1148 bytes} [Sun Aug 28 00:48:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:48:40.432161 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40848663-63d9-4b15-9b32-6654745594f7 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:40.529167 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:40.538517 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40848663-63d9-4b15-9b32-6654745594f7 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:40.575844 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63645c1d-9538-4446-8389-16adf6ff903f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:40.576588 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63645c1d-9538-4446-8389-16adf6ff903f None admin] REQUEST_METHOD: `PUT` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:40.576870 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63645c1d-9538-4446-8389-16adf6ff903f None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:40.577137 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63645c1d-9538-4446-8389-16adf6ff903f None admin] PATH_INFO: `/v3/projects/6d6e897c6391486e9c44e9277a3ee823/users/8f4fc1d11f5641b0b5f301b234282aa9/roles/2e4889bb71f9434392c0baba59f2534e` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:40.579432 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63645c1d-9538-4446-8389-16adf6ff903f None admin] RBAC: Authorizing `identity:create_grant(project_id=6d6e897c6391486e9c44e9277a3ee823, user_id=8f4fc1d11f5641b0b5f301b234282aa9, role_id=2e4889bb71f9434392c0baba59f2534e)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:40.580960 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63645c1d-9538-4446-8389-16adf6ff903f None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:40.595404 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 636/1273] 10.222.0.49 () {58 vars in 1439 bytes} [Sun Aug 28 00:48:40 2022] PUT /identity/v3/projects/6d6e897c6391486e9c44e9277a3ee823/users/8f4fc1d11f5641b0b5f301b234282aa9/roles/2e4889bb71f9434392c0baba59f2534e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:48:42.484996 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6b99c-0e0b-48ae-8f90-e992ce607804 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:42.485570 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6b99c-0e0b-48ae-8f90-e992ce607804 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:42.485570 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6b99c-0e0b-48ae-8f90-e992ce607804 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:42.486889 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 638/1274] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:48:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:48:42.492707 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64bacdf-884a-4e70-a985-e207cadc5e59 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:42.493274 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64bacdf-884a-4e70-a985-e207cadc5e59 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:42.493274 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64bacdf-884a-4e70-a985-e207cadc5e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:42.512533 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-b64bacdf-884a-4e70-a985-e207cadc5e59 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:48:42.513726 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-b64bacdf-884a-4e70-a985-e207cadc5e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:42.590949 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 637/1275] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:48:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:48:42.858925 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e6b99c-0e0b-48ae-8f90-e992ce607804 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:42.970568 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e6b99c-0e0b-48ae-8f90-e992ce607804 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:42.989255 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:43.008272 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1650d916-cc4d-4fab-9598-7f870317a73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:43.008912 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650d916-cc4d-4fab-9598-7f870317a73a None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:43.009184 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650d916-cc4d-4fab-9598-7f870317a73a None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:43.009461 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650d916-cc4d-4fab-9598-7f870317a73a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:43.020173 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1650d916-cc4d-4fab-9598-7f870317a73a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 28 00:48:43.025011 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-1650d916-cc4d-4fab-9598-7f870317a73a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:48:43.025011 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:48:43.025011 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:48:43.025011 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:48:43.025011 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:48:43.025011 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:48:43.025011 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:48:43.025011 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:48:43.025011 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:48:43.025011 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:48:43.025011 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:48:43.025011 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:48:43.025011 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 28 00:48:43.025011 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 28 00:48:43.025011 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 28 00:48:43.025011 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 28 00:48:43.026101 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 28 00:48:43.026101 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 28 00:48:43.026101 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 28 00:48:43.026101 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 28 00:48:43.026101 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:48:43.026101 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:48:43.026101 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:48:43.026101 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:48:43.026101 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:48:43.026101 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:48:43.026101 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:48:43.026101 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:48:43.026101 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:48:43.026101 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:48:43.026101 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:48:43.026101 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:48:43.027353 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:48:43.027353 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:48:43.027353 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:48:43.027353 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:48:43.027353 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 28 00:48:43.027353 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 28 00:48:43.027353 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 28 00:48:43.027353 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 28 00:48:43.027353 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 28 00:48:43.027353 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 28 00:48:43.027353 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 28 00:48:43.027353 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:48:43.027353 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 639/1276] 10.222.0.49 () {56 vars in 1096 bytes} [Sun Aug 28 00:48:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:48:43.032344 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64bacdf-884a-4e70-a985-e207cadc5e59 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:43.115767 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:43.136755 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64bacdf-884a-4e70-a985-e207cadc5e59 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:43.173261 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b4589-9217-467d-b034-d0fe2a4a4926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:43.173866 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b4589-9217-467d-b034-d0fe2a4a4926 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:43.174143 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b4589-9217-467d-b034-d0fe2a4a4926 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:43.174409 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b4589-9217-467d-b034-d0fe2a4a4926 None admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:43.175083 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b4589-9217-467d-b034-d0fe2a4a4926 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:48:43.175388 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b4589-9217-467d-b034-d0fe2a4a4926 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:43.176786 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b4589-9217-467d-b034-d0fe2a4a4926 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:43.185204 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 638/1277] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 28 00:48:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:48:43.192302 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1650d916-cc4d-4fab-9598-7f870317a73a None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:43.307058 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1650d916-cc4d-4fab-9598-7f870317a73a None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:43.345597 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64837e81-5f74-4dd7-8634-233ec3891745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:43.346225 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64837e81-5f74-4dd7-8634-233ec3891745 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:43.346494 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64837e81-5f74-4dd7-8634-233ec3891745 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:43.346763 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64837e81-5f74-4dd7-8634-233ec3891745 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:43.357622 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64837e81-5f74-4dd7-8634-233ec3891745 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:43.359081 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64837e81-5f74-4dd7-8634-233ec3891745 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:43.374153 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-64837e81-5f74-4dd7-8634-233ec3891745 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:48:43.374153 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:48:43.374153 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:48:43.374153 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:48:43.374153 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:48:43.374153 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:48:43.374153 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:48:43.374153 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:48:43.374153 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:48:43.374153 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:48:43.374153 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:48:43.374153 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:48:43.374153 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:48:43.374153 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:48:43.374153 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:48:43.374153 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:48:43.375342 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:48:43.375342 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:48:43.375342 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:48:43.375342 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:48:43.375342 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:48:43.375342 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:48:43.375342 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:48:43.375342 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:48:43.375342 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:48:43.375342 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:48:43.375342 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:48:43.375342 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:48:43.375342 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:48:43.375342 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:48:43.375342 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:48:43.375342 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:48:43.375342 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:48:43.376396 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:48:43.376396 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:48:43.376396 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:48:43.376396 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 640/1278] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:48:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:48:43.381464 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b4589-9217-467d-b034-d0fe2a4a4926 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:43.498455 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b4589-9217-467d-b034-d0fe2a4a4926 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:43.532743 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe85d43-a254-4f1d-a10b-ee7ea7213db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:43.533341 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe85d43-a254-4f1d-a10b-ee7ea7213db9 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:43.533617 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe85d43-a254-4f1d-a10b-ee7ea7213db9 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:43.533878 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe85d43-a254-4f1d-a10b-ee7ea7213db9 None admin] PATH_INFO: `/v3/domains` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:43.534537 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe85d43-a254-4f1d-a10b-ee7ea7213db9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:48:43.534833 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe85d43-a254-4f1d-a10b-ee7ea7213db9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:43.536264 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe85d43-a254-4f1d-a10b-ee7ea7213db9 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:43.548665 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 639/1279] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:48:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:48:43.554756 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64837e81-5f74-4dd7-8634-233ec3891745 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:43.587384 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:43.663082 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64837e81-5f74-4dd7-8634-233ec3891745 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:43.698844 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab7db6-da9e-4c29-99fa-a47171fe24c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:43.699472 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab7db6-da9e-4c29-99fa-a47171fe24c6 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:43.699761 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab7db6-da9e-4c29-99fa-a47171fe24c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:43.700035 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab7db6-da9e-4c29-99fa-a47171fe24c6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:43.708494 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cab7db6-da9e-4c29-99fa-a47171fe24c6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:43.709935 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cab7db6-da9e-4c29-99fa-a47171fe24c6 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:43.721557 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-7cab7db6-da9e-4c29-99fa-a47171fe24c6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 28 00:48:43.721557 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:48:43.721557 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:48:43.721557 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:48:43.721557 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:48:43.721557 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:48:43.721557 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:48:43.721557 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:48:43.721557 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:48:43.721557 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:48:43.721557 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:48:43.721557 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:48:43.721557 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 28 00:48:43.721557 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 28 00:48:43.721557 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 28 00:48:43.721557 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 28 00:48:43.722653 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:48:43.722653 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:48:43.722653 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 28 00:48:43.722653 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:48:43.722653 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 28 00:48:43.722653 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 28 00:48:43.722653 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:48:43.722653 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:48:43.722653 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:48:43.722653 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:48:43.722653 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:48:43.722653 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:48:43.722653 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:48:43.722653 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:48:43.722653 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:48:43.722653 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:48:43.722653 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:48:43.722653 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:48:43.723632 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:48:43.723632 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:48:43.723632 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 28 00:48:43.723632 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 28 00:48:43.723632 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 28 00:48:43.723632 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 28 00:48:43.723632 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 28 00:48:43.723632 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 28 00:48:43.723632 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 28 00:48:43.723632 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:48:43.723632 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 641/1280] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:48:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:48:43.728809 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe85d43-a254-4f1d-a10b-ee7ea7213db9 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:43.732866 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:43.833292 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe85d43-a254-4f1d-a10b-ee7ea7213db9 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:43.868896 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502cc4c5-4d0b-477c-8b9e-183fe5bece8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:43.869502 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502cc4c5-4d0b-477c-8b9e-183fe5bece8d None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:43.869788 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502cc4c5-4d0b-477c-8b9e-183fe5bece8d None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:43.870058 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502cc4c5-4d0b-477c-8b9e-183fe5bece8d None admin] PATH_INFO: `/v3/users` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:43.870794 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502cc4c5-4d0b-477c-8b9e-183fe5bece8d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:48:43.871104 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502cc4c5-4d0b-477c-8b9e-183fe5bece8d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:43.872564 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502cc4c5-4d0b-477c-8b9e-183fe5bece8d None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:43.891627 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 640/1281] 10.222.0.49 () {56 vars in 1143 bytes} [Sun Aug 28 00:48:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:48:43.897939 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab7db6-da9e-4c29-99fa-a47171fe24c6 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:43.992151 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:44.004713 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab7db6-da9e-4c29-99fa-a47171fe24c6 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:44.040804 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0c32d8-f53e-40bb-aed4-a4b8f4db105f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:44.041410 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c32d8-f53e-40bb-aed4-a4b8f4db105f None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:44.041684 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c32d8-f53e-40bb-aed4-a4b8f4db105f None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:44.041951 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c32d8-f53e-40bb-aed4-a4b8f4db105f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:44.114841 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0c32d8-f53e-40bb-aed4-a4b8f4db105f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:44.116416 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0c32d8-f53e-40bb-aed4-a4b8f4db105f None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:44.218873 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:44.230038 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 642/1282] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 28 00:48:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 28 00:48:44.235973 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502cc4c5-4d0b-477c-8b9e-183fe5bece8d None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:44.298332 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:44.337271 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502cc4c5-4d0b-477c-8b9e-183fe5bece8d None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:44.371363 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bbe535-0ebc-4740-ab0a-377b6976e49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:44.372003 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bbe535-0ebc-4740-ab0a-377b6976e49c None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:44.372281 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bbe535-0ebc-4740-ab0a-377b6976e49c None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:44.372550 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bbe535-0ebc-4740-ab0a-377b6976e49c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:44.383335 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bbe535-0ebc-4740-ab0a-377b6976e49c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:44.384818 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bbe535-0ebc-4740-ab0a-377b6976e49c None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:44.400386 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-04bbe535-0ebc-4740-ab0a-377b6976e49c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:48:44.400386 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:48:44.400386 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:48:44.400386 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:48:44.400386 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:48:44.400386 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:48:44.400386 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:48:44.400386 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:48:44.400386 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:48:44.400386 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:48:44.400386 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:48:44.400386 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:48:44.400386 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 28 00:48:44.400386 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 28 00:48:44.400386 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 28 00:48:44.400386 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 28 00:48:44.401484 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:48:44.401484 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:48:44.401484 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:48:44.401484 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:48:44.401484 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:48:44.401484 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:48:44.401484 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:48:44.401484 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:48:44.401484 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:48:44.401484 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:48:44.401484 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:48:44.401484 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:48:44.401484 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:48:44.401484 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:48:44.401484 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:48:44.401484 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:48:44.401484 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 28 00:48:44.402403 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 28 00:48:44.402403 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 28 00:48:44.402403 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:48:44.402403 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 641/1283] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:48:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:48:44.407432 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0c32d8-f53e-40bb-aed4-a4b8f4db105f None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:44.511938 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0c32d8-f53e-40bb-aed4-a4b8f4db105f None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:44.547181 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec82a8-d07d-4f51-b4fb-8db53afdbd0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:44.547813 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec82a8-d07d-4f51-b4fb-8db53afdbd0c None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:44.548088 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec82a8-d07d-4f51-b4fb-8db53afdbd0c None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:44.548416 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec82a8-d07d-4f51-b4fb-8db53afdbd0c None admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:44.548984 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fec82a8-d07d-4f51-b4fb-8db53afdbd0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:48:44.549277 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fec82a8-d07d-4f51-b4fb-8db53afdbd0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:44.550646 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fec82a8-d07d-4f51-b4fb-8db53afdbd0c None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:44.562298 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 643/1284] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 28 00:48:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:48:44.568282 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bbe535-0ebc-4740-ab0a-377b6976e49c None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:44.669355 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bbe535-0ebc-4740-ab0a-377b6976e49c None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:44.683218 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:44.707098 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39206b03-36bf-40a2-995b-68fa854b0368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:44.707754 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39206b03-36bf-40a2-995b-68fa854b0368 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:44.708017 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39206b03-36bf-40a2-995b-68fa854b0368 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:44.708286 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39206b03-36bf-40a2-995b-68fa854b0368 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:44.714990 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39206b03-36bf-40a2-995b-68fa854b0368 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:44.716584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39206b03-36bf-40a2-995b-68fa854b0368 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:44.728272 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application [None req-39206b03-36bf-40a2-995b-68fa854b0368 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:48:44.728272 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:48:44.728272 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:48:44.728272 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:48:44.728272 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:48:44.728272 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:48:44.728272 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:48:44.728272 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:48:44.728272 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:48:44.728272 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:48:44.728272 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:48:44.728272 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:48:44.728272 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 28 00:48:44.728272 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 28 00:48:44.728272 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 28 00:48:44.729211 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 28 00:48:44.729211 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:48:44.729211 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:48:44.729211 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:48:44.729211 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:48:44.729211 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:48:44.729211 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:48:44.729211 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:48:44.729211 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application with Lock( Aug 28 00:48:44.729211 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:48:44.729211 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:48:44.729211 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:48:44.729211 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:48:44.729211 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:48:44.729211 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:48:44.729211 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:48:44.729211 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:48:44.730134 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 28 00:48:44.730134 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 28 00:48:44.730134 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 28 00:48:44.730134 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 28 00:48:44.730134 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 28 00:48:44.730134 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 28 00:48:44.730134 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 28 00:48:44.730134 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: ERROR keystone.server.flask.application Aug 28 00:48:44.730134 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 642/1285] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 28 00:48:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:48:44.735556 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec82a8-d07d-4f51-b4fb-8db53afdbd0c None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:44.788169 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:44.841741 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec82a8-d07d-4f51-b4fb-8db53afdbd0c None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:44.877435 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e528e0-1c49-48ed-a79f-d9a13f0c53f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:44.878040 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e528e0-1c49-48ed-a79f-d9a13f0c53f1 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:44.878319 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e528e0-1c49-48ed-a79f-d9a13f0c53f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:44.878589 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e528e0-1c49-48ed-a79f-d9a13f0c53f1 None admin] PATH_INFO: `/v3/projects` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:44.879342 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e528e0-1c49-48ed-a79f-d9a13f0c53f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:48:44.879645 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e528e0-1c49-48ed-a79f-d9a13f0c53f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:44.881121 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e528e0-1c49-48ed-a79f-d9a13f0c53f1 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:44.894223 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 644/1286] 10.222.0.49 () {56 vars in 1148 bytes} [Sun Aug 28 00:48:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:48:44.900629 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39206b03-36bf-40a2-995b-68fa854b0368 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:45.013689 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39206b03-36bf-40a2-995b-68fa854b0368 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:45.049582 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12241512-6241-4e0a-a5ea-8cb81cf1bf15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:45.050178 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12241512-6241-4e0a-a5ea-8cb81cf1bf15 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:45.050454 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12241512-6241-4e0a-a5ea-8cb81cf1bf15 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:45.050713 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12241512-6241-4e0a-a5ea-8cb81cf1bf15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:45.051517 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12241512-6241-4e0a-a5ea-8cb81cf1bf15 None admin] RBAC: Adding query filter params (role.id=2e4889bb71f9434392c0baba59f2534e, scope.project.id=6d6e897c6391486e9c44e9277a3ee823, user.id=8f4fc1d11f5641b0b5f301b234282aa9) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:48:45.051859 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12241512-6241-4e0a-a5ea-8cb81cf1bf15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:45.053292 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12241512-6241-4e0a-a5ea-8cb81cf1bf15 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:45.059489 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 643/1287] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 28 00:48:44 2022] GET /identity/v3/role_assignments?user.id=8f4fc1d11f5641b0b5f301b234282aa9&scope.project.id=6d6e897c6391486e9c44e9277a3ee823&role.id=2e4889bb71f9434392c0baba59f2534e => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:48:46.967972 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be697c46-e21c-4d44-8e60-980d393cdcb8 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:46.968681 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be697c46-e21c-4d44-8e60-980d393cdcb8 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:46.968681 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be697c46-e21c-4d44-8e60-980d393cdcb8 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:46.970192 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 645/1288] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:48:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:48:46.976157 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b138f-5221-401c-b2ed-257234729d77 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:46.976621 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b138f-5221-401c-b2ed-257234729d77 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:46.976621 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b138f-5221-401c-b2ed-257234729d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:46.995816 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-204b138f-5221-401c-b2ed-257234729d77 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:48:46.996991 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-204b138f-5221-401c-b2ed-257234729d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:47.028495 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:47.071639 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 644/1289] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:48:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:48:47.351729 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be697c46-e21c-4d44-8e60-980d393cdcb8 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:47.464769 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be697c46-e21c-4d44-8e60-980d393cdcb8 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:47.475892 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:47.501039 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0482d0d1-424b-408d-8a98-7f1aacce8eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:47.501677 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0482d0d1-424b-408d-8a98-7f1aacce8eff None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:47.501952 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0482d0d1-424b-408d-8a98-7f1aacce8eff None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:47.502217 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0482d0d1-424b-408d-8a98-7f1aacce8eff None admin] PATH_INFO: `/v3/services/placement` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:47.502780 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0482d0d1-424b-408d-8a98-7f1aacce8eff None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:47.504267 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0482d0d1-424b-408d-8a98-7f1aacce8eff None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:47.513194 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-0482d0d1-424b-408d-8a98-7f1aacce8eff None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 28 00:48:47.513194 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:48:47.513194 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:48:47.513194 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:48:47.513194 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:48:47.513194 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:48:47.513194 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:48:47.513194 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:48:47.513194 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 28 00:48:47.513194 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:48:47.513194 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:48:47.513194 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:48:47.513194 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:48:47.513194 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:48:47.513194 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:48:47.513194 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:48:47.513194 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:48:47.514398 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:48:47.514398 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:48:47.514398 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:48:47.514398 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:48:47.514398 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:48:47.514398 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:48:47.514398 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:48:47.514398 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:48:47.514398 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:48:47.514398 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:48:47.514398 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:48:47.514398 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:48:47.514398 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:48:47.514398 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:48:47.514398 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:48:47.514398 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:48:47.515286 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:48:47.515286 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:48:47.515286 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:48:47.515286 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:48:47.515286 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:48:47.515286 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:48:47.515286 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:48:47.515286 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:48:47.515286 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:48:47.515286 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:48:47.515286 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:48:47.515286 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:48:47.515286 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 28 00:48:47.515286 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:48:47.515286 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 646/1290] 10.222.0.49 () {56 vars in 1117 bytes} [Sun Aug 28 00:48:47 2022] GET /identity/v3/services/placement => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:48:47.520737 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204b138f-5221-401c-b2ed-257234729d77 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:47.623053 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204b138f-5221-401c-b2ed-257234729d77 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:47.656734 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63d4a95-9dfb-4d72-8812-9f46d0133da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:47.657338 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d4a95-9dfb-4d72-8812-9f46d0133da2 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:47.657613 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d4a95-9dfb-4d72-8812-9f46d0133da2 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:47.657877 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63d4a95-9dfb-4d72-8812-9f46d0133da2 None admin] PATH_INFO: `/v3/services` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:47.658508 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63d4a95-9dfb-4d72-8812-9f46d0133da2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:48:47.658802 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63d4a95-9dfb-4d72-8812-9f46d0133da2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:47.660260 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63d4a95-9dfb-4d72-8812-9f46d0133da2 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:47.665348 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 645/1291] 10.222.0.49 () {56 vars in 1116 bytes} [Sun Aug 28 00:48:47 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:48:47.671355 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0482d0d1-424b-408d-8a98-7f1aacce8eff None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:47.781482 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0482d0d1-424b-408d-8a98-7f1aacce8eff None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:47.817972 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fd8995-6aa2-460e-a36d-818311a05923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:47.818613 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd8995-6aa2-460e-a36d-818311a05923 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:47.818863 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd8995-6aa2-460e-a36d-818311a05923 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:47.819128 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd8995-6aa2-460e-a36d-818311a05923 None admin] PATH_INFO: `/v3/services` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:47.819798 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fd8995-6aa2-460e-a36d-818311a05923 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:48:47.820100 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fd8995-6aa2-460e-a36d-818311a05923 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:47.821519 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fd8995-6aa2-460e-a36d-818311a05923 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:47.826256 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 647/1292] 10.222.0.49 () {56 vars in 1116 bytes} [Sun Aug 28 00:48:47 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:48:49.706790 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea9830-ad41-4507-82e5-d6974ee343b8 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:49.707447 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea9830-ad41-4507-82e5-d6974ee343b8 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:49.707447 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea9830-ad41-4507-82e5-d6974ee343b8 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:49.708781 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 646/1293] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:48:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:48:49.715416 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ebf6a-8ae1-43db-8817-3dea3790c1ca None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:49.716251 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ebf6a-8ae1-43db-8817-3dea3790c1ca None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:49.716251 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ebf6a-8ae1-43db-8817-3dea3790c1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:49.744529 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-544ebf6a-8ae1-43db-8817-3dea3790c1ca None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:48:49.745737 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-544ebf6a-8ae1-43db-8817-3dea3790c1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:49.777164 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:49.822586 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 648/1294] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:48:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:48:50.087136 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ea9830-ad41-4507-82e5-d6974ee343b8 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:50.119110 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:50.191741 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ea9830-ad41-4507-82e5-d6974ee343b8 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:50.240155 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33b3be-2dba-44dd-b9a1-05945507d8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:50.240813 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33b3be-2dba-44dd-b9a1-05945507d8a8 None admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:50.241095 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33b3be-2dba-44dd-b9a1-05945507d8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:50.241398 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33b3be-2dba-44dd-b9a1-05945507d8a8 None admin] PATH_INFO: `/v3/services` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:50.242137 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a33b3be-2dba-44dd-b9a1-05945507d8a8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:50.243850 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a33b3be-2dba-44dd-b9a1-05945507d8a8 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:50.263327 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 647/1295] 10.222.0.49 () {60 vars in 1141 bytes} [Sun Aug 28 00:48:50 2022] POST /identity/v3/services => generated 246 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:48:52.175252 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3269dea-ee7f-4ac2-91a3-873798479938 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:52.175836 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3269dea-ee7f-4ac2-91a3-873798479938 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:52.175836 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3269dea-ee7f-4ac2-91a3-873798479938 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:52.177105 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 649/1296] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:48:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:48:52.182661 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de96ddd-6e01-4ca6-99e3-3a6ccf948fc0 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:52.183092 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de96ddd-6e01-4ca6-99e3-3a6ccf948fc0 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:52.183180 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de96ddd-6e01-4ca6-99e3-3a6ccf948fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:52.204608 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-2de96ddd-6e01-4ca6-99e3-3a6ccf948fc0 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:48:52.205795 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-2de96ddd-6e01-4ca6-99e3-3a6ccf948fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:52.281692 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 648/1297] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:48:52 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:48:52.540105 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3269dea-ee7f-4ac2-91a3-873798479938 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:52.647458 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3269dea-ee7f-4ac2-91a3-873798479938 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:52.682500 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5d34f5-8987-49f2-8d14-39d153205538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:52.683121 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d34f5-8987-49f2-8d14-39d153205538 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:52.683401 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d34f5-8987-49f2-8d14-39d153205538 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:52.683694 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d34f5-8987-49f2-8d14-39d153205538 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:52.684276 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5d34f5-8987-49f2-8d14-39d153205538 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:52.685644 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5d34f5-8987-49f2-8d14-39d153205538 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:52.694847 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-cb5d34f5-8987-49f2-8d14-39d153205538 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 28 00:48:52.694847 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:48:52.694847 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:48:52.694847 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:48:52.694847 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:48:52.694847 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:48:52.694847 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:48:52.694847 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:48:52.694847 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 28 00:48:52.694847 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:48:52.694847 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:48:52.694847 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:48:52.694847 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:48:52.694847 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:48:52.694847 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:48:52.694847 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:48:52.694847 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:48:52.696023 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:48:52.696023 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:48:52.696023 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:48:52.696023 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:48:52.696023 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:48:52.696023 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:48:52.696023 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:48:52.696023 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:48:52.696023 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:48:52.696023 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:48:52.696023 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:48:52.696023 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:48:52.696023 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:48:52.696023 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:48:52.696023 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:48:52.696023 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:48:52.696962 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:48:52.696962 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:48:52.696962 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:48:52.696962 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:48:52.696962 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:48:52.696962 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:48:52.696962 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:48:52.696962 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:48:52.696962 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:48:52.696962 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:48:52.696962 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:48:52.696962 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:48:52.696962 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 28 00:48:52.696962 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:48:52.696962 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 650/1298] 10.222.0.49 () {56 vars in 1117 bytes} [Sun Aug 28 00:48:52 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:48:52.702214 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de96ddd-6e01-4ca6-99e3-3a6ccf948fc0 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:52.722984 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:52.818119 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de96ddd-6e01-4ca6-99e3-3a6ccf948fc0 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:52.860253 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852fd23e-ec2e-4adc-85a9-43a7df5b2372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:52.861034 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852fd23e-ec2e-4adc-85a9-43a7df5b2372 None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:52.861408 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852fd23e-ec2e-4adc-85a9-43a7df5b2372 None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:52.861779 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852fd23e-ec2e-4adc-85a9-43a7df5b2372 None admin] PATH_INFO: `/v3/services` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:52.862732 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852fd23e-ec2e-4adc-85a9-43a7df5b2372 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:48:52.863226 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852fd23e-ec2e-4adc-85a9-43a7df5b2372 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:52.864614 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852fd23e-ec2e-4adc-85a9-43a7df5b2372 None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:52.870065 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 649/1299] 10.222.0.49 () {56 vars in 1116 bytes} [Sun Aug 28 00:48:52 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:48:52.876591 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5d34f5-8987-49f2-8d14-39d153205538 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:52.910670 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:52.994009 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5d34f5-8987-49f2-8d14-39d153205538 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:53.029386 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf1d92d-96fe-4929-a61a-e648233a4da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:53.030020 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf1d92d-96fe-4929-a61a-e648233a4da3 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:53.030310 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf1d92d-96fe-4929-a61a-e648233a4da3 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:53.030571 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf1d92d-96fe-4929-a61a-e648233a4da3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:53.031275 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf1d92d-96fe-4929-a61a-e648233a4da3 None admin] RBAC: Adding query filter params (interface=public, service_id=7a15d8c37e344bd0b778b5938cabb535, region_id=RegionOne) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:48:53.031577 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf1d92d-96fe-4929-a61a-e648233a4da3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:53.032990 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf1d92d-96fe-4929-a61a-e648233a4da3 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:53.038199 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 651/1300] 10.222.0.49 () {56 vars in 1251 bytes} [Sun Aug 28 00:48:52 2022] GET /identity/v3/endpoints?service_id=7a15d8c37e344bd0b778b5938cabb535&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:48:53.044340 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852fd23e-ec2e-4adc-85a9-43a7df5b2372 None admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:53.130067 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:53.150311 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852fd23e-ec2e-4adc-85a9-43a7df5b2372 None admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:53.185629 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b59d3-8f59-460e-abe7-bf5474ff9b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:53.186327 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b59d3-8f59-460e-abe7-bf5474ff9b8a None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:53.186504 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b59d3-8f59-460e-abe7-bf5474ff9b8a None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:53.186770 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b59d3-8f59-460e-abe7-bf5474ff9b8a None admin] PATH_INFO: `/v3/services` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:53.187381 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7b59d3-8f59-460e-abe7-bf5474ff9b8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:53.188787 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7b59d3-8f59-460e-abe7-bf5474ff9b8a None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:53.196278 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 650/1301] 10.222.0.49 () {56 vars in 1087 bytes} [Sun Aug 28 00:48:53 2022] GET /identity/v3/services => generated 2191 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:48:55.070438 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c9ed6-fc61-4acf-9626-a27b5f477ff6 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:55.070968 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c9ed6-fc61-4acf-9626-a27b5f477ff6 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:55.070968 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c9ed6-fc61-4acf-9626-a27b5f477ff6 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:55.072271 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 652/1302] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:48:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:48:55.077810 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e16a7a-5738-451e-af27-fd4cc4ef7a43 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:55.078553 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e16a7a-5738-451e-af27-fd4cc4ef7a43 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:55.078644 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e16a7a-5738-451e-af27-fd4cc4ef7a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:55.097336 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-95e16a7a-5738-451e-af27-fd4cc4ef7a43 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:48:55.098533 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-95e16a7a-5738-451e-af27-fd4cc4ef7a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:48:55.170487 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 651/1303] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:48:55 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 28 00:48:55.432348 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19c9ed6-fc61-4acf-9626-a27b5f477ff6 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:55.536064 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:55.543614 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19c9ed6-fc61-4acf-9626-a27b5f477ff6 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:55.578489 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df518fd-9e59-4db1-b821-45861abe7502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:55.579110 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df518fd-9e59-4db1-b821-45861abe7502 None admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:55.579382 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df518fd-9e59-4db1-b821-45861abe7502 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:55.579646 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df518fd-9e59-4db1-b821-45861abe7502 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:55.580256 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df518fd-9e59-4db1-b821-45861abe7502 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:55.581683 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df518fd-9e59-4db1-b821-45861abe7502 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:55.590456 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application [None req-5df518fd-9e59-4db1-b821-45861abe7502 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 28 00:48:55.590456 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:48:55.590456 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 28 00:48:55.590456 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 28 00:48:55.590456 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 28 00:48:55.590456 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 28 00:48:55.590456 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 28 00:48:55.590456 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:48:55.590456 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 28 00:48:55.590456 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:48:55.590456 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 28 00:48:55.590456 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:48:55.590456 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 28 00:48:55.590456 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 28 00:48:55.590456 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 28 00:48:55.590456 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 28 00:48:55.590456 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 28 00:48:55.591713 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 28 00:48:55.591713 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 28 00:48:55.591713 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 28 00:48:55.591713 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 28 00:48:55.591713 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 28 00:48:55.591713 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 28 00:48:55.591713 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 28 00:48:55.591713 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 28 00:48:55.591713 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 28 00:48:55.591713 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 28 00:48:55.591713 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 28 00:48:55.591713 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 28 00:48:55.591713 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 28 00:48:55.591713 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 28 00:48:55.591713 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 28 00:48:55.591713 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.get_or_create( Aug 28 00:48:55.592782 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 28 00:48:55.592782 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application with Lock( Aug 28 00:48:55.592782 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 28 00:48:55.592782 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self._enter() Aug 28 00:48:55.592782 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 28 00:48:55.592782 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 28 00:48:55.592782 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 28 00:48:55.592782 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application return self.creator() Aug 28 00:48:55.592782 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 28 00:48:55.592782 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application created_value = creator( Aug 28 00:48:55.592782 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 28 00:48:55.592782 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 28 00:48:55.592782 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 28 00:48:55.592782 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: ERROR keystone.server.flask.application Aug 28 00:48:55.592782 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 653/1304] 10.222.0.49 () {56 vars in 1117 bytes} [Sun Aug 28 00:48:55 2022] GET /identity/v3/services/placement => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 28 00:48:55.598116 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e16a7a-5738-451e-af27-fd4cc4ef7a43 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:55.677143 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:48:55.701873 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e16a7a-5738-451e-af27-fd4cc4ef7a43 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:55.739198 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf8fdfa-b7bb-4470-9f6e-0d624cd42b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:55.739839 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8fdfa-b7bb-4470-9f6e-0d624cd42b0a None admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:55.740115 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8fdfa-b7bb-4470-9f6e-0d624cd42b0a None admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:55.740381 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8fdfa-b7bb-4470-9f6e-0d624cd42b0a None admin] PATH_INFO: `/v3/services` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:55.741041 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf8fdfa-b7bb-4470-9f6e-0d624cd42b0a None admin] RBAC: Adding query filter params (name=placement) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:48:55.741336 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf8fdfa-b7bb-4470-9f6e-0d624cd42b0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:55.742694 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf8fdfa-b7bb-4470-9f6e-0d624cd42b0a None admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:55.747920 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 652/1305] 10.222.0.49 () {56 vars in 1116 bytes} [Sun Aug 28 00:48:55 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:48:55.753814 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df518fd-9e59-4db1-b821-45861abe7502 None admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:48:55.864451 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df518fd-9e59-4db1-b821-45861abe7502 None admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:48:55.899038 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca9c2e-a5d5-4615-be32-baca2e893784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:48:55.899624 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca9c2e-a5d5-4615-be32-baca2e893784 None admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:48:55.899925 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca9c2e-a5d5-4615-be32-baca2e893784 None admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:48:55.900189 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca9c2e-a5d5-4615-be32-baca2e893784 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:48:55.900855 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aca9c2e-a5d5-4615-be32-baca2e893784 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:48:55.902218 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aca9c2e-a5d5-4615-be32-baca2e893784 None admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:48:55.924081 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 654/1306] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 00:48:55 2022] POST /identity/v3/endpoints => generated 331 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:49:05.744793 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=30 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:49:05.919187 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:00.869306 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca06989-e84c-4493-bca7-59345e6dc961 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:00.870345 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca06989-e84c-4493-bca7-59345e6dc961 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:00.870816 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca06989-e84c-4493-bca7-59345e6dc961 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:00.878329 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c2cf9a-65fa-43ed-a244-8449101bca6e None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:00.879331 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c2cf9a-65fa-43ed-a244-8449101bca6e None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:00.879833 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c2cf9a-65fa-43ed-a244-8449101bca6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:00.882443 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 653/1307] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:50:00 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:50:00.966113 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-38c2cf9a-65fa-43ed-a244-8449101bca6e None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:50:00.967495 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-38c2cf9a-65fa-43ed-a244-8449101bca6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:50:01.093896 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 655/1308] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:50:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:50:01.390806 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b44c5-abd6-4669-8a89-2df0f00b26ba None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:01.391110 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b44c5-abd6-4669-8a89-2df0f00b26ba None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:01.391344 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b44c5-abd6-4669-8a89-2df0f00b26ba None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:01.393034 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 654/1309] 10.222.0.49 () {54 vars in 965 bytes} [Sun Aug 28 00:50:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:50:01.400119 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e0714-2cc3-40d5-a086-18da9724e287 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:01.400459 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e0714-2cc3-40d5-a086-18da9724e287 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:01.400783 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e0714-2cc3-40d5-a086-18da9724e287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:01.499242 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-e02e0714-2cc3-40d5-a086-18da9724e287 None None] MFA Rules not processed for user `2d14dcd0cb25427291ab8831924184e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:50:01.500503 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-e02e0714-2cc3-40d5-a086-18da9724e287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:50:01.532932 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:01.604693 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 656/1310] 10.222.0.49 () {58 vars in 1062 bytes} [Sun Aug 28 00:50:01 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:50:01.614674 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b44c5-abd6-4669-8a89-2df0f00b26ba None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:01.617742 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-086b44c5-abd6-4669-8a89-2df0f00b26ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:50:01.766794 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b44c5-abd6-4669-8a89-2df0f00b26ba None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:01.864683 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8e3e59-a94e-463e-ad64-ae1e8257cad0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:01.865519 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e3e59-a94e-463e-ad64-ae1e8257cad0 service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:01.865867 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e3e59-a94e-463e-ad64-ae1e8257cad0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:01.866139 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e3e59-a94e-463e-ad64-ae1e8257cad0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:01.867947 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-1e8e3e59-a94e-463e-ad64-ae1e8257cad0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:50:01.958425 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:02.055840 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8e3e59-a94e-463e-ad64-ae1e8257cad0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:02.057325 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8e3e59-a94e-463e-ad64-ae1e8257cad0 service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:02.083165 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 655/1311] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:50:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 00:50:04.414433 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f435f13e-2873-446f-b105-208392fafb2d None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:04.415053 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f435f13e-2873-446f-b105-208392fafb2d None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:04.415053 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f435f13e-2873-446f-b105-208392fafb2d None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:04.416790 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 657/1312] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:50:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:50:04.422800 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626cf1b-60cf-4de7-8772-d71ef67d2e81 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:04.423325 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626cf1b-60cf-4de7-8772-d71ef67d2e81 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:04.423325 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626cf1b-60cf-4de7-8772-d71ef67d2e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:04.517676 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-2626cf1b-60cf-4de7-8772-d71ef67d2e81 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:50:04.518906 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-2626cf1b-60cf-4de7-8772-d71ef67d2e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:50:04.643819 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 656/1313] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:50:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:50:04.939725 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eaa802-29d6-40b7-9c0a-6709fa85525a None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:04.940015 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eaa802-29d6-40b7-9c0a-6709fa85525a None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:04.940289 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eaa802-29d6-40b7-9c0a-6709fa85525a None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:04.941640 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 658/1314] 10.222.0.49 () {54 vars in 965 bytes} [Sun Aug 28 00:50:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:50:04.948174 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faba0a5-21e2-420a-82e9-94eb68eac546 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:04.948559 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faba0a5-21e2-420a-82e9-94eb68eac546 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:04.948929 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faba0a5-21e2-420a-82e9-94eb68eac546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:04.961483 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:05.030826 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-7faba0a5-21e2-420a-82e9-94eb68eac546 None None] MFA Rules not processed for user `2d14dcd0cb25427291ab8831924184e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:50:05.032061 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-7faba0a5-21e2-420a-82e9-94eb68eac546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:50:05.111219 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 657/1315] 10.222.0.49 () {58 vars in 1062 bytes} [Sun Aug 28 00:50:04 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:50:05.125683 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eaa802-29d6-40b7-9c0a-6709fa85525a None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:05.127362 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-a6eaa802-29d6-40b7-9c0a-6709fa85525a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:50:05.236146 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eaa802-29d6-40b7-9c0a-6709fa85525a None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:05.310210 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:05.314289 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0e76a0-153b-4d05-a4e1-7f13ae2ae397 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:05.314855 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e76a0-153b-4d05-a4e1-7f13ae2ae397 service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:05.315138 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e76a0-153b-4d05-a4e1-7f13ae2ae397 service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:05.315411 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e76a0-153b-4d05-a4e1-7f13ae2ae397 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:05.317667 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-1b0e76a0-153b-4d05-a4e1-7f13ae2ae397 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:50:05.436189 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0e76a0-153b-4d05-a4e1-7f13ae2ae397 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:05.437646 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0e76a0-153b-4d05-a4e1-7f13ae2ae397 service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:05.457940 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 659/1316] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:50:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:50:07.907821 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840519fc-a8b8-4b01-a934-0a1e7a19ef92 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:07.908380 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840519fc-a8b8-4b01-a934-0a1e7a19ef92 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:07.908380 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840519fc-a8b8-4b01-a934-0a1e7a19ef92 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:07.909697 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 658/1317] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:50:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:50:07.916293 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c2bc4-98a2-4cf3-83b9-aa05a4e93dac None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:07.916985 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c2bc4-98a2-4cf3-83b9-aa05a4e93dac None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:07.917179 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c2bc4-98a2-4cf3-83b9-aa05a4e93dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:08.000350 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-3c3c2bc4-98a2-4cf3-83b9-aa05a4e93dac None None] MFA Rules not processed for user `06cf6d63014b475ca19007466ceb7bb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:50:08.001489 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-3c3c2bc4-98a2-4cf3-83b9-aa05a4e93dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:50:08.057125 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:08.102609 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 660/1318] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:50:07 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:50:08.388204 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840519fc-a8b8-4b01-a934-0a1e7a19ef92 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:08.389766 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-840519fc-a8b8-4b01-a934-0a1e7a19ef92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:50:08.497347 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840519fc-a8b8-4b01-a934-0a1e7a19ef92 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:08.500152 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:08.573827 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4892038-de83-43b1-85ea-684231afb4be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:08.574462 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4892038-de83-43b1-85ea-684231afb4be service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:08.574738 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4892038-de83-43b1-85ea-684231afb4be service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:08.575005 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4892038-de83-43b1-85ea-684231afb4be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:08.576669 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-b4892038-de83-43b1-85ea-684231afb4be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:50:08.687459 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4892038-de83-43b1-85ea-684231afb4be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:08.689003 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4892038-de83-43b1-85ea-684231afb4be service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:08.707978 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 659/1319] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:50:08 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:50:11.134997 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340291d9-5f36-4b81-8d82-e9f240265132 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:11.135532 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340291d9-5f36-4b81-8d82-e9f240265132 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:11.135532 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340291d9-5f36-4b81-8d82-e9f240265132 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:11.136918 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 661/1320] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:50:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:50:11.142641 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224e82b-da11-49bb-b0ec-5f91a6c87b2e None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:11.143100 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224e82b-da11-49bb-b0ec-5f91a6c87b2e None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:11.143215 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224e82b-da11-49bb-b0ec-5f91a6c87b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:11.184027 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:11.211585 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-3224e82b-da11-49bb-b0ec-5f91a6c87b2e None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:50:11.212848 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-3224e82b-da11-49bb-b0ec-5f91a6c87b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:50:11.314512 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 660/1321] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:50:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:50:11.595308 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340291d9-5f36-4b81-8d82-e9f240265132 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:11.596900 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-340291d9-5f36-4b81-8d82-e9f240265132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:50:11.709940 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340291d9-5f36-4b81-8d82-e9f240265132 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:11.787120 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb785d5-c50f-468e-9520-2de93584fa34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:11.787750 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb785d5-c50f-468e-9520-2de93584fa34 service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:11.788025 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb785d5-c50f-468e-9520-2de93584fa34 service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:11.788294 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb785d5-c50f-468e-9520-2de93584fa34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:11.789902 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-2cb785d5-c50f-468e-9520-2de93584fa34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:50:11.797733 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:11.906013 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb785d5-c50f-468e-9520-2de93584fa34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:11.907508 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb785d5-c50f-468e-9520-2de93584fa34 service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:11.932911 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 662/1322] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:50:11 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:50:14.497346 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a429bf-d828-4d42-910a-dd01aa0842a2 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:14.497914 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a429bf-d828-4d42-910a-dd01aa0842a2 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:14.497914 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a429bf-d828-4d42-910a-dd01aa0842a2 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:14.499255 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 661/1323] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:50:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:50:14.504891 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4931454a-92b0-4ae5-ae48-ebb9dae69b7c None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:14.505314 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4931454a-92b0-4ae5-ae48-ebb9dae69b7c None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:14.505470 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4931454a-92b0-4ae5-ae48-ebb9dae69b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:14.575097 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-4931454a-92b0-4ae5-ae48-ebb9dae69b7c None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:50:14.576350 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-4931454a-92b0-4ae5-ae48-ebb9dae69b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:50:14.635518 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:14.678578 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 663/1324] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:50:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:50:14.961108 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a429bf-d828-4d42-910a-dd01aa0842a2 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:14.962661 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-38a429bf-d828-4d42-910a-dd01aa0842a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:50:15.072189 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a429bf-d828-4d42-910a-dd01aa0842a2 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:15.085648 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:15.150807 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aa6bd0-4f71-4239-8f40-0cd11d1a725d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:15.151467 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa6bd0-4f71-4239-8f40-0cd11d1a725d service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:15.151722 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa6bd0-4f71-4239-8f40-0cd11d1a725d service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:15.151995 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa6bd0-4f71-4239-8f40-0cd11d1a725d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:15.153632 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-c7aa6bd0-4f71-4239-8f40-0cd11d1a725d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:50:15.275085 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aa6bd0-4f71-4239-8f40-0cd11d1a725d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:15.276600 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aa6bd0-4f71-4239-8f40-0cd11d1a725d service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:15.296932 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 662/1325] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:50:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:50:17.251804 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda3b56-6262-4c20-b918-d5f690a5e41a None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:17.252363 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda3b56-6262-4c20-b918-d5f690a5e41a None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:17.252363 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda3b56-6262-4c20-b918-d5f690a5e41a None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:17.253568 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 664/1326] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:50:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:50:17.259284 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c8d885-86a7-4456-a5fd-d0653da367ed None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:17.259804 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c8d885-86a7-4456-a5fd-d0653da367ed None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:17.259907 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c8d885-86a7-4456-a5fd-d0653da367ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:17.309364 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:17.329092 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-c8c8d885-86a7-4456-a5fd-d0653da367ed None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:50:17.330323 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-c8c8d885-86a7-4456-a5fd-d0653da367ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:50:17.435683 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 663/1327] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:50:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:50:17.709905 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eda3b56-6262-4c20-b918-d5f690a5e41a None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:17.711449 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-9eda3b56-6262-4c20-b918-d5f690a5e41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:50:17.829091 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eda3b56-6262-4c20-b918-d5f690a5e41a None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:17.915766 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7e2d87-c39e-40e9-ab9b-657aa0fde69e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:17.916376 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e2d87-c39e-40e9-ab9b-657aa0fde69e service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:17.916648 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e2d87-c39e-40e9-ab9b-657aa0fde69e service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:17.916915 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e2d87-c39e-40e9-ab9b-657aa0fde69e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:17.918526 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-ac7e2d87-c39e-40e9-ab9b-657aa0fde69e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:50:17.936647 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:18.042232 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7e2d87-c39e-40e9-ab9b-657aa0fde69e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:18.043740 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7e2d87-c39e-40e9-ab9b-657aa0fde69e service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:18.062636 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 665/1328] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:50:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:50:20.032393 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7635ecc-3b0a-4769-b83d-2d62b9280803 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:20.032947 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7635ecc-3b0a-4769-b83d-2d62b9280803 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:20.032947 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7635ecc-3b0a-4769-b83d-2d62b9280803 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:20.034520 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 664/1329] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:50:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:50:20.040614 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae435d71-90e4-49bb-a796-46d5cbf39ca4 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:20.041158 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae435d71-90e4-49bb-a796-46d5cbf39ca4 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:20.041158 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae435d71-90e4-49bb-a796-46d5cbf39ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:20.114892 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-ae435d71-90e4-49bb-a796-46d5cbf39ca4 None None] MFA Rules not processed for user `06cf6d63014b475ca19007466ceb7bb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:50:20.116148 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-ae435d71-90e4-49bb-a796-46d5cbf39ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:50:20.183495 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:20.217304 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 666/1330] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:50:20 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:50:20.502969 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7635ecc-3b0a-4769-b83d-2d62b9280803 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:20.504592 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-b7635ecc-3b0a-4769-b83d-2d62b9280803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:50:20.618409 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7635ecc-3b0a-4769-b83d-2d62b9280803 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:20.638937 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:20.695977 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b170486-8750-4606-9384-26096569ed3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:20.696518 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b170486-8750-4606-9384-26096569ed3d service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:20.696796 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b170486-8750-4606-9384-26096569ed3d service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:20.697064 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b170486-8750-4606-9384-26096569ed3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:20.698671 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-9b170486-8750-4606-9384-26096569ed3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:50:20.817161 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b170486-8750-4606-9384-26096569ed3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:20.818548 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b170486-8750-4606-9384-26096569ed3d service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:20.840252 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 665/1331] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:50:20 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:50:23.030394 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b073a-588c-4aad-9c7e-1a37227fd792 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:23.031002 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b073a-588c-4aad-9c7e-1a37227fd792 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:23.031002 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b073a-588c-4aad-9c7e-1a37227fd792 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:23.032412 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 667/1332] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:50:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:50:23.038534 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c2250c-6fc5-42f5-a98f-331304b4e64e None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:23.039316 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c2250c-6fc5-42f5-a98f-331304b4e64e None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:23.039316 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c2250c-6fc5-42f5-a98f-331304b4e64e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:23.114111 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:23.126920 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-36c2250c-6fc5-42f5-a98f-331304b4e64e None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:50:23.128689 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-36c2250c-6fc5-42f5-a98f-331304b4e64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:50:23.229932 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 666/1333] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:50:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:50:23.508205 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b073a-588c-4aad-9c7e-1a37227fd792 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:23.509752 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-e03b073a-588c-4aad-9c7e-1a37227fd792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:50:23.619580 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b073a-588c-4aad-9c7e-1a37227fd792 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:23.695289 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c33043-ff5b-4c8b-b58a-4ea829849897 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:23.695920 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c33043-ff5b-4c8b-b58a-4ea829849897 service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:23.696194 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c33043-ff5b-4c8b-b58a-4ea829849897 service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:23.696454 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c33043-ff5b-4c8b-b58a-4ea829849897 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:23.698042 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-f8c33043-ff5b-4c8b-b58a-4ea829849897 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:50:23.726936 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:23.812425 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c33043-ff5b-4c8b-b58a-4ea829849897 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:23.813811 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c33043-ff5b-4c8b-b58a-4ea829849897 service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:23.833726 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 668/1334] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:50:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:50:25.778090 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ece94-6feb-4098-9ea2-e9ca34d231c0 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:25.778635 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ece94-6feb-4098-9ea2-e9ca34d231c0 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:25.778635 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ece94-6feb-4098-9ea2-e9ca34d231c0 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:25.780155 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 667/1335] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:50:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:50:25.786015 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec8262-f034-49dc-9e14-372a3c52e807 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:25.786485 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec8262-f034-49dc-9e14-372a3c52e807 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:25.786673 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec8262-f034-49dc-9e14-372a3c52e807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:25.857620 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-13ec8262-f034-49dc-9e14-372a3c52e807 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:50:25.858851 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-13ec8262-f034-49dc-9e14-372a3c52e807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:50:25.941748 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:25.966032 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 669/1336] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:50:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:50:26.261907 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434ece94-6feb-4098-9ea2-e9ca34d231c0 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:26.263444 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-434ece94-6feb-4098-9ea2-e9ca34d231c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:50:26.375047 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434ece94-6feb-4098-9ea2-e9ca34d231c0 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:26.405118 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:26.455120 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31851363-29cf-4ac7-86c2-054fe44229c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:26.455792 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31851363-29cf-4ac7-86c2-054fe44229c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:26.456047 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31851363-29cf-4ac7-86c2-054fe44229c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:26.456310 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31851363-29cf-4ac7-86c2-054fe44229c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:26.457894 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-31851363-29cf-4ac7-86c2-054fe44229c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:50:26.568928 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31851363-29cf-4ac7-86c2-054fe44229c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:26.570274 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31851363-29cf-4ac7-86c2-054fe44229c8 service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:26.590453 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 668/1337] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:50:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:50:28.823009 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb39df-ccec-4680-807e-6320bbea921b None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:28.823569 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb39df-ccec-4680-807e-6320bbea921b None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:28.823569 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb39df-ccec-4680-807e-6320bbea921b None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:28.824895 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 670/1338] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:50:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:50:28.830898 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a40a91-dd4c-4a3f-afda-2b335192d6a0 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:28.831354 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a40a91-dd4c-4a3f-afda-2b335192d6a0 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:28.831449 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a40a91-dd4c-4a3f-afda-2b335192d6a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:28.898048 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-c8a40a91-dd4c-4a3f-afda-2b335192d6a0 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:50:28.899257 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-c8a40a91-dd4c-4a3f-afda-2b335192d6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:50:28.907797 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:29.000550 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 669/1339] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:50:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:50:29.283348 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb39df-ccec-4680-807e-6320bbea921b None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:29.284959 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-a2cb39df-ccec-4680-807e-6320bbea921b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:50:29.393000 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb39df-ccec-4680-807e-6320bbea921b None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:29.475035 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef9e3a-98d6-454d-8020-b95995a85df1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:29.476051 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef9e3a-98d6-454d-8020-b95995a85df1 service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:29.476300 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef9e3a-98d6-454d-8020-b95995a85df1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:29.476596 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef9e3a-98d6-454d-8020-b95995a85df1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:29.478276 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-f8ef9e3a-98d6-454d-8020-b95995a85df1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:50:29.519934 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:29.599466 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef9e3a-98d6-454d-8020-b95995a85df1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:29.600874 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef9e3a-98d6-454d-8020-b95995a85df1 service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:29.619998 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 671/1340] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:50:29 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:50:33.522633 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73659fa9-f2b8-419a-be39-7099f81b9806 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:33.523126 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73659fa9-f2b8-419a-be39-7099f81b9806 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:33.523229 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73659fa9-f2b8-419a-be39-7099f81b9806 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:33.524596 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 670/1341] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:50:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:50:33.530574 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d5012-b888-4a1e-8f3e-d45d6241c8e7 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:33.531199 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d5012-b888-4a1e-8f3e-d45d6241c8e7 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:33.531199 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d5012-b888-4a1e-8f3e-d45d6241c8e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:33.602027 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-c79d5012-b888-4a1e-8f3e-d45d6241c8e7 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:50:33.603291 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-c79d5012-b888-4a1e-8f3e-d45d6241c8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:50:33.696174 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:33.709174 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 672/1342] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:50:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:50:33.990068 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73659fa9-f2b8-419a-be39-7099f81b9806 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:33.991606 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-73659fa9-f2b8-419a-be39-7099f81b9806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:50:34.098536 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73659fa9-f2b8-419a-be39-7099f81b9806 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:34.141816 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:34.179040 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3369db10-3088-4a06-b9a7-9c48edf75e78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:34.179672 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369db10-3088-4a06-b9a7-9c48edf75e78 service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:34.179957 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369db10-3088-4a06-b9a7-9c48edf75e78 service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:34.180227 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369db10-3088-4a06-b9a7-9c48edf75e78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:34.181874 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-3369db10-3088-4a06-b9a7-9c48edf75e78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:50:34.301320 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3369db10-3088-4a06-b9a7-9c48edf75e78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:34.302688 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3369db10-3088-4a06-b9a7-9c48edf75e78 service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:34.322200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 671/1343] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:50:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:50:37.224856 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b96015-e14d-46b8-99f8-77be8ad6f0ca None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:37.225456 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b96015-e14d-46b8-99f8-77be8ad6f0ca None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:37.225456 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b96015-e14d-46b8-99f8-77be8ad6f0ca None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:37.226645 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 673/1344] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:50:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:50:37.232168 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5838029-5f34-43af-84dc-a5c18a80e93f None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:37.232676 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5838029-5f34-43af-84dc-a5c18a80e93f None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:37.232676 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5838029-5f34-43af-84dc-a5c18a80e93f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:37.304030 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-d5838029-5f34-43af-84dc-a5c18a80e93f None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:50:37.305259 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-d5838029-5f34-43af-84dc-a5c18a80e93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:50:37.325022 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:37.412043 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 672/1345] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:50:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:50:37.686674 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b96015-e14d-46b8-99f8-77be8ad6f0ca None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:37.688363 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-50b96015-e14d-46b8-99f8-77be8ad6f0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:50:37.803462 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b96015-e14d-46b8-99f8-77be8ad6f0ca None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:37.884592 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de62777-26b1-4143-8245-5e61f73a090a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:37.885215 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de62777-26b1-4143-8245-5e61f73a090a service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:37.885483 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de62777-26b1-4143-8245-5e61f73a090a service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:37.885743 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de62777-26b1-4143-8245-5e61f73a090a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:37.887537 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-7de62777-26b1-4143-8245-5e61f73a090a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:50:37.936440 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:38.017137 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de62777-26b1-4143-8245-5e61f73a090a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:38.018622 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de62777-26b1-4143-8245-5e61f73a090a service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:38.040305 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 674/1346] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:50:37 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:50:42.237374 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879230ad-a96b-4435-834f-3910cfc446d6 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:42.237930 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879230ad-a96b-4435-834f-3910cfc446d6 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:42.237930 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879230ad-a96b-4435-834f-3910cfc446d6 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:42.239255 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 673/1347] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:50:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:50:42.244745 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be9b70-1858-48db-be1f-1975e830cfe6 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:42.245242 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be9b70-1858-48db-be1f-1975e830cfe6 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:42.245242 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be9b70-1858-48db-be1f-1975e830cfe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:42.316749 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-10be9b70-1858-48db-be1f-1975e830cfe6 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:50:42.317971 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-10be9b70-1858-48db-be1f-1975e830cfe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:50:42.419289 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:42.422321 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 675/1348] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:50:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:50:42.706905 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879230ad-a96b-4435-834f-3910cfc446d6 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:42.709678 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-879230ad-a96b-4435-834f-3910cfc446d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:50:42.830644 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879230ad-a96b-4435-834f-3910cfc446d6 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:42.881244 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:42.909166 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ca19d-603f-4784-b018-aa5e5bbf1a7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:42.909725 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ca19d-603f-4784-b018-aa5e5bbf1a7f service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:42.910000 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ca19d-603f-4784-b018-aa5e5bbf1a7f service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:42.910264 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ca19d-603f-4784-b018-aa5e5bbf1a7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:42.911911 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-567ca19d-603f-4784-b018-aa5e5bbf1a7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:50:43.030974 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567ca19d-603f-4784-b018-aa5e5bbf1a7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:43.032475 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567ca19d-603f-4784-b018-aa5e5bbf1a7f service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:43.054037 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 674/1349] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:50:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:50:48.026026 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f064c5-f411-4830-a249-0f1d9a9fb349 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:48.026555 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f064c5-f411-4830-a249-0f1d9a9fb349 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:48.026555 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f064c5-f411-4830-a249-0f1d9a9fb349 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:48.028624 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 676/1350] 10.222.0.49 () {54 vars in 921 bytes} [Sun Aug 28 00:50:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:50:48.034088 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f70f1-295d-4cb9-9be6-27cc317b09c3 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:48.034567 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f70f1-295d-4cb9-9be6-27cc317b09c3 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:48.034567 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988f70f1-295d-4cb9-9be6-27cc317b09c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:48.151363 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-988f70f1-295d-4cb9-9be6-27cc317b09c3 None None] MFA Rules not processed for user `8f4fc1d11f5641b0b5f301b234282aa9`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:50:48.153289 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-988f70f1-295d-4cb9-9be6-27cc317b09c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:50:48.194334 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:48.299314 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 675/1351] 10.222.0.49 () {58 vars in 1018 bytes} [Sun Aug 28 00:50:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:50:52.545571 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b45a2-0630-4146-9a42-066524f8b5a9 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:52.546540 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b45a2-0630-4146-9a42-066524f8b5a9 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:52.547002 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b45a2-0630-4146-9a42-066524f8b5a9 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:52.548679 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 677/1352] 10.222.0.49 () {54 vars in 921 bytes} [Sun Aug 28 00:50:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:50:52.554149 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fcce3f-9e80-42e7-9cec-9baa50e48509 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:52.554688 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fcce3f-9e80-42e7-9cec-9baa50e48509 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:52.554688 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fcce3f-9e80-42e7-9cec-9baa50e48509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:52.639575 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-a6fcce3f-9e80-42e7-9cec-9baa50e48509 None None] MFA Rules not processed for user `8f4fc1d11f5641b0b5f301b234282aa9`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:50:52.641129 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-a6fcce3f-9e80-42e7-9cec-9baa50e48509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:50:52.733873 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:52.780808 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 676/1353] 10.222.0.49 () {58 vars in 1018 bytes} [Sun Aug 28 00:50:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:50:54.033494 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb95b1-152a-4c84-8dfc-54e13f16e42c None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:54.033998 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb95b1-152a-4c84-8dfc-54e13f16e42c None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:54.033998 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb95b1-152a-4c84-8dfc-54e13f16e42c None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:54.035368 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 678/1354] 10.222.0.49 () {54 vars in 921 bytes} [Sun Aug 28 00:50:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:50:54.041126 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf29a3-4a64-4c92-8000-37794e1379bb None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:54.041625 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf29a3-4a64-4c92-8000-37794e1379bb None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:54.041720 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf29a3-4a64-4c92-8000-37794e1379bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:54.127856 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-35bf29a3-4a64-4c92-8000-37794e1379bb None None] MFA Rules not processed for user `8f4fc1d11f5641b0b5f301b234282aa9`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:50:54.129064 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-35bf29a3-4a64-4c92-8000-37794e1379bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:50:54.244323 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 677/1355] 10.222.0.49 () {58 vars in 1018 bytes} [Sun Aug 28 00:50:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:50:57.618698 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0fa39-04b3-446f-91ab-4a883ec346ee None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:57.619315 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0fa39-04b3-446f-91ab-4a883ec346ee None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:57.619315 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0fa39-04b3-446f-91ab-4a883ec346ee None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:57.620627 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 679/1356] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:50:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:50:57.626386 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc04e7-bc55-4f12-bfd1-fac3227252eb None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:57.626875 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc04e7-bc55-4f12-bfd1-fac3227252eb None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:57.626970 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc04e7-bc55-4f12-bfd1-fac3227252eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:57.664350 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:57.703907 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-e8fc04e7-bc55-4f12-bfd1-fac3227252eb None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:50:57.705143 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-e8fc04e7-bc55-4f12-bfd1-fac3227252eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:50:57.847271 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 678/1357] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:50:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:50:58.153827 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8edd42-6c18-4d43-8e2b-2a8006c298a0 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:58.154683 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8edd42-6c18-4d43-8e2b-2a8006c298a0 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:58.155374 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8edd42-6c18-4d43-8e2b-2a8006c298a0 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:58.159337 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 680/1358] 10.222.0.49 () {54 vars in 962 bytes} [Sun Aug 28 00:50:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:50:58.166708 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d920a5a3-05fe-4821-bf1a-6e078b188555 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:58.167731 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d920a5a3-05fe-4821-bf1a-6e078b188555 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:58.168864 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d920a5a3-05fe-4821-bf1a-6e078b188555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:58.257901 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-d920a5a3-05fe-4821-bf1a-6e078b188555 None None] MFA Rules not processed for user `3dc0655c8156457a8fcb006c9fe85eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:50:58.259267 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-d920a5a3-05fe-4821-bf1a-6e078b188555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:50:58.315313 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:58.410205 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 679/1359] 10.222.0.49 () {58 vars in 1059 bytes} [Sun Aug 28 00:50:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:50:58.418482 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8edd42-6c18-4d43-8e2b-2a8006c298a0 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:50:58.420204 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-3e8edd42-6c18-4d43-8e2b-2a8006c298a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:50:58.581099 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8edd42-6c18-4d43-8e2b-2a8006c298a0 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:50:58.666659 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:50:58.712454 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d1a20f-9d16-4757-9d25-d9a22fbc8b80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:50:58.713240 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1a20f-9d16-4757-9d25-d9a22fbc8b80 service nova] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:50:58.713630 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1a20f-9d16-4757-9d25-d9a22fbc8b80 service nova] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:50:58.714005 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d1a20f-9d16-4757-9d25-d9a22fbc8b80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:50:58.716372 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-d3d1a20f-9d16-4757-9d25-d9a22fbc8b80 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:50:58.814288 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d1a20f-9d16-4757-9d25-d9a22fbc8b80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:50:58.816256 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d1a20f-9d16-4757-9d25-d9a22fbc8b80 service nova] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:50:58.836657 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 681/1360] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:50:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:51:00.952015 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209aff2-abf1-40ef-ac3c-b1a0944c6f0f None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:00.952663 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209aff2-abf1-40ef-ac3c-b1a0944c6f0f None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:00.952663 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209aff2-abf1-40ef-ac3c-b1a0944c6f0f None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:00.954167 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 680/1361] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:51:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:00.959813 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9620f-8708-442f-9ce0-6e53fabb6094 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:00.960362 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9620f-8708-442f-9ce0-6e53fabb6094 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:00.960362 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9620f-8708-442f-9ce0-6e53fabb6094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:01.041388 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-20d9620f-8708-442f-9ce0-6e53fabb6094 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:01.042806 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-20d9620f-8708-442f-9ce0-6e53fabb6094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:01.086764 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:01.154291 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 682/1362] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:51:01.438995 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e209aff2-abf1-40ef-ac3c-b1a0944c6f0f None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:01.440586 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-e209aff2-abf1-40ef-ac3c-b1a0944c6f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:01.606015 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e209aff2-abf1-40ef-ac3c-b1a0944c6f0f None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:01.617864 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:01.751313 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76599ab8-f59f-4787-99d1-6bfe27ba52d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:01.752424 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76599ab8-f59f-4787-99d1-6bfe27ba52d4 service nova] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:01.752915 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76599ab8-f59f-4787-99d1-6bfe27ba52d4 service nova] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:01.753434 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76599ab8-f59f-4787-99d1-6bfe27ba52d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:01.755374 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-76599ab8-f59f-4787-99d1-6bfe27ba52d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:01.865384 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76599ab8-f59f-4787-99d1-6bfe27ba52d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:01.867356 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76599ab8-f59f-4787-99d1-6bfe27ba52d4 service nova] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:01.887275 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 681/1363] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:51:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:51:04.176876 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9786d53-99e7-4d50-80cb-f658730460bd None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:04.176876 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9786d53-99e7-4d50-80cb-f658730460bd None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:04.177500 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9786d53-99e7-4d50-80cb-f658730460bd None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:04.178583 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 683/1364] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:51:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:04.184267 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1e756-21aa-4dcf-9ace-db78e684dd32 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:04.184764 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1e756-21aa-4dcf-9ace-db78e684dd32 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:04.184863 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1e756-21aa-4dcf-9ace-db78e684dd32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:04.204211 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:04.279701 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-c4f1e756-21aa-4dcf-9ace-db78e684dd32 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:04.281020 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-c4f1e756-21aa-4dcf-9ace-db78e684dd32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:04.410782 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 682/1365] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:51:04.725103 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e116260-dbad-44a2-8776-c4978030c0e7 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:04.725616 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e116260-dbad-44a2-8776-c4978030c0e7 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:04.726059 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e116260-dbad-44a2-8776-c4978030c0e7 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:04.728439 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 684/1366] 10.222.0.49 () {54 vars in 962 bytes} [Sun Aug 28 00:51:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:04.747711 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15098f-c139-467f-ac60-8e1f4f6211db None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:04.747711 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15098f-c139-467f-ac60-8e1f4f6211db None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:04.747711 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f15098f-c139-467f-ac60-8e1f4f6211db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:04.848621 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-8f15098f-c139-467f-ac60-8e1f4f6211db None None] MFA Rules not processed for user `3dc0655c8156457a8fcb006c9fe85eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:04.849776 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-8f15098f-c139-467f-ac60-8e1f4f6211db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:05.012953 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:05.140774 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 683/1367] 10.222.0.49 () {58 vars in 1059 bytes} [Sun Aug 28 00:51:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:51:05.148571 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e116260-dbad-44a2-8776-c4978030c0e7 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:05.150080 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-4e116260-dbad-44a2-8776-c4978030c0e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:05.323147 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e116260-dbad-44a2-8776-c4978030c0e7 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:05.346692 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:05.470933 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813cf79c-cacf-4c53-aa22-367bd23ea468 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:05.471548 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813cf79c-cacf-4c53-aa22-367bd23ea468 service nova] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:05.471871 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813cf79c-cacf-4c53-aa22-367bd23ea468 service nova] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:05.472369 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813cf79c-cacf-4c53-aa22-367bd23ea468 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:05.474111 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-813cf79c-cacf-4c53-aa22-367bd23ea468 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:05.604845 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813cf79c-cacf-4c53-aa22-367bd23ea468 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:05.606473 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813cf79c-cacf-4c53-aa22-367bd23ea468 service nova] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:05.630150 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 685/1368] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:51:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:51:07.775909 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de098107-91c0-4380-a3be-cfba85bf997d None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:07.776391 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de098107-91c0-4380-a3be-cfba85bf997d None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:07.776482 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de098107-91c0-4380-a3be-cfba85bf997d None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:07.777982 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 684/1369] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:51:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:07.786122 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f18407-0a84-480f-8659-4f9b11908265 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:07.786974 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f18407-0a84-480f-8659-4f9b11908265 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:07.787461 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f18407-0a84-480f-8659-4f9b11908265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:07.833264 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:07.910767 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-04f18407-0a84-480f-8659-4f9b11908265 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:07.912462 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-04f18407-0a84-480f-8659-4f9b11908265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:08.038844 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 686/1370] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:51:08.356792 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de098107-91c0-4380-a3be-cfba85bf997d None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:08.358726 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-de098107-91c0-4380-a3be-cfba85bf997d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:08.537053 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:08.544564 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de098107-91c0-4380-a3be-cfba85bf997d None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:08.697790 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394a88f5-7510-4263-b445-2ef2e8483fb7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:08.698504 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a88f5-7510-4263-b445-2ef2e8483fb7 service nova] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:08.698994 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a88f5-7510-4263-b445-2ef2e8483fb7 service nova] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:08.699334 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394a88f5-7510-4263-b445-2ef2e8483fb7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:08.701496 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-394a88f5-7510-4263-b445-2ef2e8483fb7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:08.806065 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394a88f5-7510-4263-b445-2ef2e8483fb7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:08.808158 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394a88f5-7510-4263-b445-2ef2e8483fb7 service nova] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:08.827497 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:08.831338 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 685/1371] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:51:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:51:09.587053 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f976bfd7-24dc-4f9d-88ed-d0d4f78d0345 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:09.587615 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f976bfd7-24dc-4f9d-88ed-d0d4f78d0345 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:09.587615 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f976bfd7-24dc-4f9d-88ed-d0d4f78d0345 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:09.589306 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 687/1372] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:51:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:09.595479 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f27ca-d933-4fff-ae25-ec56c63ce7c8 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:09.595763 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f27ca-d933-4fff-ae25-ec56c63ce7c8 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:09.596197 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f27ca-d933-4fff-ae25-ec56c63ce7c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:09.684826 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-488f27ca-d933-4fff-ae25-ec56c63ce7c8 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:09.686147 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-488f27ca-d933-4fff-ae25-ec56c63ce7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:09.795751 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 686/1373] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:51:10.383484 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8581e704-a324-4d45-afe1-f7a371cda1a8 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:10.383484 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8581e704-a324-4d45-afe1-f7a371cda1a8 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:10.383484 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8581e704-a324-4d45-afe1-f7a371cda1a8 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:10.385145 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 688/1374] 10.222.0.49 () {54 vars in 964 bytes} [Sun Aug 28 00:51:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:10.390619 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db415f-7c3c-41d7-85ae-a0833d574b2b None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:10.391165 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db415f-7c3c-41d7-85ae-a0833d574b2b None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:10.391165 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db415f-7c3c-41d7-85ae-a0833d574b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:10.484592 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-c3db415f-7c3c-41d7-85ae-a0833d574b2b None None] MFA Rules not processed for user `95355adb5a6a4a69a31904247eac6d69`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:10.485830 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-c3db415f-7c3c-41d7-85ae-a0833d574b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:10.513192 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:10.582545 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 687/1375] 10.222.0.49 () {58 vars in 1061 bytes} [Sun Aug 28 00:51:10 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:51:10.590348 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8581e704-a324-4d45-afe1-f7a371cda1a8 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:10.592686 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-8581e704-a324-4d45-afe1-f7a371cda1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:10.704108 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8581e704-a324-4d45-afe1-f7a371cda1a8 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:10.708230 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:10.794681 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb987c-79be-4499-838f-7688d7fcd68a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95355adb5a6a4a69a31904247eac6d69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:10.795900 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb987c-79be-4499-838f-7688d7fcd68a service cinder] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:10.796362 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb987c-79be-4499-838f-7688d7fcd68a service cinder] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:10.796813 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb987c-79be-4499-838f-7688d7fcd68a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:10.798597 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-3afb987c-79be-4499-838f-7688d7fcd68a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:10.926416 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa78dc-7cac-4916-a361-f905dc7ef01d None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:10.926672 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa78dc-7cac-4916-a361-f905dc7ef01d None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:10.926959 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa78dc-7cac-4916-a361-f905dc7ef01d None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:10.928135 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afb987c-79be-4499-838f-7688d7fcd68a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:10.928618 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 688/1376] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:51:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:51:10.929746 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afb987c-79be-4499-838f-7688d7fcd68a service cinder] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:10.934090 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac72f14-cb1d-4126-b602-0f7b50abd6b5 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:10.934378 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac72f14-cb1d-4126-b602-0f7b50abd6b5 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:10.934671 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac72f14-cb1d-4126-b602-0f7b50abd6b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:10.950395 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 689/1377] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:51:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:51:11.010461 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-0ac72f14-cb1d-4126-b602-0f7b50abd6b5 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:11.011698 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-0ac72f14-cb1d-4126-b602-0f7b50abd6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:11.117939 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 689/1378] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:51:11.416651 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb987c-79be-4499-838f-7688d7fcd68a service cinder] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:11.417853 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-3afb987c-79be-4499-838f-7688d7fcd68a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:11.459530 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:11.535211 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb987c-79be-4499-838f-7688d7fcd68a service cinder] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:11.748746 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a662be6e-d90e-4779-a304-a95cbb9d2456 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:11.750700 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662be6e-d90e-4779-a304-a95cbb9d2456 service nova] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:11.751145 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662be6e-d90e-4779-a304-a95cbb9d2456 service nova] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:11.751515 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662be6e-d90e-4779-a304-a95cbb9d2456 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:11.753401 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-a662be6e-d90e-4779-a304-a95cbb9d2456 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:11.809315 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:11.862467 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a662be6e-d90e-4779-a304-a95cbb9d2456 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:11.864199 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a662be6e-d90e-4779-a304-a95cbb9d2456 service nova] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:11.885441 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 690/1379] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:51:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:51:13.896519 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbacff37-f5ca-44ee-9fae-07a0c819113a None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:13.897091 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbacff37-f5ca-44ee-9fae-07a0c819113a None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:13.897210 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbacff37-f5ca-44ee-9fae-07a0c819113a None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:13.899560 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 690/1380] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:51:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:13.907802 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0416e05-77d7-43d8-955c-ba5d9fcbb9a0 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:13.908778 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0416e05-77d7-43d8-955c-ba5d9fcbb9a0 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:13.909030 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0416e05-77d7-43d8-955c-ba5d9fcbb9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:13.986870 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-a0416e05-77d7-43d8-955c-ba5d9fcbb9a0 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:13.988430 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-a0416e05-77d7-43d8-955c-ba5d9fcbb9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:14.121800 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 691/1381] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:51:14.414697 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbacff37-f5ca-44ee-9fae-07a0c819113a None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:14.416371 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-dbacff37-f5ca-44ee-9fae-07a0c819113a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:14.451331 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:14.615983 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbacff37-f5ca-44ee-9fae-07a0c819113a None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:14.757873 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:14.783192 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c9b831-7d67-4651-b3b0-928f7d4d8858 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:14.784364 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9b831-7d67-4651-b3b0-928f7d4d8858 service nova] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:14.784754 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9b831-7d67-4651-b3b0-928f7d4d8858 service nova] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:14.785132 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9b831-7d67-4651-b3b0-928f7d4d8858 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:14.788189 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-28c9b831-7d67-4651-b3b0-928f7d4d8858 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:14.911109 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c9b831-7d67-4651-b3b0-928f7d4d8858 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:14.914317 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c9b831-7d67-4651-b3b0-928f7d4d8858 service nova] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:14.937723 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 691/1382] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:51:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:51:17.050545 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da858a-0642-4d12-b2cb-7907cafac2b9 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:17.051109 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da858a-0642-4d12-b2cb-7907cafac2b9 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:17.051109 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da858a-0642-4d12-b2cb-7907cafac2b9 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:17.058004 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0daead-18a2-460b-84e0-46b95569ed45 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:17.058533 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0daead-18a2-460b-84e0-46b95569ed45 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:17.058533 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0daead-18a2-460b-84e0-46b95569ed45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:17.063113 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 692/1383] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:51:17 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:17.133378 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-0c0daead-18a2-460b-84e0-46b95569ed45 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:17.134588 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-0c0daead-18a2-460b-84e0-46b95569ed45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:17.202419 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:17.269224 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 692/1384] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:51:17.554329 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da858a-0642-4d12-b2cb-7907cafac2b9 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:17.556113 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-09da858a-0642-4d12-b2cb-7907cafac2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:17.584730 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:17.771587 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da858a-0642-4d12-b2cb-7907cafac2b9 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:17.909628 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:17.932305 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf2564e-5cf4-4b6f-b89d-10b48ec68866 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:17.932916 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf2564e-5cf4-4b6f-b89d-10b48ec68866 service nova] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:17.933187 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf2564e-5cf4-4b6f-b89d-10b48ec68866 service nova] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:17.933452 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf2564e-5cf4-4b6f-b89d-10b48ec68866 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:17.935068 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-3bf2564e-5cf4-4b6f-b89d-10b48ec68866 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:18.055842 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf2564e-5cf4-4b6f-b89d-10b48ec68866 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:18.058255 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf2564e-5cf4-4b6f-b89d-10b48ec68866 service nova] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:18.080160 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 693/1385] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:51:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:51:20.058665 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba16a888-f9d7-4915-be03-eb3b4f3af1de None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:20.059343 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba16a888-f9d7-4915-be03-eb3b4f3af1de None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:20.059693 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba16a888-f9d7-4915-be03-eb3b4f3af1de None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:20.062267 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 693/1386] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:51:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:20.068577 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0471261-22c7-4620-ae36-c4a01f5072e8 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:20.069140 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0471261-22c7-4620-ae36-c4a01f5072e8 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:20.069140 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0471261-22c7-4620-ae36-c4a01f5072e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:20.152563 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-b0471261-22c7-4620-ae36-c4a01f5072e8 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:20.153889 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-b0471261-22c7-4620-ae36-c4a01f5072e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:20.235208 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:20.288469 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 694/1387] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:51:20.584486 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba16a888-f9d7-4915-be03-eb3b4f3af1de None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:20.586157 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-ba16a888-f9d7-4915-be03-eb3b4f3af1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:20.763096 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba16a888-f9d7-4915-be03-eb3b4f3af1de None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:20.824667 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:20.925853 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c432248-987e-466d-88dc-c3184090d77f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:20.926533 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c432248-987e-466d-88dc-c3184090d77f service nova] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:20.926811 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c432248-987e-466d-88dc-c3184090d77f service nova] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:20.927090 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c432248-987e-466d-88dc-c3184090d77f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:20.928956 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-2c432248-987e-466d-88dc-c3184090d77f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:21.048407 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c432248-987e-466d-88dc-c3184090d77f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:21.050456 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c432248-987e-466d-88dc-c3184090d77f service nova] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:21.073937 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 694/1388] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:51:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:51:23.206454 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c0913d-942b-43c3-997e-7248130ee490 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:23.207193 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c0913d-942b-43c3-997e-7248130ee490 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:23.207501 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c0913d-942b-43c3-997e-7248130ee490 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:23.209903 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 695/1389] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:51:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:23.216954 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c717e1-ef2f-42bd-8b41-14e3c513fe1f None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:23.217512 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c717e1-ef2f-42bd-8b41-14e3c513fe1f None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:23.217707 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c717e1-ef2f-42bd-8b41-14e3c513fe1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:23.303919 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:23.307910 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-31c717e1-ef2f-42bd-8b41-14e3c513fe1f None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:23.310114 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-31c717e1-ef2f-42bd-8b41-14e3c513fe1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:23.428916 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 695/1390] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:51:23.718980 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c0913d-942b-43c3-997e-7248130ee490 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:23.720801 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-59c0913d-942b-43c3-997e-7248130ee490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:23.914293 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c0913d-942b-43c3-997e-7248130ee490 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:23.970342 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:24.061668 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0235a24-4dc7-4973-a2c9-389c6b182c1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:24.062352 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0235a24-4dc7-4973-a2c9-389c6b182c1a service nova] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:24.062657 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0235a24-4dc7-4973-a2c9-389c6b182c1a service nova] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:24.062943 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0235a24-4dc7-4973-a2c9-389c6b182c1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:24.064849 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-e0235a24-4dc7-4973-a2c9-389c6b182c1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:24.206803 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0235a24-4dc7-4973-a2c9-389c6b182c1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:24.209594 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0235a24-4dc7-4973-a2c9-389c6b182c1a service nova] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:24.238095 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 696/1391] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:51:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:51:26.226099 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c40727-9629-4237-86ca-a3c6bd968113 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:26.226751 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c40727-9629-4237-86ca-a3c6bd968113 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:26.226751 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c40727-9629-4237-86ca-a3c6bd968113 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:26.228342 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 696/1392] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:51:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:26.234155 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6acdbff-d038-47da-b6c2-490dcfd0aaca None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:26.237781 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6acdbff-d038-47da-b6c2-490dcfd0aaca None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:26.237781 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6acdbff-d038-47da-b6c2-490dcfd0aaca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:26.301424 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:26.312744 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-d6acdbff-d038-47da-b6c2-490dcfd0aaca None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:26.313993 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-d6acdbff-d038-47da-b6c2-490dcfd0aaca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:26.387645 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c29235-45ac-410e-a68c-53557acda72f None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:26.388064 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c29235-45ac-410e-a68c-53557acda72f None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:26.388404 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c29235-45ac-410e-a68c-53557acda72f None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:26.389953 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 697/1393] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:51:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:51:26.395311 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176b770-8d2e-46b6-a9d0-dcff119d78e4 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:26.395690 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176b770-8d2e-46b6-a9d0-dcff119d78e4 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:26.396048 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176b770-8d2e-46b6-a9d0-dcff119d78e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:26.424610 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 697/1394] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:51:26.472630 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-8176b770-8d2e-46b6-a9d0-dcff119d78e4 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:26.473979 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-8176b770-8d2e-46b6-a9d0-dcff119d78e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:26.554527 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:26.579950 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 698/1395] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:51:26.713266 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6acdbff-d038-47da-b6c2-490dcfd0aaca None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:26.714501 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-d6acdbff-d038-47da-b6c2-490dcfd0aaca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:26.831844 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6acdbff-d038-47da-b6c2-490dcfd0aaca None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:26.850051 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:26.878444 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca8dfe-1459-4825-8ef0-3070b9b33bbe None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:26.878724 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca8dfe-1459-4825-8ef0-3070b9b33bbe None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:26.878997 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca8dfe-1459-4825-8ef0-3070b9b33bbe None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:26.880447 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 699/1396] 10.222.0.49 () {54 vars in 967 bytes} [Sun Aug 28 00:51:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:51:26.885633 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e8a87-b9a3-4ca2-9acb-4278cb53817b None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:26.885914 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e8a87-b9a3-4ca2-9acb-4278cb53817b None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:26.886188 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748e8a87-b9a3-4ca2-9acb-4278cb53817b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:26.959200 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db17f6ff-3084-4b9c-a26b-d0e30fddf16d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:26.960304 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17f6ff-3084-4b9c-a26b-d0e30fddf16d service nova] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:26.960790 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17f6ff-3084-4b9c-a26b-d0e30fddf16d service nova] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:26.961268 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17f6ff-3084-4b9c-a26b-d0e30fddf16d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:26.966707 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-db17f6ff-3084-4b9c-a26b-d0e30fddf16d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:26.969264 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-748e8a87-b9a3-4ca2-9acb-4278cb53817b None None] MFA Rules not processed for user `22053bd9632346aab63814f740415f69`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:26.970450 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-748e8a87-b9a3-4ca2-9acb-4278cb53817b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:27.055826 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 700/1397] 10.222.0.49 () {58 vars in 1064 bytes} [Sun Aug 28 00:51:26 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:51:27.063959 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e8a87-b9a3-4ca2-9acb-4278cb53817b None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:27.072570 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748e8a87-b9a3-4ca2-9acb-4278cb53817b None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:27.080336 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db17f6ff-3084-4b9c-a26b-d0e30fddf16d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:27.082272 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db17f6ff-3084-4b9c-a26b-d0e30fddf16d service nova] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:27.104602 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 698/1398] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:51:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:51:27.169666 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:27.179915 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9550351a-2519-46db-94ca-5ba54d606674 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22053bd9632346aab63814f740415f69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:27.179915 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550351a-2519-46db-94ca-5ba54d606674 service glance] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:27.179915 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550351a-2519-46db-94ca-5ba54d606674 service glance] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:27.179915 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550351a-2519-46db-94ca-5ba54d606674 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:27.180575 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-9550351a-2519-46db-94ca-5ba54d606674 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:27.313335 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9550351a-2519-46db-94ca-5ba54d606674 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:27.315343 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9550351a-2519-46db-94ca-5ba54d606674 service glance] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:27.345615 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 701/1399] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:51:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:51:28.137634 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c5512b-dbc3-4f74-9194-f859e0bd18c9 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:28.138240 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c5512b-dbc3-4f74-9194-f859e0bd18c9 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:28.138240 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c5512b-dbc3-4f74-9194-f859e0bd18c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:28.167207 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:28.222130 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-09c5512b-dbc3-4f74-9194-f859e0bd18c9 None None] MFA Rules not processed for user `cbe0653ed0c04a9080b5c337392de8ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:28.223406 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-09c5512b-dbc3-4f74-9194-f859e0bd18c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:28.327324 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 699/1400] 10.222.0.49 () {58 vars in 1009 bytes} [Sun Aug 28 00:51:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:51:28.373786 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d337e172-5934-400a-85a5-d944d9f18440 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:28.374321 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d337e172-5934-400a-85a5-d944d9f18440 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:28.374321 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d337e172-5934-400a-85a5-d944d9f18440 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:28.375729 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 702/1401] 10.222.0.49 () {54 vars in 943 bytes} [Sun Aug 28 00:51:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:28.382589 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebea4b6-1d00-4650-b43a-26a57d892bb2 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:28.382975 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebea4b6-1d00-4650-b43a-26a57d892bb2 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:28.383248 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebea4b6-1d00-4650-b43a-26a57d892bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:28.464991 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-7ebea4b6-1d00-4650-b43a-26a57d892bb2 None None] MFA Rules not processed for user `4ce463b940db4f83a6df7e0561a88567`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:28.467438 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-7ebea4b6-1d00-4650-b43a-26a57d892bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:28.531554 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:28.609899 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 700/1402] 10.222.0.49 () {58 vars in 1040 bytes} [Sun Aug 28 00:51:28 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:51:28.619524 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d337e172-5934-400a-85a5-d944d9f18440 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:28.621241 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-d337e172-5934-400a-85a5-d944d9f18440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:28.723692 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:28.765141 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d337e172-5934-400a-85a5-d944d9f18440 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:28.880006 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1401c448-c7e6-4b9f-8ab0-202f3fcc99e7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ce463b940db4f83a6df7e0561a88567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:28.880625 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401c448-c7e6-4b9f-8ab0-202f3fcc99e7 service swift] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:28.880912 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401c448-c7e6-4b9f-8ab0-202f3fcc99e7 service swift] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:28.881170 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401c448-c7e6-4b9f-8ab0-202f3fcc99e7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:28.883507 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-1401c448-c7e6-4b9f-8ab0-202f3fcc99e7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:28.976204 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1401c448-c7e6-4b9f-8ab0-202f3fcc99e7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:28.977739 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1401c448-c7e6-4b9f-8ab0-202f3fcc99e7 service swift] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:28.982541 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:28.986739 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 703/1403] 10.222.0.49 () {60 vars in 1384 bytes} [Sun Aug 28 00:51:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 00:51:29.118639 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd53a3e-9d09-4b36-9d77-1b8df3c4f336 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:29.118639 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd53a3e-9d09-4b36-9d77-1b8df3c4f336 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:29.118639 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd53a3e-9d09-4b36-9d77-1b8df3c4f336 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:29.119933 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 701/1404] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:51:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:29.124915 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b671fce-77ca-46c2-9ec4-6bf751286951 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:29.125205 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b671fce-77ca-46c2-9ec4-6bf751286951 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:29.125625 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b671fce-77ca-46c2-9ec4-6bf751286951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:29.201624 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-1b671fce-77ca-46c2-9ec4-6bf751286951 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:29.202836 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-1b671fce-77ca-46c2-9ec4-6bf751286951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:29.346217 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 704/1405] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:51:29.744596 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd53a3e-9d09-4b36-9d77-1b8df3c4f336 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:29.746385 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-5dd53a3e-9d09-4b36-9d77-1b8df3c4f336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:29.918686 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd53a3e-9d09-4b36-9d77-1b8df3c4f336 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:29.948447 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:30.047874 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1fee8d-b3ef-4090-a4b2-54df8ce49469 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:30.048492 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1fee8d-b3ef-4090-a4b2-54df8ce49469 service nova] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:30.048790 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1fee8d-b3ef-4090-a4b2-54df8ce49469 service nova] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:30.049030 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1fee8d-b3ef-4090-a4b2-54df8ce49469 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:30.050683 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-1e1fee8d-b3ef-4090-a4b2-54df8ce49469 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:30.158144 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1fee8d-b3ef-4090-a4b2-54df8ce49469 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:30.159908 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1fee8d-b3ef-4090-a4b2-54df8ce49469 service nova] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:30.186794 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 702/1406] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:51:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:51:32.144614 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14620947-5775-4ae7-91b0-a544e87c3e69 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:32.145186 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14620947-5775-4ae7-91b0-a544e87c3e69 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:32.145186 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14620947-5775-4ae7-91b0-a544e87c3e69 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:32.147009 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 705/1407] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:51:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:32.152491 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d71d0-ab1b-4eaf-b3ab-da21304deeac None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:32.152932 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d71d0-ab1b-4eaf-b3ab-da21304deeac None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:32.153030 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d71d0-ab1b-4eaf-b3ab-da21304deeac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:32.191228 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:32.226100 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-738d71d0-ab1b-4eaf-b3ab-da21304deeac None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:32.227459 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-738d71d0-ab1b-4eaf-b3ab-da21304deeac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:32.338162 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 703/1408] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:51:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:51:32.620635 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14620947-5775-4ae7-91b0-a544e87c3e69 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:32.622176 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-14620947-5775-4ae7-91b0-a544e87c3e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:32.708022 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:32.780255 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14620947-5775-4ae7-91b0-a544e87c3e69 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:32.906045 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa4304c-55d7-4bbf-ad29-21fd6afc66bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:32.906564 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4304c-55d7-4bbf-ad29-21fd6afc66bc service nova] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:32.906857 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4304c-55d7-4bbf-ad29-21fd6afc66bc service nova] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:32.907112 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4304c-55d7-4bbf-ad29-21fd6afc66bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:32.908741 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-aaa4304c-55d7-4bbf-ad29-21fd6afc66bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:32.952281 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:33.008532 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa4304c-55d7-4bbf-ad29-21fd6afc66bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:33.010142 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa4304c-55d7-4bbf-ad29-21fd6afc66bc service nova] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:33.039584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 706/1409] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:51:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:51:42.337709 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=52 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:43.036549 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=28 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:51.296618 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95bfbf1-c63c-4911-bcd4-419e53e87352 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:51.297152 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95bfbf1-c63c-4911-bcd4-419e53e87352 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:51.297152 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95bfbf1-c63c-4911-bcd4-419e53e87352 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:51.298458 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 704/1410] 10.222.0.49 () {54 vars in 918 bytes} [Sun Aug 28 00:51:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:51.304704 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9306de-eecb-4f37-927b-a3256e6be083 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:51.305412 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9306de-eecb-4f37-927b-a3256e6be083 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:51.305572 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9306de-eecb-4f37-927b-a3256e6be083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:51.389213 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-1e9306de-eecb-4f37-927b-a3256e6be083 None None] MFA Rules not processed for user `8f4fc1d11f5641b0b5f301b234282aa9`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:51.390446 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-1e9306de-eecb-4f37-927b-a3256e6be083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:51.508437 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 707/1411] 10.222.0.49 () {58 vars in 1015 bytes} [Sun Aug 28 00:51:51 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:51:51.523489 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93697a2d-d97f-4000-b840-b5c730642d3b None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:51.523802 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93697a2d-d97f-4000-b840-b5c730642d3b None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:51.524076 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93697a2d-d97f-4000-b840-b5c730642d3b None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:51.525447 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 705/1412] 10.222.0.49 () {54 vars in 918 bytes} [Sun Aug 28 00:51:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:51.531535 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38c74f-4f81-4322-bc10-fce4590fce54 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:51.531832 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38c74f-4f81-4322-bc10-fce4590fce54 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:51.532266 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea38c74f-4f81-4322-bc10-fce4590fce54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:51.620275 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:51.623503 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-ea38c74f-4f81-4322-bc10-fce4590fce54 None None] MFA Rules not processed for user `3dc0655c8156457a8fcb006c9fe85eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:51.625253 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-ea38c74f-4f81-4322-bc10-fce4590fce54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:51.749512 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 708/1413] 10.222.0.49 () {58 vars in 1015 bytes} [Sun Aug 28 00:51:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:51:54.227511 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d783de2-6f57-4163-aad8-7fd28d014815 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:54.228157 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d783de2-6f57-4163-aad8-7fd28d014815 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:54.228157 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d783de2-6f57-4163-aad8-7fd28d014815 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:54.229685 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 706/1414] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 00:51:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:54.237941 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbeb877-ade0-429d-ba84-e2836c1f2ca3 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:54.238415 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbeb877-ade0-429d-ba84-e2836c1f2ca3 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:54.238524 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbeb877-ade0-429d-ba84-e2836c1f2ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:54.312135 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-3fbeb877-ade0-429d-ba84-e2836c1f2ca3 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:54.313356 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-3fbeb877-ade0-429d-ba84-e2836c1f2ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:54.370952 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:54.415420 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 709/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 00:51:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:51:54.719925 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d783de2-6f57-4163-aad8-7fd28d014815 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:54.721765 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-2d783de2-6f57-4163-aad8-7fd28d014815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:54.900142 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d783de2-6f57-4163-aad8-7fd28d014815 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:54.981207 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:55.025724 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49820b97-d270-4cef-bc93-6699d96e7daa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:55.026339 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49820b97-d270-4cef-bc93-6699d96e7daa service nova] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:55.026618 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49820b97-d270-4cef-bc93-6699d96e7daa service nova] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:55.026885 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49820b97-d270-4cef-bc93-6699d96e7daa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:55.028581 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-49820b97-d270-4cef-bc93-6699d96e7daa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:55.133985 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49820b97-d270-4cef-bc93-6699d96e7daa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:55.136452 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49820b97-d270-4cef-bc93-6699d96e7daa service nova] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:55.156634 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 707/1416] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:51:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:51:56.090887 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce611ca0-1b12-4fa4-8566-bda849a836ed None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:56.091582 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce611ca0-1b12-4fa4-8566-bda849a836ed None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:56.091728 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce611ca0-1b12-4fa4-8566-bda849a836ed None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:56.093060 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 710/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 00:51:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:56.098352 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe3b76-3deb-4d78-9864-73645c142a5b None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:56.098763 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe3b76-3deb-4d78-9864-73645c142a5b None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:56.098880 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe3b76-3deb-4d78-9864-73645c142a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:56.199221 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-eefe3b76-3deb-4d78-9864-73645c142a5b None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:56.200474 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-eefe3b76-3deb-4d78-9864-73645c142a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:56.230547 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:56.316139 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 708/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 00:51:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:51:56.481837 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce611ca0-1b12-4fa4-8566-bda849a836ed None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:56.483388 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-ce611ca0-1b12-4fa4-8566-bda849a836ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:56.662088 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce611ca0-1b12-4fa4-8566-bda849a836ed None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:56.716088 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:56.798756 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91794a7-1ba6-4977-a5fe-54e920a9ec16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:56.799367 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91794a7-1ba6-4977-a5fe-54e920a9ec16 service nova] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:56.799642 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91794a7-1ba6-4977-a5fe-54e920a9ec16 service nova] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:56.799964 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91794a7-1ba6-4977-a5fe-54e920a9ec16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:56.801552 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-f91794a7-1ba6-4977-a5fe-54e920a9ec16 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:56.906256 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91794a7-1ba6-4977-a5fe-54e920a9ec16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:56.907904 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91794a7-1ba6-4977-a5fe-54e920a9ec16 service nova] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:56.929877 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 711/1419] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:51:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:51:57.899339 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71115e7-12ee-4dfe-b560-bb4ceb3fbe92 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:57.899986 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71115e7-12ee-4dfe-b560-bb4ceb3fbe92 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:57.900080 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71115e7-12ee-4dfe-b560-bb4ceb3fbe92 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:57.901371 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 709/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 00:51:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:57.909567 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214efb57-dd8d-4aea-aeb2-a6d0f2821d18 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:57.910312 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214efb57-dd8d-4aea-aeb2-a6d0f2821d18 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:57.910461 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214efb57-dd8d-4aea-aeb2-a6d0f2821d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:57.984760 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:58.017520 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-214efb57-dd8d-4aea-aeb2-a6d0f2821d18 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:58.018745 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-214efb57-dd8d-4aea-aeb2-a6d0f2821d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:58.131122 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 712/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 00:51:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:51:58.285103 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71115e7-12ee-4dfe-b560-bb4ceb3fbe92 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:51:58.286807 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-c71115e7-12ee-4dfe-b560-bb4ceb3fbe92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:58.442606 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71115e7-12ee-4dfe-b560-bb4ceb3fbe92 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:51:58.455786 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:58.591776 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e76d3e0-bd9a-4e11-a3e2-08e823a45b7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:51:58.592293 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e76d3e0-bd9a-4e11-a3e2-08e823a45b7c service nova] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:58.592558 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e76d3e0-bd9a-4e11-a3e2-08e823a45b7c service nova] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:58.592838 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e76d3e0-bd9a-4e11-a3e2-08e823a45b7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:58.594477 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-7e76d3e0-bd9a-4e11-a3e2-08e823a45b7c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:58.695233 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e76d3e0-bd9a-4e11-a3e2-08e823a45b7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:51:58.696863 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e76d3e0-bd9a-4e11-a3e2-08e823a45b7c service nova] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:51:58.720172 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 710/1422] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:51:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:51:59.615737 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436fb2c-f948-4c39-a60c-8d1526a3f9b7 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:59.616647 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436fb2c-f948-4c39-a60c-8d1526a3f9b7 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:59.616831 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7436fb2c-f948-4c39-a60c-8d1526a3f9b7 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:59.618394 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 713/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 00:51:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:51:59.628277 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3164cd8-e523-44f1-901c-9c14d12cd5df None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:51:59.629052 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3164cd8-e523-44f1-901c-9c14d12cd5df None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:51:59.629142 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3164cd8-e523-44f1-901c-9c14d12cd5df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:51:59.653509 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:51:59.722903 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-e3164cd8-e523-44f1-901c-9c14d12cd5df None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:51:59.724387 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-e3164cd8-e523-44f1-901c-9c14d12cd5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:51:59.850957 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 711/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 00:51:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:52:00.008951 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7436fb2c-f948-4c39-a60c-8d1526a3f9b7 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:00.011271 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-7436fb2c-f948-4c39-a60c-8d1526a3f9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:00.150107 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:00.190091 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7436fb2c-f948-4c39-a60c-8d1526a3f9b7 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:00.323764 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d081289-8ffc-46a3-8c92-869b213ee34b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:00.324468 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d081289-8ffc-46a3-8c92-869b213ee34b service nova] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:00.324658 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d081289-8ffc-46a3-8c92-869b213ee34b service nova] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:00.324961 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d081289-8ffc-46a3-8c92-869b213ee34b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:00.326989 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-4d081289-8ffc-46a3-8c92-869b213ee34b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:00.405456 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:00.420167 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d081289-8ffc-46a3-8c92-869b213ee34b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:00.421763 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d081289-8ffc-46a3-8c92-869b213ee34b service nova] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:00.440020 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 714/1425] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:52:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:52:01.326482 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d81155-d50a-4d3d-891f-13d636160eb9 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:01.327309 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d81155-d50a-4d3d-891f-13d636160eb9 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:01.327309 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d81155-d50a-4d3d-891f-13d636160eb9 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:01.329372 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 712/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 00:52:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:52:01.337431 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfab9dc-0116-417e-b997-d6b2e19aa3bd None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:01.337914 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfab9dc-0116-417e-b997-d6b2e19aa3bd None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:01.338021 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfab9dc-0116-417e-b997-d6b2e19aa3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:01.420500 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-1dfab9dc-0116-417e-b997-d6b2e19aa3bd None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:01.421736 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-1dfab9dc-0116-417e-b997-d6b2e19aa3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:01.527860 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 715/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 00:52:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:52:01.686191 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d81155-d50a-4d3d-891f-13d636160eb9 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:01.688598 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-01d81155-d50a-4d3d-891f-13d636160eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:01.806347 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:01.873856 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d81155-d50a-4d3d-891f-13d636160eb9 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:02.006103 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78859ab6-d9b2-4ee6-b82f-addd7bb3fd24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:02.006620 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78859ab6-d9b2-4ee6-b82f-addd7bb3fd24 service nova] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:02.006894 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78859ab6-d9b2-4ee6-b82f-addd7bb3fd24 service nova] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:02.007155 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78859ab6-d9b2-4ee6-b82f-addd7bb3fd24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:02.008784 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-78859ab6-d9b2-4ee6-b82f-addd7bb3fd24 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:02.061681 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:02.107578 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78859ab6-d9b2-4ee6-b82f-addd7bb3fd24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:02.109247 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78859ab6-d9b2-4ee6-b82f-addd7bb3fd24 service nova] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:02.128873 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 713/1428] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:52:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:52:02.942967 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4741a75d-3aa5-4130-bcb9-440126a2aa8d None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:02.943563 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4741a75d-3aa5-4130-bcb9-440126a2aa8d None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:02.943563 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4741a75d-3aa5-4130-bcb9-440126a2aa8d None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:02.944910 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 716/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 00:52:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:52:02.950159 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48218d13-0ee7-49e5-8569-5ca73e24ab46 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:02.950619 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48218d13-0ee7-49e5-8569-5ca73e24ab46 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:02.950730 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48218d13-0ee7-49e5-8569-5ca73e24ab46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:03.030096 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-48218d13-0ee7-49e5-8569-5ca73e24ab46 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:03.031309 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-48218d13-0ee7-49e5-8569-5ca73e24ab46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:03.133657 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 714/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 00:52:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:52:03.289992 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4741a75d-3aa5-4130-bcb9-440126a2aa8d None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:03.292808 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-4741a75d-3aa5-4130-bcb9-440126a2aa8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:03.365626 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:03.475364 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4741a75d-3aa5-4130-bcb9-440126a2aa8d None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:03.608671 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fafbd27-141b-467f-a5db-800a60626aa0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:03.609303 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fafbd27-141b-467f-a5db-800a60626aa0 service nova] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:03.609580 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fafbd27-141b-467f-a5db-800a60626aa0 service nova] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:03.609845 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fafbd27-141b-467f-a5db-800a60626aa0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:03.613803 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-5fafbd27-141b-467f-a5db-800a60626aa0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:03.622142 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:03.721177 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fafbd27-141b-467f-a5db-800a60626aa0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:03.722885 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fafbd27-141b-467f-a5db-800a60626aa0 service nova] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:03.742191 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 717/1431] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:52:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:52:04.597208 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c781d9-2109-4750-b5f1-b423f393c354 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:04.597799 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c781d9-2109-4750-b5f1-b423f393c354 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:04.597799 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c781d9-2109-4750-b5f1-b423f393c354 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:04.599972 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 715/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 00:52:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:52:04.608075 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bcfd58-c3b1-4d1c-a733-d213a2e19860 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:04.608546 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bcfd58-c3b1-4d1c-a733-d213a2e19860 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:04.608644 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bcfd58-c3b1-4d1c-a733-d213a2e19860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:04.692414 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-51bcfd58-c3b1-4d1c-a733-d213a2e19860 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:04.693944 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-51bcfd58-c3b1-4d1c-a733-d213a2e19860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:04.771620 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:04.803564 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 718/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 00:52:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:52:04.968833 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c781d9-2109-4750-b5f1-b423f393c354 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:04.970361 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-75c781d9-2109-4750-b5f1-b423f393c354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:04.996818 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:05.265799 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c781d9-2109-4750-b5f1-b423f393c354 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:05.374703 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:05.408043 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9d8a8e-553f-49c7-bd5a-2e4ce62c35d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:05.408682 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d8a8e-553f-49c7-bd5a-2e4ce62c35d9 service nova] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:05.408954 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d8a8e-553f-49c7-bd5a-2e4ce62c35d9 service nova] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:05.409227 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9d8a8e-553f-49c7-bd5a-2e4ce62c35d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:05.411211 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-af9d8a8e-553f-49c7-bd5a-2e4ce62c35d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:05.526569 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d8a8e-553f-49c7-bd5a-2e4ce62c35d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:05.528265 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9d8a8e-553f-49c7-bd5a-2e4ce62c35d9 service nova] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:05.554663 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 716/1434] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:52:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 586 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:52:06.403978 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11914b-0a11-4ba5-9625-f213bde92539 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:06.404565 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11914b-0a11-4ba5-9625-f213bde92539 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:06.404565 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11914b-0a11-4ba5-9625-f213bde92539 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:06.406232 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 719/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 00:52:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:52:06.412749 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62abe4d-15a9-467b-acf9-ef4a41f64192 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:06.413457 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62abe4d-15a9-467b-acf9-ef4a41f64192 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:06.413682 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62abe4d-15a9-467b-acf9-ef4a41f64192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:06.522836 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-b62abe4d-15a9-467b-acf9-ef4a41f64192 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:06.524184 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-b62abe4d-15a9-467b-acf9-ef4a41f64192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:06.573914 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:06.636804 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 717/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 00:52:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:52:06.803199 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd11914b-0a11-4ba5-9625-f213bde92539 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:06.804821 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-bd11914b-0a11-4ba5-9625-f213bde92539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:06.972384 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd11914b-0a11-4ba5-9625-f213bde92539 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:07.035214 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:07.096315 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d14c5-1a79-4fed-92ad-675e70e4c621 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:07.096928 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d14c5-1a79-4fed-92ad-675e70e4c621 service nova] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:07.097201 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d14c5-1a79-4fed-92ad-675e70e4c621 service nova] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:07.097468 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d14c5-1a79-4fed-92ad-675e70e4c621 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:07.099084 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-dc2d14c5-1a79-4fed-92ad-675e70e4c621 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:07.210176 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2d14c5-1a79-4fed-92ad-675e70e4c621 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:07.211790 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2d14c5-1a79-4fed-92ad-675e70e4c621 service nova] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:07.231032 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 720/1437] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:52:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:52:08.043789 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8829e0-1a9c-4868-a842-0204713596c7 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:08.044393 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8829e0-1a9c-4868-a842-0204713596c7 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:08.044393 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8829e0-1a9c-4868-a842-0204713596c7 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:08.045591 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 718/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 00:52:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:52:08.051787 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c0f1fe-b1c5-4944-920f-745ec1c05960 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:08.052455 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c0f1fe-b1c5-4944-920f-745ec1c05960 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:08.052550 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c0f1fe-b1c5-4944-920f-745ec1c05960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:08.144003 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-68c0f1fe-b1c5-4944-920f-745ec1c05960 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:08.145289 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-68c0f1fe-b1c5-4944-920f-745ec1c05960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:08.147366 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:08.255310 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 721/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 00:52:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:52:08.414594 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8829e0-1a9c-4868-a842-0204713596c7 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:08.416864 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-6a8829e0-1a9c-4868-a842-0204713596c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:08.571468 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8829e0-1a9c-4868-a842-0204713596c7 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:08.598915 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:08.691186 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be7e5a-adf9-4924-a9f8-b3434096a9e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:08.691859 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be7e5a-adf9-4924-a9f8-b3434096a9e1 service nova] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:08.692137 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be7e5a-adf9-4924-a9f8-b3434096a9e1 service nova] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:08.692402 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be7e5a-adf9-4924-a9f8-b3434096a9e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:08.694025 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-56be7e5a-adf9-4924-a9f8-b3434096a9e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:08.798821 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56be7e5a-adf9-4924-a9f8-b3434096a9e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:08.800494 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56be7e5a-adf9-4924-a9f8-b3434096a9e1 service nova] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:08.819360 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 719/1440] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:52:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:52:10.640001 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182302c7-9fb1-4234-8f95-10a4c68f6734 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:10.640652 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182302c7-9fb1-4234-8f95-10a4c68f6734 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:10.640652 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182302c7-9fb1-4234-8f95-10a4c68f6734 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:10.641931 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 722/1441] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 00:52:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:52:10.647627 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b5dad-e274-405e-ba75-0b4a1055c3a8 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:10.648085 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b5dad-e274-405e-ba75-0b4a1055c3a8 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:10.648181 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b5dad-e274-405e-ba75-0b4a1055c3a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:10.693484 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:10.722547 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-832b5dad-e274-405e-ba75-0b4a1055c3a8 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:10.723870 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-832b5dad-e274-405e-ba75-0b4a1055c3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:10.827102 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 720/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 00:52:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:52:11.123977 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182302c7-9fb1-4234-8f95-10a4c68f6734 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:11.126105 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-182302c7-9fb1-4234-8f95-10a4c68f6734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:11.247866 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182302c7-9fb1-4234-8f95-10a4c68f6734 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:11.282679 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:11.329660 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae91740-2b1d-4f5e-909b-302060f36f1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:11.330174 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae91740-2b1d-4f5e-909b-302060f36f1c service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:11.330472 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae91740-2b1d-4f5e-909b-302060f36f1c service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:11.330760 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae91740-2b1d-4f5e-909b-302060f36f1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:11.332362 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-2ae91740-2b1d-4f5e-909b-302060f36f1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:11.444777 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae91740-2b1d-4f5e-909b-302060f36f1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:11.446207 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae91740-2b1d-4f5e-909b-302060f36f1c service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:11.465930 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 723/1443] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:52:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:52:13.587115 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43754fd-0bed-4019-a683-cffc6252f7e5 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:13.588273 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43754fd-0bed-4019-a683-cffc6252f7e5 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:13.588273 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43754fd-0bed-4019-a683-cffc6252f7e5 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:13.590327 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 721/1444] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 00:52:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:52:13.595921 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d9b863-3c11-47f2-8449-f5dd09d8d68c None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:13.596389 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d9b863-3c11-47f2-8449-f5dd09d8d68c None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:13.596498 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d9b863-3c11-47f2-8449-f5dd09d8d68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:13.665455 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-30d9b863-3c11-47f2-8449-f5dd09d8d68c None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:13.666689 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-30d9b863-3c11-47f2-8449-f5dd09d8d68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:13.679851 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:13.772105 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 724/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 00:52:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:52:14.076124 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43754fd-0bed-4019-a683-cffc6252f7e5 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:14.078907 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-d43754fd-0bed-4019-a683-cffc6252f7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:14.211056 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43754fd-0bed-4019-a683-cffc6252f7e5 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:14.224892 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:14.289234 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabbae6d-b6d5-407e-9c33-d38f03da917b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:14.289845 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabbae6d-b6d5-407e-9c33-d38f03da917b service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:14.290121 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabbae6d-b6d5-407e-9c33-d38f03da917b service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:14.290389 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabbae6d-b6d5-407e-9c33-d38f03da917b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:14.292033 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-aabbae6d-b6d5-407e-9c33-d38f03da917b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:14.408988 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabbae6d-b6d5-407e-9c33-d38f03da917b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:14.410365 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabbae6d-b6d5-407e-9c33-d38f03da917b service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:14.435906 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 722/1446] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:52:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:52:16.707569 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0321ffe6-92f3-4334-9b12-0e6945a4e87f None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:16.708226 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0321ffe6-92f3-4334-9b12-0e6945a4e87f None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:16.708226 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0321ffe6-92f3-4334-9b12-0e6945a4e87f None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:16.709509 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 725/1447] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 00:52:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:52:16.715908 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33461963-3db4-47d7-98ef-d70e0a88030a None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:16.716697 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33461963-3db4-47d7-98ef-d70e0a88030a None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:16.716845 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33461963-3db4-47d7-98ef-d70e0a88030a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:16.780054 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:16.804652 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-33461963-3db4-47d7-98ef-d70e0a88030a None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:16.805882 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-33461963-3db4-47d7-98ef-d70e0a88030a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:16.911577 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 723/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 00:52:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:52:17.203869 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0321ffe6-92f3-4334-9b12-0e6945a4e87f None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:17.205479 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-0321ffe6-92f3-4334-9b12-0e6945a4e87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:17.315473 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0321ffe6-92f3-4334-9b12-0e6945a4e87f None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:17.360007 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:17.401304 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b950380-c887-4d40-a9c7-d3820104fe8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:17.401923 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b950380-c887-4d40-a9c7-d3820104fe8f service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:17.402211 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b950380-c887-4d40-a9c7-d3820104fe8f service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:17.402482 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b950380-c887-4d40-a9c7-d3820104fe8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:17.404168 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-4b950380-c887-4d40-a9c7-d3820104fe8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:17.529246 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b950380-c887-4d40-a9c7-d3820104fe8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:17.531238 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b950380-c887-4d40-a9c7-d3820104fe8f service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:17.554345 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 726/1449] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:52:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:52:19.625436 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72196b8a-0d50-41aa-8f05-010c00c31e1e None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:19.626436 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72196b8a-0d50-41aa-8f05-010c00c31e1e None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:19.626436 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72196b8a-0d50-41aa-8f05-010c00c31e1e None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:19.628593 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 724/1450] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 00:52:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:52:19.635149 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9996db60-3dbf-4dba-b2f6-de357cec0ff5 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:19.635870 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9996db60-3dbf-4dba-b2f6-de357cec0ff5 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:19.636058 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9996db60-3dbf-4dba-b2f6-de357cec0ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:19.706965 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-9996db60-3dbf-4dba-b2f6-de357cec0ff5 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:19.708214 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-9996db60-3dbf-4dba-b2f6-de357cec0ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:19.730097 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:19.812837 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 727/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 00:52:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:52:20.110360 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72196b8a-0d50-41aa-8f05-010c00c31e1e None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:20.112914 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-72196b8a-0d50-41aa-8f05-010c00c31e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:20.238541 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72196b8a-0d50-41aa-8f05-010c00c31e1e None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:20.259571 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:20.320072 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f2ede1-96d3-482a-9e3b-fc29f5bafeaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:20.320683 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2ede1-96d3-482a-9e3b-fc29f5bafeaa service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:20.320954 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2ede1-96d3-482a-9e3b-fc29f5bafeaa service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:20.321227 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2ede1-96d3-482a-9e3b-fc29f5bafeaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:20.322841 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-c2f2ede1-96d3-482a-9e3b-fc29f5bafeaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:20.437837 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f2ede1-96d3-482a-9e3b-fc29f5bafeaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:20.439360 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f2ede1-96d3-482a-9e3b-fc29f5bafeaa service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:20.459244 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 725/1452] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:52:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:52:22.431955 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca167a50-df65-48ba-8398-c7f383a25dc9 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:22.432563 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca167a50-df65-48ba-8398-c7f383a25dc9 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:22.432563 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca167a50-df65-48ba-8398-c7f383a25dc9 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:22.434655 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 728/1453] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 00:52:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:52:22.442817 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464e9a4-8a52-46c0-b487-a952cd8d53b7 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:22.443298 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464e9a4-8a52-46c0-b487-a952cd8d53b7 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:22.443408 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464e9a4-8a52-46c0-b487-a952cd8d53b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:22.510451 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:22.514230 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-3464e9a4-8a52-46c0-b487-a952cd8d53b7 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:22.516189 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-3464e9a4-8a52-46c0-b487-a952cd8d53b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:22.628820 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 726/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 00:52:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:52:22.908691 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca167a50-df65-48ba-8398-c7f383a25dc9 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:22.910251 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-ca167a50-df65-48ba-8398-c7f383a25dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:23.030580 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca167a50-df65-48ba-8398-c7f383a25dc9 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:23.085606 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:23.111984 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43747d2-8dc6-4a38-a699-931362b9968b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:23.112620 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43747d2-8dc6-4a38-a699-931362b9968b service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:23.112903 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43747d2-8dc6-4a38-a699-931362b9968b service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:23.113171 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43747d2-8dc6-4a38-a699-931362b9968b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:23.114830 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-b43747d2-8dc6-4a38-a699-931362b9968b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:23.253261 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43747d2-8dc6-4a38-a699-931362b9968b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:23.254723 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43747d2-8dc6-4a38-a699-931362b9968b service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:23.280165 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 729/1455] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:52:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:52:25.249854 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a4dc2-7f49-4c6c-ae27-88a272138b56 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:25.250441 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a4dc2-7f49-4c6c-ae27-88a272138b56 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:25.250441 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a4dc2-7f49-4c6c-ae27-88a272138b56 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:25.251827 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 727/1456] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 00:52:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:52:25.257730 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007d947-7f9e-419f-bd4f-bd22b1d2cc17 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:25.258200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007d947-7f9e-419f-bd4f-bd22b1d2cc17 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:25.258298 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007d947-7f9e-419f-bd4f-bd22b1d2cc17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:25.347801 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-7007d947-7f9e-419f-bd4f-bd22b1d2cc17 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:25.349015 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-7007d947-7f9e-419f-bd4f-bd22b1d2cc17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:25.378131 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:25.460662 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 730/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 00:52:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:52:25.750111 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a4dc2-7f49-4c6c-ae27-88a272138b56 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:25.751689 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-8a6a4dc2-7f49-4c6c-ae27-88a272138b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:25.867083 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a4dc2-7f49-4c6c-ae27-88a272138b56 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:25.899180 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:25.949297 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa911f59-180c-45ad-b128-6ec2bde2a761 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:25.950256 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa911f59-180c-45ad-b128-6ec2bde2a761 service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:25.950558 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa911f59-180c-45ad-b128-6ec2bde2a761 service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:25.950973 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa911f59-180c-45ad-b128-6ec2bde2a761 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:25.953507 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-aa911f59-180c-45ad-b128-6ec2bde2a761 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:26.087287 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa911f59-180c-45ad-b128-6ec2bde2a761 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:26.088693 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa911f59-180c-45ad-b128-6ec2bde2a761 service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:26.108668 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 728/1458] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:52:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 00:52:28.050837 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679693c-96fe-44bf-acb0-45b16e60f70a None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:28.051424 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679693c-96fe-44bf-acb0-45b16e60f70a None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:28.051424 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679693c-96fe-44bf-acb0-45b16e60f70a None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:28.052995 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 731/1459] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 00:52:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:52:28.058624 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7879a-d5bf-4f03-8a20-66320a0f9526 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:28.059065 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7879a-d5bf-4f03-8a20-66320a0f9526 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:28.059218 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7879a-d5bf-4f03-8a20-66320a0f9526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:28.130067 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-93c7879a-d5bf-4f03-8a20-66320a0f9526 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:28.131304 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-93c7879a-d5bf-4f03-8a20-66320a0f9526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:28.140316 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:28.242309 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 729/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 00:52:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:52:28.525992 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1679693c-96fe-44bf-acb0-45b16e60f70a None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:28.528580 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-1679693c-96fe-44bf-acb0-45b16e60f70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:28.645696 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1679693c-96fe-44bf-acb0-45b16e60f70a None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:28.706143 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:28.726207 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9ad4f0-c8f0-4915-96a6-6c76b21d0aed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:28.726858 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9ad4f0-c8f0-4915-96a6-6c76b21d0aed service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:28.727136 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9ad4f0-c8f0-4915-96a6-6c76b21d0aed service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:28.727407 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9ad4f0-c8f0-4915-96a6-6c76b21d0aed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:28.729064 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-ef9ad4f0-c8f0-4915-96a6-6c76b21d0aed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:28.853347 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9ad4f0-c8f0-4915-96a6-6c76b21d0aed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:28.854801 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9ad4f0-c8f0-4915-96a6-6c76b21d0aed service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:28.873820 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 732/1461] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:52:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 00:52:30.900041 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c79c0b-9f3a-479f-93e2-8653b8dd2e82 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:30.900620 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c79c0b-9f3a-479f-93e2-8653b8dd2e82 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:30.900620 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c79c0b-9f3a-479f-93e2-8653b8dd2e82 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:30.901979 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 730/1462] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 00:52:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:52:30.907948 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea0805-52f6-4a23-9fc8-93bbbb48b133 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:30.908443 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea0805-52f6-4a23-9fc8-93bbbb48b133 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:30.908539 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea0805-52f6-4a23-9fc8-93bbbb48b133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:30.985583 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-f7ea0805-52f6-4a23-9fc8-93bbbb48b133 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:30.986731 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-f7ea0805-52f6-4a23-9fc8-93bbbb48b133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:31.025638 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:31.087062 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 733/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 00:52:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:52:31.367526 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c79c0b-9f3a-479f-93e2-8653b8dd2e82 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:31.369511 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-14c79c0b-9f3a-479f-93e2-8653b8dd2e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:31.488141 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c79c0b-9f3a-479f-93e2-8653b8dd2e82 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:31.528579 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:31.566139 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a469623f-89b0-4e47-83fb-7ef314c9a312 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:31.566765 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a469623f-89b0-4e47-83fb-7ef314c9a312 service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:31.566995 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a469623f-89b0-4e47-83fb-7ef314c9a312 service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:31.567290 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a469623f-89b0-4e47-83fb-7ef314c9a312 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:31.568946 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-a469623f-89b0-4e47-83fb-7ef314c9a312 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:31.684484 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a469623f-89b0-4e47-83fb-7ef314c9a312 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:31.686437 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a469623f-89b0-4e47-83fb-7ef314c9a312 service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:31.711204 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 731/1464] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:52:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:52:33.608931 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a104e-d6ae-42c2-91f0-97b630268634 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:33.609801 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a104e-d6ae-42c2-91f0-97b630268634 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:33.609801 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a104e-d6ae-42c2-91f0-97b630268634 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:33.611936 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 734/1465] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 00:52:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:52:33.618530 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43f04e-e23a-46b9-b72a-259beadb5d65 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:33.619208 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43f04e-e23a-46b9-b72a-259beadb5d65 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:33.619417 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43f04e-e23a-46b9-b72a-259beadb5d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:33.696295 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-2d43f04e-e23a-46b9-b72a-259beadb5d65 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:33.697516 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-2d43f04e-e23a-46b9-b72a-259beadb5d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:33.717637 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:33.804275 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 732/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 00:52:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:52:34.085840 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a104e-d6ae-42c2-91f0-97b630268634 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:34.087394 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-cd8a104e-d6ae-42c2-91f0-97b630268634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:34.205757 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a104e-d6ae-42c2-91f0-97b630268634 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:34.278329 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:34.286320 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad9649-1bc6-4c78-864f-1baa2be66722 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:34.286967 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad9649-1bc6-4c78-864f-1baa2be66722 service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:34.287244 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad9649-1bc6-4c78-864f-1baa2be66722 service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:34.287531 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad9649-1bc6-4c78-864f-1baa2be66722 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:34.289219 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-bdad9649-1bc6-4c78-864f-1baa2be66722 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:34.414871 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdad9649-1bc6-4c78-864f-1baa2be66722 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:34.416321 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdad9649-1bc6-4c78-864f-1baa2be66722 service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:34.435367 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 735/1467] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:52:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 00:52:36.342202 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e9266-869b-4057-9d05-30707749dcf4 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:36.343118 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e9266-869b-4057-9d05-30707749dcf4 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:36.343118 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e9266-869b-4057-9d05-30707749dcf4 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:36.345440 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 733/1468] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 00:52:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:52:36.354629 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e484b-6641-4f15-85d6-99ff2a017cde None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:36.355345 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e484b-6641-4f15-85d6-99ff2a017cde None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:36.355501 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e484b-6641-4f15-85d6-99ff2a017cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:36.427553 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-c55e484b-6641-4f15-85d6-99ff2a017cde None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:36.428778 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-c55e484b-6641-4f15-85d6-99ff2a017cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:36.482088 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:36.533683 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 736/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 00:52:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:52:36.815049 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97e9266-869b-4057-9d05-30707749dcf4 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:36.816622 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-b97e9266-869b-4057-9d05-30707749dcf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:36.942370 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97e9266-869b-4057-9d05-30707749dcf4 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:36.994331 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:37.020702 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d4c75a-cd5f-4bcd-b28d-fbca3f1308c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:37.021323 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4c75a-cd5f-4bcd-b28d-fbca3f1308c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:37.021595 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4c75a-cd5f-4bcd-b28d-fbca3f1308c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:37.021856 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4c75a-cd5f-4bcd-b28d-fbca3f1308c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:37.023460 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-76d4c75a-cd5f-4bcd-b28d-fbca3f1308c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:37.139014 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d4c75a-cd5f-4bcd-b28d-fbca3f1308c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:37.140575 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d4c75a-cd5f-4bcd-b28d-fbca3f1308c0 service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:37.159132 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 734/1470] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:52:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:52:46.531922 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=22 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:47.156691 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=66 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:56.779571 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c9b52-96cc-4810-8048-3a23828a25f5 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:56.780209 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c9b52-96cc-4810-8048-3a23828a25f5 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:56.780209 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c9b52-96cc-4810-8048-3a23828a25f5 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:56.781625 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 737/1471] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:52:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:52:56.787304 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9bc776-886f-435d-ae52-b7c12ffa44a9 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:56.787830 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9bc776-886f-435d-ae52-b7c12ffa44a9 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:56.787953 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9bc776-886f-435d-ae52-b7c12ffa44a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:56.856070 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-7e9bc776-886f-435d-ae52-b7c12ffa44a9 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:56.857301 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-7e9bc776-886f-435d-ae52-b7c12ffa44a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:56.965896 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 735/1472] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:52:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:52:57.268264 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2984ff-bfdc-4721-9cac-9cee6d09e56d None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:57.268550 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2984ff-bfdc-4721-9cac-9cee6d09e56d None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:57.268811 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2984ff-bfdc-4721-9cac-9cee6d09e56d None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:57.270711 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 738/1473] 10.222.0.49 () {54 vars in 967 bytes} [Sun Aug 28 00:52:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:52:57.275283 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d221e7a-837d-41ef-9007-8476ece4df6a None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:57.275583 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d221e7a-837d-41ef-9007-8476ece4df6a None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:57.275861 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d221e7a-837d-41ef-9007-8476ece4df6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:57.360365 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-9d221e7a-837d-41ef-9007-8476ece4df6a None None] MFA Rules not processed for user `22053bd9632346aab63814f740415f69`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:57.361496 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-9d221e7a-837d-41ef-9007-8476ece4df6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:57.382808 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:57.443839 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 736/1474] 10.222.0.49 () {58 vars in 1064 bytes} [Sun Aug 28 00:52:57 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:52:57.451624 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2984ff-bfdc-4721-9cac-9cee6d09e56d None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:52:57.453572 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-5b2984ff-bfdc-4721-9cac-9cee6d09e56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:57.562290 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2984ff-bfdc-4721-9cac-9cee6d09e56d None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:52:57.643599 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4b8eeb-4848-425f-8ce0-36c6655d492c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22053bd9632346aab63814f740415f69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:52:57.644216 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4b8eeb-4848-425f-8ce0-36c6655d492c service glance] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:57.644498 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4b8eeb-4848-425f-8ce0-36c6655d492c service glance] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:57.644770 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4b8eeb-4848-425f-8ce0-36c6655d492c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:57.646406 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-fe4b8eeb-4848-425f-8ce0-36c6655d492c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:57.704573 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:52:57.763379 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4b8eeb-4848-425f-8ce0-36c6655d492c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:52:57.764857 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4b8eeb-4848-425f-8ce0-36c6655d492c service glance] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:52:57.784277 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 739/1475] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:52:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:52:59.784878 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab22c4-9ef3-4164-8013-0350e6f3c453 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:59.785472 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab22c4-9ef3-4164-8013-0350e6f3c453 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:59.785472 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ab22c4-9ef3-4164-8013-0350e6f3c453 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:59.786765 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 737/1476] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:52:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:52:59.793663 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16486394-7721-4da7-b457-c274e45738b9 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:52:59.794111 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16486394-7721-4da7-b457-c274e45738b9 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:52:59.794215 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16486394-7721-4da7-b457-c274e45738b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:52:59.869180 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-16486394-7721-4da7-b457-c274e45738b9 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:52:59.870381 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-16486394-7721-4da7-b457-c274e45738b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:52:59.975714 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 740/1477] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:52:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:53:00.260392 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ab22c4-9ef3-4164-8013-0350e6f3c453 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:00.262894 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-a3ab22c4-9ef3-4164-8013-0350e6f3c453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:53:00.410564 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ab22c4-9ef3-4164-8013-0350e6f3c453 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:00.464916 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:00.518745 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0e4e08-8440-4918-99b5-71a97641e95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:00.519358 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e4e08-8440-4918-99b5-71a97641e95f admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:00.519634 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e4e08-8440-4918-99b5-71a97641e95f admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:00.519931 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e4e08-8440-4918-99b5-71a97641e95f admin admin] PATH_INFO: `/v3/projects` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:00.520566 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0e4e08-8440-4918-99b5-71a97641e95f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:00.522358 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: WARNING py.warnings [None req-aa0e4e08-8440-4918-99b5-71a97641e95f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 00:53:00.522358 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: warnings.warn(msg) Aug 28 00:53:00.522358 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: Aug 28 00:53:00.523522 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0e4e08-8440-4918-99b5-71a97641e95f admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:00.545032 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 738/1478] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 28 00:53:00 2022] GET /identity/v3/projects => generated 2553 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:53:02.468444 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c26694-d8d2-47a9-8342-eedc54daf014 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:02.469066 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c26694-d8d2-47a9-8342-eedc54daf014 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:02.469066 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c26694-d8d2-47a9-8342-eedc54daf014 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:02.470354 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 741/1479] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:53:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:53:02.475863 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d9bf2b-1b06-4b54-8c8f-97dc1ee35522 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:02.476658 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d9bf2b-1b06-4b54-8c8f-97dc1ee35522 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:02.476934 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d9bf2b-1b06-4b54-8c8f-97dc1ee35522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:02.548740 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-d7d9bf2b-1b06-4b54-8c8f-97dc1ee35522 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:53:02.549962 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-d7d9bf2b-1b06-4b54-8c8f-97dc1ee35522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:53:02.651495 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 739/1480] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:53:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:53:02.946566 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c26694-d8d2-47a9-8342-eedc54daf014 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:02.948103 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-11c26694-d8d2-47a9-8342-eedc54daf014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:53:02.958592 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:03.107218 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c26694-d8d2-47a9-8342-eedc54daf014 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:03.197159 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:03.233452 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f327f-6e79-4771-8b81-f4e94627d512 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:03.234223 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f327f-6e79-4771-8b81-f4e94627d512 service nova] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:03.234502 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f327f-6e79-4771-8b81-f4e94627d512 service nova] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:03.234769 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f327f-6e79-4771-8b81-f4e94627d512 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:03.236425 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-565f327f-6e79-4771-8b81-f4e94627d512 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:53:03.331406 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565f327f-6e79-4771-8b81-f4e94627d512 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:03.333051 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565f327f-6e79-4771-8b81-f4e94627d512 service nova] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:03.351769 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 742/1481] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:53:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:53:05.443570 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876aaffd-323a-4266-9312-727b0f8860ac None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:05.444233 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876aaffd-323a-4266-9312-727b0f8860ac None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:05.444233 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876aaffd-323a-4266-9312-727b0f8860ac None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:05.445551 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 740/1482] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:53:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:53:05.451327 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e7c24-bcb5-4e15-b225-f8e7be627c17 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:05.452215 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e7c24-bcb5-4e15-b225-f8e7be627c17 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:05.452215 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e7c24-bcb5-4e15-b225-f8e7be627c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:05.523017 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-2a8e7c24-bcb5-4e15-b225-f8e7be627c17 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:53:05.524400 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-2a8e7c24-bcb5-4e15-b225-f8e7be627c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:53:05.574307 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:05.629880 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 743/1483] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:53:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:53:05.924849 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876aaffd-323a-4266-9312-727b0f8860ac None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:05.926393 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-876aaffd-323a-4266-9312-727b0f8860ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:53:05.952786 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:06.042174 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876aaffd-323a-4266-9312-727b0f8860ac None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:06.119556 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1b0a42-ffdc-485e-98ea-4a996fa88a9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:06.120200 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b0a42-ffdc-485e-98ea-4a996fa88a9b service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:06.120475 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b0a42-ffdc-485e-98ea-4a996fa88a9b service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:06.120767 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1b0a42-ffdc-485e-98ea-4a996fa88a9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:06.122401 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-2c1b0a42-ffdc-485e-98ea-4a996fa88a9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:53:06.209987 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:06.246576 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1b0a42-ffdc-485e-98ea-4a996fa88a9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:06.248094 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1b0a42-ffdc-485e-98ea-4a996fa88a9b service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:06.269021 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 741/1484] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:53:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:53:08.215209 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a0a10-57e4-4855-9fc3-39f71d2034b8 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:08.215871 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a0a10-57e4-4855-9fc3-39f71d2034b8 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:08.215871 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a0a10-57e4-4855-9fc3-39f71d2034b8 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:08.217230 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 744/1485] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:53:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:53:08.223584 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94794778-f88c-4c01-91eb-ce3ee6b567ee None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:08.224209 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94794778-f88c-4c01-91eb-ce3ee6b567ee None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:08.224209 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94794778-f88c-4c01-91eb-ce3ee6b567ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:08.294805 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-94794778-f88c-4c01-91eb-ce3ee6b567ee None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:53:08.296183 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-94794778-f88c-4c01-91eb-ce3ee6b567ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:53:08.401149 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 742/1486] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:53:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:53:08.690615 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77a0a10-57e4-4855-9fc3-39f71d2034b8 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:08.692206 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-a77a0a10-57e4-4855-9fc3-39f71d2034b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:53:08.802996 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77a0a10-57e4-4855-9fc3-39f71d2034b8 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:08.883936 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:08.885617 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72c0765-e708-4feb-9040-8361853dbd17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:08.886747 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c0765-e708-4feb-9040-8361853dbd17 service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:08.886998 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c0765-e708-4feb-9040-8361853dbd17 service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:08.887325 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c0765-e708-4feb-9040-8361853dbd17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:08.889913 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-e72c0765-e708-4feb-9040-8361853dbd17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:53:09.001301 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72c0765-e708-4feb-9040-8361853dbd17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:09.002640 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72c0765-e708-4feb-9040-8361853dbd17 service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:09.022462 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 745/1487] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:53:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:53:11.067776 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a38562-3bdf-47fc-9ecf-9c19cc5ac7a3 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:11.068362 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a38562-3bdf-47fc-9ecf-9c19cc5ac7a3 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:11.068362 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a38562-3bdf-47fc-9ecf-9c19cc5ac7a3 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:11.069605 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 743/1488] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:53:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:53:11.075309 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec32a48-8409-4360-b4e9-23d08933485b None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:11.075804 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec32a48-8409-4360-b4e9-23d08933485b None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:11.075921 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec32a48-8409-4360-b4e9-23d08933485b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:11.145368 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-8ec32a48-8409-4360-b4e9-23d08933485b None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:53:11.146561 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-8ec32a48-8409-4360-b4e9-23d08933485b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:53:11.200823 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:11.246972 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 746/1489] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:53:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:53:11.533645 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a38562-3bdf-47fc-9ecf-9c19cc5ac7a3 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:11.535191 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-a8a38562-3bdf-47fc-9ecf-9c19cc5ac7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:53:11.574087 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:11.646873 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a38562-3bdf-47fc-9ecf-9c19cc5ac7a3 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:11.726073 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcee8727-21f6-4840-b61b-efc86142a4d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:11.726686 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee8727-21f6-4840-b61b-efc86142a4d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:11.726957 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee8727-21f6-4840-b61b-efc86142a4d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:11.727221 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcee8727-21f6-4840-b61b-efc86142a4d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:11.728846 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-dcee8727-21f6-4840-b61b-efc86142a4d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:53:11.811958 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:11.845137 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcee8727-21f6-4840-b61b-efc86142a4d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:11.846590 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcee8727-21f6-4840-b61b-efc86142a4d5 service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:11.865607 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 744/1490] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:53:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:53:14.119346 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d278e-8696-4e95-a442-d6961ca8a842 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:14.120553 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d278e-8696-4e95-a442-d6961ca8a842 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:14.120553 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2d278e-8696-4e95-a442-d6961ca8a842 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:14.122323 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 747/1491] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 28 00:53:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:53:14.128158 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d67f2e-d4cf-4c41-8a79-34c82de3986d None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:14.128746 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d67f2e-d4cf-4c41-8a79-34c82de3986d None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:14.128746 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d67f2e-d4cf-4c41-8a79-34c82de3986d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:14.198000 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-e1d67f2e-d4cf-4c41-8a79-34c82de3986d None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:53:14.199222 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-e1d67f2e-d4cf-4c41-8a79-34c82de3986d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:53:14.303676 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 745/1492] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 28 00:53:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:53:14.622872 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d278e-8696-4e95-a442-d6961ca8a842 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:53:14.625069 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-5c2d278e-8696-4e95-a442-d6961ca8a842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:53:14.752207 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2d278e-8696-4e95-a442-d6961ca8a842 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:53:14.834477 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d29e510-07c6-4aef-b060-f1f11915c61f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:53:14.835103 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29e510-07c6-4aef-b060-f1f11915c61f service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:53:14.835385 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29e510-07c6-4aef-b060-f1f11915c61f service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:53:14.835688 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29e510-07c6-4aef-b060-f1f11915c61f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:53:14.837367 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-2d29e510-07c6-4aef-b060-f1f11915c61f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:53:14.848964 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:14.969863 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d29e510-07c6-4aef-b060-f1f11915c61f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:53:14.971296 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d29e510-07c6-4aef-b060-f1f11915c61f service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:53:14.991721 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 748/1493] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:53:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:53:24.301822 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=82 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:53:24.989105 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=50 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:54:27.926483 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22a1fd-b5a9-4a33-9f83-a5ae27efdb31 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:27.927391 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22a1fd-b5a9-4a33-9f83-a5ae27efdb31 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:27.927391 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22a1fd-b5a9-4a33-9f83-a5ae27efdb31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:28.012691 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-1f22a1fd-b5a9-4a33-9f83-a5ae27efdb31 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:54:28.013846 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-1f22a1fd-b5a9-4a33-9f83-a5ae27efdb31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:28.118530 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 746/1494] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:54:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:54:28.127069 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c77b9-14da-4146-a971-42872d1058c8 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:28.127728 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c77b9-14da-4146-a971-42872d1058c8 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:28.127728 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c77b9-14da-4146-a971-42872d1058c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:28.205853 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-c59c77b9-14da-4146-a971-42872d1058c8 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:54:28.207086 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-c59c77b9-14da-4146-a971-42872d1058c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:28.308950 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 749/1495] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:54:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:54:28.313939 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f22a1fd-b5a9-4a33-9f83-a5ae27efdb31 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:28.315203 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-1f22a1fd-b5a9-4a33-9f83-a5ae27efdb31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:28.327037 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f22a1fd-b5a9-4a33-9f83-a5ae27efdb31 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:28.395998 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:54:28.431282 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e73ef2-8e58-4478-b241-7040a68a75f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:28.432002 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e73ef2-8e58-4478-b241-7040a68a75f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:28.432280 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e73ef2-8e58-4478-b241-7040a68a75f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:28.432551 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e73ef2-8e58-4478-b241-7040a68a75f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:28.433208 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e73ef2-8e58-4478-b241-7040a68a75f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:54:28.433509 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e73ef2-8e58-4478-b241-7040a68a75f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:28.434540 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: WARNING py.warnings [None req-14e73ef2-8e58-4478-b241-7040a68a75f0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 00:54:28.434540 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: warnings.warn(msg) Aug 28 00:54:28.434540 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: Aug 28 00:54:28.435448 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e73ef2-8e58-4478-b241-7040a68a75f0 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:28.447790 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 747/1496] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 00:54:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:54:28.456641 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c77b9-14da-4146-a971-42872d1058c8 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:28.466416 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c77b9-14da-4146-a971-42872d1058c8 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:28.533232 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:54:28.571563 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bfa1d7-4b08-485e-afc7-0be8274f828c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:28.572214 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bfa1d7-4b08-485e-afc7-0be8274f828c admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:28.572492 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bfa1d7-4b08-485e-afc7-0be8274f828c admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:28.572760 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bfa1d7-4b08-485e-afc7-0be8274f828c admin admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:28.573398 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bfa1d7-4b08-485e-afc7-0be8274f828c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:28.575146 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: WARNING py.warnings [None req-b7bfa1d7-4b08-485e-afc7-0be8274f828c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 00:54:28.575146 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: warnings.warn(msg) Aug 28 00:54:28.575146 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: Aug 28 00:54:28.576393 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bfa1d7-4b08-485e-afc7-0be8274f828c admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:28.635449 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 750/1497] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 00:54:28 2022] POST /identity/v3/projects => generated 379 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:54:28.639952 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e73ef2-8e58-4478-b241-7040a68a75f0 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:28.641514 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-14e73ef2-8e58-4478-b241-7040a68a75f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:28.677917 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e73ef2-8e58-4478-b241-7040a68a75f0 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:28.775796 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f119e-bcd0-40a7-811b-2c866b9c8b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:28.776410 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f119e-bcd0-40a7-811b-2c866b9c8b20 admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:28.776689 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f119e-bcd0-40a7-811b-2c866b9c8b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:28.776981 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f119e-bcd0-40a7-811b-2c866b9c8b20 admin admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:28.777626 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28f119e-bcd0-40a7-811b-2c866b9c8b20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:28.778686 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: WARNING py.warnings [None req-c28f119e-bcd0-40a7-811b-2c866b9c8b20 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 00:54:28.778686 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: warnings.warn(msg) Aug 28 00:54:28.778686 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: Aug 28 00:54:28.779960 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28f119e-bcd0-40a7-811b-2c866b9c8b20 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:28.826520 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 748/1498] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 00:54:28 2022] POST /identity/v3/users => generated 290 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:54:28.831027 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bfa1d7-4b08-485e-afc7-0be8274f828c admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:28.832607 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-b7bfa1d7-4b08-485e-afc7-0be8274f828c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:28.899628 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bfa1d7-4b08-485e-afc7-0be8274f828c admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:28.986526 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:54:28.998448 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d763d15-6ed5-461b-ab48-d71968457f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:28.999056 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d763d15-6ed5-461b-ab48-d71968457f9b admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:28.999326 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d763d15-6ed5-461b-ab48-d71968457f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:28.999588 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d763d15-6ed5-461b-ab48-d71968457f9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:29.000270 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d763d15-6ed5-461b-ab48-d71968457f9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:29.001270 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: WARNING py.warnings [None req-6d763d15-6ed5-461b-ab48-d71968457f9b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 00:54:29.001270 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: warnings.warn(msg) Aug 28 00:54:29.001270 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: Aug 28 00:54:29.002157 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d763d15-6ed5-461b-ab48-d71968457f9b admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:29.015219 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 751/1499] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:54:28 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:54:29.019701 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f119e-bcd0-40a7-811b-2c866b9c8b20 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:29.021368 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-c28f119e-bcd0-40a7-811b-2c866b9c8b20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:29.033115 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f119e-bcd0-40a7-811b-2c866b9c8b20 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:29.059087 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:54:29.135168 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6171ed-53d4-481d-bee7-7fc839568e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:29.135826 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6171ed-53d4-481d-bee7-7fc839568e50 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:29.136090 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6171ed-53d4-481d-bee7-7fc839568e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:29.136475 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6171ed-53d4-481d-bee7-7fc839568e50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:29.136994 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6171ed-53d4-481d-bee7-7fc839568e50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:29.138054 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: WARNING py.warnings [None req-2b6171ed-53d4-481d-bee7-7fc839568e50 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 00:54:29.138054 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: warnings.warn(msg) Aug 28 00:54:29.138054 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: Aug 28 00:54:29.138952 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6171ed-53d4-481d-bee7-7fc839568e50 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:29.153335 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 749/1500] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:54:29 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:54:29.158160 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d763d15-6ed5-461b-ab48-d71968457f9b admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:29.159781 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-6d763d15-6ed5-461b-ab48-d71968457f9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:29.197959 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d763d15-6ed5-461b-ab48-d71968457f9b admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:29.319857 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50388a3c-5263-4f57-8f92-7d5ae52e8096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:29.320965 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50388a3c-5263-4f57-8f92-7d5ae52e8096 admin admin] REQUEST_METHOD: `PUT` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:29.321452 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50388a3c-5263-4f57-8f92-7d5ae52e8096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:29.321925 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50388a3c-5263-4f57-8f92-7d5ae52e8096 admin admin] PATH_INFO: `/v3/projects/52ddf3829d1e4cbcaba8b952e66e53c1/users/f8076d48b5034e9ab50221ebf17936d4/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:29.361019 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50388a3c-5263-4f57-8f92-7d5ae52e8096 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52ddf3829d1e4cbcaba8b952e66e53c1, user_id=f8076d48b5034e9ab50221ebf17936d4, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:29.362896 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: WARNING py.warnings [None req-50388a3c-5263-4f57-8f92-7d5ae52e8096 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 00:54:29.362896 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: warnings.warn(msg) Aug 28 00:54:29.362896 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: Aug 28 00:54:29.366849 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50388a3c-5263-4f57-8f92-7d5ae52e8096 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:29.397200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 752/1501] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 00:54:29 2022] PUT /identity/v3/projects/52ddf3829d1e4cbcaba8b952e66e53c1/users/f8076d48b5034e9ab50221ebf17936d4/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:54:29.411002 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35404f82-15f0-409e-8a21-c3ad2394125a None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:29.411377 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35404f82-15f0-409e-8a21-c3ad2394125a None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:29.411628 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35404f82-15f0-409e-8a21-c3ad2394125a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:29.472453 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-35404f82-15f0-409e-8a21-c3ad2394125a None None] MFA Rules not processed for user `f8076d48b5034e9ab50221ebf17936d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:54:29.473961 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-35404f82-15f0-409e-8a21-c3ad2394125a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:29.554860 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 750/1502] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:54:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:54:29.568251 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59449b9c-b0ed-4635-8101-8cc9a289326d None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:29.568468 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59449b9c-b0ed-4635-8101-8cc9a289326d None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:29.568803 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59449b9c-b0ed-4635-8101-8cc9a289326d None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:29.570166 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 753/1503] 10.222.0.49 () {54 vars in 964 bytes} [Sun Aug 28 00:54:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:54:29.575427 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768babc-447a-4905-8e24-ccaa6f12d014 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:29.575766 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768babc-447a-4905-8e24-ccaa6f12d014 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:29.576039 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768babc-447a-4905-8e24-ccaa6f12d014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:29.608659 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:54:29.656061 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-6768babc-447a-4905-8e24-ccaa6f12d014 None None] MFA Rules not processed for user `95355adb5a6a4a69a31904247eac6d69`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:54:29.657359 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-6768babc-447a-4905-8e24-ccaa6f12d014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:29.740110 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 751/1504] 10.222.0.49 () {58 vars in 1061 bytes} [Sun Aug 28 00:54:29 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:54:29.748232 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59449b9c-b0ed-4635-8101-8cc9a289326d None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:29.749800 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-59449b9c-b0ed-4635-8101-8cc9a289326d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:29.800061 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:54:29.857379 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59449b9c-b0ed-4635-8101-8cc9a289326d None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:29.932709 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f32d6-dd48-4c3e-b1d7-79ba540b8535 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95355adb5a6a4a69a31904247eac6d69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:29.933248 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f32d6-dd48-4c3e-b1d7-79ba540b8535 service cinder] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:29.933523 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f32d6-dd48-4c3e-b1d7-79ba540b8535 service cinder] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:29.933790 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f32d6-dd48-4c3e-b1d7-79ba540b8535 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:29.935488 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-270f32d6-dd48-4c3e-b1d7-79ba540b8535 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:30.044386 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270f32d6-dd48-4c3e-b1d7-79ba540b8535 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:30.045957 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270f32d6-dd48-4c3e-b1d7-79ba540b8535 service cinder] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:30.049771 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:54:30.066644 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 754/1505] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:54:29 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:54:30.117565 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de79f4e-ffca-452e-abb4-3fc800ab9885 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:30.118120 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de79f4e-ffca-452e-abb4-3fc800ab9885 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:30.118120 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de79f4e-ffca-452e-abb4-3fc800ab9885 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:30.119410 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 752/1506] 10.222.0.49 () {52 vars in 830 bytes} [Sun Aug 28 00:54:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:54:30.123791 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f32d6-dd48-4c3e-b1d7-79ba540b8535 service cinder] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:30.125010 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-270f32d6-dd48-4c3e-b1d7-79ba540b8535 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:30.232289 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f32d6-dd48-4c3e-b1d7-79ba540b8535 service cinder] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:30.326117 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d80f93c-1b1f-498e-b5c6-bb9726759223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:30.326758 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80f93c-1b1f-498e-b5c6-bb9726759223 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:30.327034 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80f93c-1b1f-498e-b5c6-bb9726759223 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:30.327289 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80f93c-1b1f-498e-b5c6-bb9726759223 admin admin] PATH_INFO: `/v3/users/f8076d48b5034e9ab50221ebf17936d4` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:30.340399 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d80f93c-1b1f-498e-b5c6-bb9726759223 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8076d48b5034e9ab50221ebf17936d4)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:30.341434 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: WARNING py.warnings [None req-7d80f93c-1b1f-498e-b5c6-bb9726759223 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 00:54:30.341434 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: warnings.warn(msg) Aug 28 00:54:30.341434 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: Aug 28 00:54:30.342660 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d80f93c-1b1f-498e-b5c6-bb9726759223 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:30.353027 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:54:30.413451 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-7d80f93c-1b1f-498e-b5c6-bb9726759223 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8076d48b5034e9ab50221ebf17936d4'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:54:30.424042 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-7d80f93c-1b1f-498e-b5c6-bb9726759223 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8076d48b5034e9ab50221ebf17936d4'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:54:30.448185 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-7d80f93c-1b1f-498e-b5c6-bb9726759223 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8076d48b5034e9ab50221ebf17936d4'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:54:30.448674 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-7d80f93c-1b1f-498e-b5c6-bb9726759223 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8076d48b5034e9ab50221ebf17936d4'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:54:30.449200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-7d80f93c-1b1f-498e-b5c6-bb9726759223 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8076d48b5034e9ab50221ebf17936d4'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:54:30.470915 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 755/1507] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 00:54:30 2022] DELETE /identity/v3/users/f8076d48b5034e9ab50221ebf17936d4 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:54:30.475560 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469271fc-17e7-4ca7-a39a-e663cbaed5b2 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:30.475870 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469271fc-17e7-4ca7-a39a-e663cbaed5b2 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:30.476376 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469271fc-17e7-4ca7-a39a-e663cbaed5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:30.534767 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-469271fc-17e7-4ca7-a39a-e663cbaed5b2 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:54:30.535939 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-469271fc-17e7-4ca7-a39a-e663cbaed5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:30.617042 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:54:30.630881 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 753/1508] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:54:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:54:30.640943 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d80f93c-1b1f-498e-b5c6-bb9726759223 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:30.642226 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-7d80f93c-1b1f-498e-b5c6-bb9726759223 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:30.747456 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d80f93c-1b1f-498e-b5c6-bb9726759223 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:30.803983 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:54:30.826926 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e277ef57-9a4c-4370-b22e-45204be44175 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:30.827822 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e277ef57-9a4c-4370-b22e-45204be44175 service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:30.828102 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e277ef57-9a4c-4370-b22e-45204be44175 service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:30.828358 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e277ef57-9a4c-4370-b22e-45204be44175 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:30.830056 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-e277ef57-9a4c-4370-b22e-45204be44175 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:30.942573 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e277ef57-9a4c-4370-b22e-45204be44175 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:30.944044 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e277ef57-9a4c-4370-b22e-45204be44175 service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:30.963856 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 756/1509] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:54:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:54:31.355594 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469271fc-17e7-4ca7-a39a-e663cbaed5b2 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:54:31.357004 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-469271fc-17e7-4ca7-a39a-e663cbaed5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:54:31.373104 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469271fc-17e7-4ca7-a39a-e663cbaed5b2 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:54:31.492053 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b8ec24-b279-47be-9a8e-585f95ab44c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:54:31.492689 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b8ec24-b279-47be-9a8e-585f95ab44c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:54:31.492969 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b8ec24-b279-47be-9a8e-585f95ab44c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:54:31.493244 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b8ec24-b279-47be-9a8e-585f95ab44c7 admin admin] PATH_INFO: `/v3/projects/52ddf3829d1e4cbcaba8b952e66e53c1` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:54:31.503464 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b8ec24-b279-47be-9a8e-585f95ab44c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52ddf3829d1e4cbcaba8b952e66e53c1)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:54:31.504666 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: WARNING py.warnings [None req-c0b8ec24-b279-47be-9a8e-585f95ab44c7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 00:54:31.504666 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: warnings.warn(msg) Aug 28 00:54:31.504666 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: Aug 28 00:54:31.505907 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b8ec24-b279-47be-9a8e-585f95ab44c7 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:54:31.570214 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-c0b8ec24-b279-47be-9a8e-585f95ab44c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52ddf3829d1e4cbcaba8b952e66e53c1', 'request_id': 'req-c0b8ec24-b279-47be-9a8e-585f95ab44c7'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:54:31.585028 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-c0b8ec24-b279-47be-9a8e-585f95ab44c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52ddf3829d1e4cbcaba8b952e66e53c1', 'request_id': 'req-c0b8ec24-b279-47be-9a8e-585f95ab44c7'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:54:31.597531 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-c0b8ec24-b279-47be-9a8e-585f95ab44c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52ddf3829d1e4cbcaba8b952e66e53c1', 'request_id': 'req-c0b8ec24-b279-47be-9a8e-585f95ab44c7'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:54:31.625337 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-c0b8ec24-b279-47be-9a8e-585f95ab44c7 admin admin] The token cache is being invalidate because project 52ddf3829d1e4cbcaba8b952e66e53c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81807) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:54:31.625633 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-c0b8ec24-b279-47be-9a8e-585f95ab44c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:54:31.626064 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-c0b8ec24-b279-47be-9a8e-585f95ab44c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:54:31.627541 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 754/1510] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 00:54:31 2022] DELETE /identity/v3/projects/52ddf3829d1e4cbcaba8b952e66e53c1 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:54:40.961172 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=62 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:54:41.622293 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:44.831257 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367494cb-ddc3-499e-bae0-e7c1178a89e4 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:44.832126 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367494cb-ddc3-499e-bae0-e7c1178a89e4 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:44.832126 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367494cb-ddc3-499e-bae0-e7c1178a89e4 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:44.833254 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 757/1511] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 00:55:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:55:44.840292 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba99172-505a-4585-abc7-e5c41942b4b1 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:44.840924 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba99172-505a-4585-abc7-e5c41942b4b1 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:44.841358 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba99172-505a-4585-abc7-e5c41942b4b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:44.945605 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-1ba99172-505a-4585-abc7-e5c41942b4b1 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:44.946868 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-1ba99172-505a-4585-abc7-e5c41942b4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:45.072669 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 755/1512] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 00:55:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:55:45.234142 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367494cb-ddc3-499e-bae0-e7c1178a89e4 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:45.236712 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-367494cb-ddc3-499e-bae0-e7c1178a89e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:45.414099 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367494cb-ddc3-499e-bae0-e7c1178a89e4 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:45.423388 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9176686-f7da-4647-aa14-a5b11f9262e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:45.424480 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9176686-f7da-4647-aa14-a5b11f9262e1 service nova] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:45.425008 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9176686-f7da-4647-aa14-a5b11f9262e1 service nova] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:45.425469 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9176686-f7da-4647-aa14-a5b11f9262e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:45.440800 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9176686-f7da-4647-aa14-a5b11f9262e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:45.443872 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9176686-f7da-4647-aa14-a5b11f9262e1 service nova] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:45.461727 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 758/1513] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:55:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:55:46.503525 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5896b-e700-48c2-a3cf-9fd67cd5e020 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:46.504214 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5896b-e700-48c2-a3cf-9fd67cd5e020 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:46.504214 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd5896b-e700-48c2-a3cf-9fd67cd5e020 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:46.505453 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 756/1514] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 00:55:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:55:46.511538 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cda398-7052-4bf8-a78f-7bbc9a6ae809 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:46.512046 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cda398-7052-4bf8-a78f-7bbc9a6ae809 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:46.512166 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cda398-7052-4bf8-a78f-7bbc9a6ae809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:46.533219 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-52cda398-7052-4bf8-a78f-7bbc9a6ae809 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:46.534592 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-52cda398-7052-4bf8-a78f-7bbc9a6ae809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:46.542954 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 759/1515] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 00:55:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:55:46.698221 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd5896b-e700-48c2-a3cf-9fd67cd5e020 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:46.713399 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd5896b-e700-48c2-a3cf-9fd67cd5e020 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:46.719477 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad957f8-67ca-434c-8fb3-3dc189ada5ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:46.720131 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad957f8-67ca-434c-8fb3-3dc189ada5ca service nova] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:46.720410 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad957f8-67ca-434c-8fb3-3dc189ada5ca service nova] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:46.720684 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad957f8-67ca-434c-8fb3-3dc189ada5ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:46.730391 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad957f8-67ca-434c-8fb3-3dc189ada5ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:46.732064 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad957f8-67ca-434c-8fb3-3dc189ada5ca service nova] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:46.743104 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 757/1516] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:55:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:55:51.226168 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c130f2c0-7b94-4097-99a5-7c6114ea3ea3 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:51.226911 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c130f2c0-7b94-4097-99a5-7c6114ea3ea3 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:51.227070 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c130f2c0-7b94-4097-99a5-7c6114ea3ea3 None None] PATH_INFO: `/v3` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:51.228625 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 760/1517] 10.222.0.47 () {54 vars in 925 bytes} [Sun Aug 28 00:55:51 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:55:51.236833 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e81a336-250b-404f-9b57-f4373c46169f None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:51.237465 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e81a336-250b-404f-9b57-f4373c46169f None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:51.237722 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e81a336-250b-404f-9b57-f4373c46169f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:51.308501 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-6e81a336-250b-404f-9b57-f4373c46169f None None] MFA Rules not processed for user `8f4fc1d11f5641b0b5f301b234282aa9`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:51.309732 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-6e81a336-250b-404f-9b57-f4373c46169f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:51.329153 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:51.392894 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 758/1518] 10.222.0.47 () {58 vars in 1015 bytes} [Sun Aug 28 00:55:51 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:55:56.528017 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=56 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:55:58.052396 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe622305-f1f9-4f44-b79e-16f73b612319 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:58.053376 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe622305-f1f9-4f44-b79e-16f73b612319 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:58.053376 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe622305-f1f9-4f44-b79e-16f73b612319 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:58.054933 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 761/1519] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 00:55:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:55:58.060798 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df44e6-8b96-4061-a1d1-393d2306fb12 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:58.061676 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df44e6-8b96-4061-a1d1-393d2306fb12 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:58.061676 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df44e6-8b96-4061-a1d1-393d2306fb12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:58.084925 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-e7df44e6-8b96-4061-a1d1-393d2306fb12 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:58.087204 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-e7df44e6-8b96-4061-a1d1-393d2306fb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:58.098142 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 759/1520] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 00:55:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:55:58.269831 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe622305-f1f9-4f44-b79e-16f73b612319 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:58.293256 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe622305-f1f9-4f44-b79e-16f73b612319 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:58.299901 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d009e4f-50c9-44c0-a408-2f5d70c2570b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:58.300607 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d009e4f-50c9-44c0-a408-2f5d70c2570b service nova] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:58.300942 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d009e4f-50c9-44c0-a408-2f5d70c2570b service nova] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:58.301251 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d009e4f-50c9-44c0-a408-2f5d70c2570b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:58.312063 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d009e4f-50c9-44c0-a408-2f5d70c2570b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:58.314059 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d009e4f-50c9-44c0-a408-2f5d70c2570b service nova] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:58.324881 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 762/1521] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:55:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:55:59.213752 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e152d-5519-46f3-a566-7ab038c9049b None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:59.214549 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e152d-5519-46f3-a566-7ab038c9049b None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:59.214549 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360e152d-5519-46f3-a566-7ab038c9049b None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:59.215902 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 760/1522] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 28 00:55:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:55:59.222513 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698145fd-3a42-4bf0-9902-5a55bbf83feb None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:59.223395 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698145fd-3a42-4bf0-9902-5a55bbf83feb None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:59.223395 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698145fd-3a42-4bf0-9902-5a55bbf83feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:59.254610 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-698145fd-3a42-4bf0-9902-5a55bbf83feb None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:55:59.257145 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-698145fd-3a42-4bf0-9902-5a55bbf83feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:55:59.271170 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 763/1523] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 28 00:55:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:55:59.430259 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e152d-5519-46f3-a566-7ab038c9049b None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:55:59.451331 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360e152d-5519-46f3-a566-7ab038c9049b None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:55:59.461206 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc64e82b-d7a7-4853-a39f-ee04fdafe126 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:55:59.462291 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64e82b-d7a7-4853-a39f-ee04fdafe126 service nova] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:55:59.462877 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64e82b-d7a7-4853-a39f-ee04fdafe126 service nova] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:55:59.463474 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64e82b-d7a7-4853-a39f-ee04fdafe126 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:55:59.479704 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc64e82b-d7a7-4853-a39f-ee04fdafe126 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:55:59.482667 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc64e82b-d7a7-4853-a39f-ee04fdafe126 service nova] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:55:59.501176 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 761/1524] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:55:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:56:00.105122 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b551a8-8fb3-41fb-ba70-3f0ee5a8a451 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:00.105387 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b551a8-8fb3-41fb-ba70-3f0ee5a8a451 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:00.105566 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b551a8-8fb3-41fb-ba70-3f0ee5a8a451 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:00.106955 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 764/1525] 10.222.0.49 () {54 vars in 961 bytes} [Sun Aug 28 00:56:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:56:00.112727 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5c12f-09ed-4855-b481-6c1e0a3da8dd None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:00.113148 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5c12f-09ed-4855-b481-6c1e0a3da8dd None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:00.113522 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d5c12f-09ed-4855-b481-6c1e0a3da8dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:00.135332 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-44d5c12f-09ed-4855-b481-6c1e0a3da8dd None None] MFA Rules not processed for user `8f4fc1d11f5641b0b5f301b234282aa9`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:56:00.136759 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-44d5c12f-09ed-4855-b481-6c1e0a3da8dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:00.147915 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 762/1526] 10.222.0.49 () {58 vars in 1058 bytes} [Sun Aug 28 00:56:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:56:00.156672 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b551a8-8fb3-41fb-ba70-3f0ee5a8a451 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:00.177554 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b551a8-8fb3-41fb-ba70-3f0ee5a8a451 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:00.184982 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf437b27-c2bb-4c7b-9df2-b288025173ae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4fc1d11f5641b0b5f301b234282aa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:00.185699 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf437b27-c2bb-4c7b-9df2-b288025173ae service placement] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:00.186024 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf437b27-c2bb-4c7b-9df2-b288025173ae service placement] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:00.186300 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf437b27-c2bb-4c7b-9df2-b288025173ae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:00.196760 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf437b27-c2bb-4c7b-9df2-b288025173ae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:00.198569 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf437b27-c2bb-4c7b-9df2-b288025173ae service placement] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:00.210170 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 765/1527] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:56:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:56:03.597407 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f4b6c-a388-44cb-8914-1b01c2d15fb9 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:03.598278 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f4b6c-a388-44cb-8914-1b01c2d15fb9 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:03.598278 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f4b6c-a388-44cb-8914-1b01c2d15fb9 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:03.600050 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 763/1528] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 00:56:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:56:03.606604 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6757e479-2ca3-4c8b-8461-dd7c8950f397 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:03.607206 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6757e479-2ca3-4c8b-8461-dd7c8950f397 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:03.607206 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6757e479-2ca3-4c8b-8461-dd7c8950f397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:03.628269 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-6757e479-2ca3-4c8b-8461-dd7c8950f397 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:56:03.629538 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-6757e479-2ca3-4c8b-8461-dd7c8950f397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:03.637957 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 766/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 00:56:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:56:03.936358 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f4b6c-a388-44cb-8914-1b01c2d15fb9 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:03.938342 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-247f4b6c-a388-44cb-8914-1b01c2d15fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:04.032872 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f4b6c-a388-44cb-8914-1b01c2d15fb9 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:04.036844 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eaca83-17a2-460a-bd4f-85d48ae763bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:04.037430 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eaca83-17a2-460a-bd4f-85d48ae763bd service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:04.037713 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eaca83-17a2-460a-bd4f-85d48ae763bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:04.038009 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eaca83-17a2-460a-bd4f-85d48ae763bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:04.048273 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eaca83-17a2-460a-bd4f-85d48ae763bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:04.049789 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eaca83-17a2-460a-bd4f-85d48ae763bd service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:04.059633 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 764/1530] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:56:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:56:06.045084 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde36d0b-7a51-4fb1-92a1-94627379b552 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:06.045644 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde36d0b-7a51-4fb1-92a1-94627379b552 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:06.045644 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde36d0b-7a51-4fb1-92a1-94627379b552 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:06.046936 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 767/1531] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 28 00:56:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:56:06.053026 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f889f-dd80-445b-ad8f-4a71cead2b64 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:06.053570 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f889f-dd80-445b-ad8f-4a71cead2b64 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:06.053570 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f889f-dd80-445b-ad8f-4a71cead2b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:06.074732 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-e02f889f-dd80-445b-ad8f-4a71cead2b64 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:56:06.076059 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-e02f889f-dd80-445b-ad8f-4a71cead2b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:06.085527 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 765/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 28 00:56:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:56:06.376562 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde36d0b-7a51-4fb1-92a1-94627379b552 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:56:06.378572 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-dde36d0b-7a51-4fb1-92a1-94627379b552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:56:06.393593 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde36d0b-7a51-4fb1-92a1-94627379b552 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:56:06.397748 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d88a94a-3839-4b30-a232-0eb94f62675a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:56:06.398367 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88a94a-3839-4b30-a232-0eb94f62675a service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:56:06.398644 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88a94a-3839-4b30-a232-0eb94f62675a service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:56:06.398915 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88a94a-3839-4b30-a232-0eb94f62675a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:56:06.409116 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d88a94a-3839-4b30-a232-0eb94f62675a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:56:06.410904 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d88a94a-3839-4b30-a232-0eb94f62675a service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:56:06.421517 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 768/1533] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:56:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:56:16.069446 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=73 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:56:16.416967 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=24 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:23.460155 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a6b726-3e45-407e-9f7d-ec0c60423d22 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:23.460878 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a6b726-3e45-407e-9f7d-ec0c60423d22 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:23.460878 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a6b726-3e45-407e-9f7d-ec0c60423d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:23.486072 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-11a6b726-3e45-407e-9f7d-ec0c60423d22 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:23.487348 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-11a6b726-3e45-407e-9f7d-ec0c60423d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:23.502354 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 766/1534] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:57:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:57:23.511529 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4ecaa-bdd7-4e2f-8b22-19a123792ced None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:23.512200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4ecaa-bdd7-4e2f-8b22-19a123792ced None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:23.512200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4ecaa-bdd7-4e2f-8b22-19a123792ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:23.541428 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-a2d4ecaa-bdd7-4e2f-8b22-19a123792ced None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:23.543243 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-a2d4ecaa-bdd7-4e2f-8b22-19a123792ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:23.567517 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 769/1535] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:57:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:23.570964 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a6b726-3e45-407e-9f7d-ec0c60423d22 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:23.589731 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a6b726-3e45-407e-9f7d-ec0c60423d22 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:23.596775 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a7d65-8c97-41a5-a3a9-e8969b003089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:23.597430 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a7d65-8c97-41a5-a3a9-e8969b003089 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:23.597709 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a7d65-8c97-41a5-a3a9-e8969b003089 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:23.597979 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48a7d65-8c97-41a5-a3a9-e8969b003089 admin admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:23.598701 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48a7d65-8c97-41a5-a3a9-e8969b003089 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:57:23.599004 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48a7d65-8c97-41a5-a3a9-e8969b003089 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:23.600768 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48a7d65-8c97-41a5-a3a9-e8969b003089 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:23.625311 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 767/1536] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 00:57:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:57:23.634773 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d4ecaa-bdd7-4e2f-8b22-19a123792ced None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:23.654423 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d4ecaa-bdd7-4e2f-8b22-19a123792ced None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:23.663390 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b94735f-222d-4fb6-bd96-680bc45af876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:23.664376 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b94735f-222d-4fb6-bd96-680bc45af876 admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:23.664663 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b94735f-222d-4fb6-bd96-680bc45af876 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:23.664940 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b94735f-222d-4fb6-bd96-680bc45af876 admin admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:23.665620 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b94735f-222d-4fb6-bd96-680bc45af876 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:23.667687 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b94735f-222d-4fb6-bd96-680bc45af876 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:23.724762 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 770/1537] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 00:57:23 2022] POST /identity/v3/projects => generated 409 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:57:23.737145 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a7d65-8c97-41a5-a3a9-e8969b003089 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:23.751881 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48a7d65-8c97-41a5-a3a9-e8969b003089 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:23.794381 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465e610-54db-4b11-9beb-9202d6e2ccc5 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:23.794587 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465e610-54db-4b11-9beb-9202d6e2ccc5 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:23.794832 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465e610-54db-4b11-9beb-9202d6e2ccc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:23.825231 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-8465e610-54db-4b11-9beb-9202d6e2ccc5 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:23.826441 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-8465e610-54db-4b11-9beb-9202d6e2ccc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:23.849189 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b388201-2c8f-4c08-8fb3-26477ddcd064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:23.849811 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b388201-2c8f-4c08-8fb3-26477ddcd064 admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:23.850145 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b388201-2c8f-4c08-8fb3-26477ddcd064 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:23.850410 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b388201-2c8f-4c08-8fb3-26477ddcd064 admin admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:23.850988 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b388201-2c8f-4c08-8fb3-26477ddcd064 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:23.859701 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b388201-2c8f-4c08-8fb3-26477ddcd064 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:23.896290 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 768/1538] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 00:57:23 2022] POST /identity/v3/users => generated 305 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:57:23.897631 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41670fd-94db-467a-9bdd-09161ca2a59e None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:23.897990 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41670fd-94db-467a-9bdd-09161ca2a59e None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:23.898169 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41670fd-94db-467a-9bdd-09161ca2a59e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:23.930346 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-b41670fd-94db-467a-9bdd-09161ca2a59e None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:23.931595 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-b41670fd-94db-467a-9bdd-09161ca2a59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:23.959868 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 769/1539] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:57:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:23.963025 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0eaab0-c539-4d13-9a1f-7ceedbbcb737 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:23.963897 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0eaab0-c539-4d13-9a1f-7ceedbbcb737 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:23.964662 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0eaab0-c539-4d13-9a1f-7ceedbbcb737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:24.010120 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 771/1540] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:57:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:57:24.010120 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8465e610-54db-4b11-9beb-9202d6e2ccc5 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:24.025181 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-4c0eaab0-c539-4d13-9a1f-7ceedbbcb737 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:24.052557 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-4c0eaab0-c539-4d13-9a1f-7ceedbbcb737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:24.052713 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8465e610-54db-4b11-9beb-9202d6e2ccc5 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:24.053843 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5341c50-6015-4101-aa9c-b4e58f2a4cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:24.054238 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 770/1541] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:57:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:24.054664 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5341c50-6015-4101-aa9c-b4e58f2a4cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:24.059718 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5341c50-6015-4101-aa9c-b4e58f2a4cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:24.059718 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5341c50-6015-4101-aa9c-b4e58f2a4cf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:24.059718 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5341c50-6015-4101-aa9c-b4e58f2a4cf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:24.060249 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587bdbe-d032-4ab4-8721-ce4e6b069927 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:24.060249 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587bdbe-d032-4ab4-8721-ce4e6b069927 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:24.060249 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587bdbe-d032-4ab4-8721-ce4e6b069927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:24.060627 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5341c50-6015-4101-aa9c-b4e58f2a4cf1 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:24.070732 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 772/1542] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:57:24.076254 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a937eb7-90a9-46ed-9230-fcf89b17b496 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:24.076254 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a937eb7-90a9-46ed-9230-fcf89b17b496 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:24.076254 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a937eb7-90a9-46ed-9230-fcf89b17b496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:24.089926 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-e587bdbe-d032-4ab4-8721-ce4e6b069927 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:24.091141 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-e587bdbe-d032-4ab4-8721-ce4e6b069927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:24.095803 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-7a937eb7-90a9-46ed-9230-fcf89b17b496 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:24.097151 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-7a937eb7-90a9-46ed-9230-fcf89b17b496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:24.107762 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 771/1543] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:57:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:24.107762 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78873661-d7b1-43e0-81f8-815291275f50 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:24.107762 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78873661-d7b1-43e0-81f8-815291275f50 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:24.107762 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78873661-d7b1-43e0-81f8-815291275f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:24.116878 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 773/1544] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:57:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:24.119311 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da36d83-6988-47c9-a5ca-b0bbec58de24 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:24.119839 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da36d83-6988-47c9-a5ca-b0bbec58de24 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:24.120312 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da36d83-6988-47c9-a5ca-b0bbec58de24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:24.132590 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-78873661-d7b1-43e0-81f8-815291275f50 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:24.134065 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-78873661-d7b1-43e0-81f8-815291275f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:24.143492 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 772/1545] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:57:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:24.145037 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd77355-a483-481f-aabe-70a157108b5a None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:24.145321 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd77355-a483-481f-aabe-70a157108b5a None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:24.145591 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd77355-a483-481f-aabe-70a157108b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:24.152701 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-0da36d83-6988-47c9-a5ca-b0bbec58de24 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:24.154296 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-0da36d83-6988-47c9-a5ca-b0bbec58de24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:24.164823 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 774/1546] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:57:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:24.166052 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2e041-4545-44e6-aac9-f2b90366ee3e None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:24.166348 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2e041-4545-44e6-aac9-f2b90366ee3e None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:24.166623 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2e041-4545-44e6-aac9-f2b90366ee3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:24.170570 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-2cd77355-a483-481f-aabe-70a157108b5a None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:24.171848 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-2cd77355-a483-481f-aabe-70a157108b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:24.186233 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 773/1547] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:57:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:24.187211 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd77355-a483-481f-aabe-70a157108b5a None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:24.188076 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-6fc2e041-4545-44e6-aac9-f2b90366ee3e None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:24.189295 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-6fc2e041-4545-44e6-aac9-f2b90366ee3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:24.198245 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd77355-a483-481f-aabe-70a157108b5a None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:24.198670 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 775/1548] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:57:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:24.200008 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ebb51-fe3f-4f07-a09a-90bab628f92b None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:24.200304 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ebb51-fe3f-4f07-a09a-90bab628f92b None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:24.200625 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ebb51-fe3f-4f07-a09a-90bab628f92b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:24.205749 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a2c7a-ebf2-4054-898a-7716d0a3a1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:24.206431 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a2c7a-ebf2-4054-898a-7716d0a3a1df admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:24.206708 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a2c7a-ebf2-4054-898a-7716d0a3a1df admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:24.207146 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a2c7a-ebf2-4054-898a-7716d0a3a1df admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:24.207881 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5a2c7a-ebf2-4054-898a-7716d0a3a1df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:24.209537 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5a2c7a-ebf2-4054-898a-7716d0a3a1df admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:24.222040 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-2d9ebb51-fe3f-4f07-a09a-90bab628f92b None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:24.223278 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-2d9ebb51-fe3f-4f07-a09a-90bab628f92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:24.225442 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 774/1549] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:57:24.226335 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a2c7a-ebf2-4054-898a-7716d0a3a1df admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:24.236424 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 776/1550] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:57:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:24.237538 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae2730-216c-4188-b1e8-10443548dd5e None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:24.237829 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae2730-216c-4188-b1e8-10443548dd5e None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:24.238106 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae2730-216c-4188-b1e8-10443548dd5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:24.244052 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a2c7a-ebf2-4054-898a-7716d0a3a1df admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:24.251107 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c2d076-f7ad-422b-b365-6f33613c489c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:24.251793 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c2d076-f7ad-422b-b365-6f33613c489c admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:24.252074 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c2d076-f7ad-422b-b365-6f33613c489c admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:24.252380 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c2d076-f7ad-422b-b365-6f33613c489c admin admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:24.253101 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c2d076-f7ad-422b-b365-6f33613c489c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:57:24.253358 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c2d076-f7ad-422b-b365-6f33613c489c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:24.255031 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c2d076-f7ad-422b-b365-6f33613c489c admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:24.263942 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-fdae2730-216c-4188-b1e8-10443548dd5e None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:24.265482 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-fdae2730-216c-4188-b1e8-10443548dd5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:24.268568 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 775/1551] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 00:57:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:57:24.269334 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c2d076-f7ad-422b-b365-6f33613c489c admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:24.277777 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 777/1552] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:57:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:24.280486 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1fee26-725a-4f51-b09f-1b11696ec932 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:24.280798 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1fee26-725a-4f51-b09f-1b11696ec932 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:24.281072 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1fee26-725a-4f51-b09f-1b11696ec932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:24.283631 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c2d076-f7ad-422b-b365-6f33613c489c admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:24.289232 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dfddc1-d6e0-4dd8-b037-81a7019020df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:24.289865 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dfddc1-d6e0-4dd8-b037-81a7019020df admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:24.290175 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dfddc1-d6e0-4dd8-b037-81a7019020df admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:24.290445 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dfddc1-d6e0-4dd8-b037-81a7019020df admin admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:24.291105 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dfddc1-d6e0-4dd8-b037-81a7019020df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:57:24.291435 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dfddc1-d6e0-4dd8-b037-81a7019020df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:24.294506 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dfddc1-d6e0-4dd8-b037-81a7019020df admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:24.308012 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-0c1fee26-725a-4f51-b09f-1b11696ec932 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:24.308236 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 776/1553] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 00:57:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:57:24.309569 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9118c-3f06-4a0d-add1-d2e635af379e None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:24.309854 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9118c-3f06-4a0d-add1-d2e635af379e None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:24.310129 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-0c1fee26-725a-4f51-b09f-1b11696ec932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:24.310270 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af9118c-3f06-4a0d-add1-d2e635af379e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:24.323809 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 778/1554] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:57:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:24.325284 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1fee26-725a-4f51-b09f-1b11696ec932 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:24.335772 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-2af9118c-3f06-4a0d-add1-d2e635af379e None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:24.337657 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-2af9118c-3f06-4a0d-add1-d2e635af379e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:24.342592 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1fee26-725a-4f51-b09f-1b11696ec932 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:24.347698 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 777/1555] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:57:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:24.348896 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9118c-3f06-4a0d-add1-d2e635af379e None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:24.353939 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d8b2d-6327-47f1-b421-6a868d8b16f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:24.354729 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d8b2d-6327-47f1-b421-6a868d8b16f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:24.355101 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d8b2d-6327-47f1-b421-6a868d8b16f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:24.355453 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d8b2d-6327-47f1-b421-6a868d8b16f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:24.356281 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3d8b2d-6327-47f1-b421-6a868d8b16f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:57:24.356650 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3d8b2d-6327-47f1-b421-6a868d8b16f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:24.357926 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: WARNING py.warnings [None req-bd3d8b2d-6327-47f1-b421-6a868d8b16f8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 28 00:57:24.357926 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: warnings.warn(msg) Aug 28 00:57:24.357926 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: Aug 28 00:57:24.359279 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3d8b2d-6327-47f1-b421-6a868d8b16f8 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:24.361216 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af9118c-3f06-4a0d-add1-d2e635af379e None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:24.366375 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3714eeb0-9bf5-4842-bdf3-8473130e095e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:24.367237 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714eeb0-9bf5-4842-bdf3-8473130e095e admin admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:24.367517 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714eeb0-9bf5-4842-bdf3-8473130e095e admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:24.367831 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714eeb0-9bf5-4842-bdf3-8473130e095e admin admin] PATH_INFO: `/v3/projects/7f70316f42b2426799cce19ff21a767a/users/1c00a14fe4fb4b61bd36135ed0633584/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:24.375049 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 779/1556] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 00:57:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:57:24.376144 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d8b2d-6327-47f1-b421-6a868d8b16f8 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:24.389382 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3714eeb0-9bf5-4842-bdf3-8473130e095e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f70316f42b2426799cce19ff21a767a, user_id=1c00a14fe4fb4b61bd36135ed0633584, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:24.389725 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d8b2d-6327-47f1-b421-6a868d8b16f8 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:24.391196 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: WARNING py.warnings [None req-3714eeb0-9bf5-4842-bdf3-8473130e095e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 00:57:24.391196 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: warnings.warn(msg) Aug 28 00:57:24.391196 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: Aug 28 00:57:24.395261 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3714eeb0-9bf5-4842-bdf3-8473130e095e admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:24.397226 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18987e48-8bd6-4019-9471-a49dc86af354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:24.398199 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18987e48-8bd6-4019-9471-a49dc86af354 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:24.398620 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18987e48-8bd6-4019-9471-a49dc86af354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:24.399268 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18987e48-8bd6-4019-9471-a49dc86af354 admin admin] PATH_INFO: `/v3/domains` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:24.400046 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18987e48-8bd6-4019-9471-a49dc86af354 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:57:24.400532 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18987e48-8bd6-4019-9471-a49dc86af354 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:24.403000 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18987e48-8bd6-4019-9471-a49dc86af354 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:24.416655 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 778/1557] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 00:57:24 2022] PUT /identity/v3/projects/7f70316f42b2426799cce19ff21a767a/users/1c00a14fe4fb4b61bd36135ed0633584/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:57:24.418244 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3714eeb0-9bf5-4842-bdf3-8473130e095e admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:24.421672 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 780/1558] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 00:57:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:57:24.422761 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18987e48-8bd6-4019-9471-a49dc86af354 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:24.445280 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18987e48-8bd6-4019-9471-a49dc86af354 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:24.479821 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:24.505668 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:24.522792 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca09c2-0145-452f-9c6d-d1a20acb47e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:24.523724 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca09c2-0145-452f-9c6d-d1a20acb47e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:24.523924 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca09c2-0145-452f-9c6d-d1a20acb47e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:24.524197 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca09c2-0145-452f-9c6d-d1a20acb47e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:24.524878 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ca09c2-0145-452f-9c6d-d1a20acb47e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:24.526906 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ca09c2-0145-452f-9c6d-d1a20acb47e0 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:24.532351 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3714eeb0-9bf5-4842-bdf3-8473130e095e admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:24.539267 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b8232e-bded-4b7e-98c0-323f65d11a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:24.540195 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8232e-bded-4b7e-98c0-323f65d11a4a admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:24.540621 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8232e-bded-4b7e-98c0-323f65d11a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:24.541014 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b8232e-bded-4b7e-98c0-323f65d11a4a admin admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:24.541888 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b8232e-bded-4b7e-98c0-323f65d11a4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:57:24.542276 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b8232e-bded-4b7e-98c0-323f65d11a4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:24.544681 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b8232e-bded-4b7e-98c0-323f65d11a4a admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:24.573041 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 779/1559] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 00:57:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:57:24.573041 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b8232e-bded-4b7e-98c0-323f65d11a4a admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:24.573441 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 781/1560] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 00:57:24 2022] POST /identity/v3/projects => generated 377 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:57:24.573441 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83ff14-643c-4ad1-bea0-c3c16ab0debc None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:24.573441 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83ff14-643c-4ad1-bea0-c3c16ab0debc None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:24.573441 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83ff14-643c-4ad1-bea0-c3c16ab0debc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:24.582585 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b8232e-bded-4b7e-98c0-323f65d11a4a admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:24.595725 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-bb83ff14-643c-4ad1-bea0-c3c16ab0debc None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:24.597711 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-bb83ff14-643c-4ad1-bea0-c3c16ab0debc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:24.669726 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d2bb6c-1a33-4617-bbb1-9dfef0162952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:24.670495 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d2bb6c-1a33-4617-bbb1-9dfef0162952 admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:24.670903 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d2bb6c-1a33-4617-bbb1-9dfef0162952 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:24.671282 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d2bb6c-1a33-4617-bbb1-9dfef0162952 admin admin] PATH_INFO: `/v3/projects` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:24.672187 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d2bb6c-1a33-4617-bbb1-9dfef0162952 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:24.673936 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: WARNING py.warnings [None req-07d2bb6c-1a33-4617-bbb1-9dfef0162952 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 00:57:24.673936 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: warnings.warn(msg) Aug 28 00:57:24.673936 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: Aug 28 00:57:24.676337 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d2bb6c-1a33-4617-bbb1-9dfef0162952 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:24.694735 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 782/1561] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:57:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:24.695686 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83ff14-643c-4ad1-bea0-c3c16ab0debc None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:24.708746 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83ff14-643c-4ad1-bea0-c3c16ab0debc None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:24.714130 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29318e3-1c02-4788-8bf8-b3ea3e4f908a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:24.714767 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29318e3-1c02-4788-8bf8-b3ea3e4f908a admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:24.715042 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29318e3-1c02-4788-8bf8-b3ea3e4f908a admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:24.715311 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29318e3-1c02-4788-8bf8-b3ea3e4f908a admin admin] PATH_INFO: `/v3/domains` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:24.716043 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29318e3-1c02-4788-8bf8-b3ea3e4f908a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:57:24.716331 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29318e3-1c02-4788-8bf8-b3ea3e4f908a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:24.718000 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29318e3-1c02-4788-8bf8-b3ea3e4f908a admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:24.723487 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 780/1562] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 00:57:24 2022] POST /identity/v3/projects => generated 391 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:57:24.725321 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d2bb6c-1a33-4617-bbb1-9dfef0162952 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:24.753546 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 783/1563] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 00:57:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:57:24.753546 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeaa17d-578b-44d6-8b12-512bfd2104a8 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:24.753546 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeaa17d-578b-44d6-8b12-512bfd2104a8 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:24.753546 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeaa17d-578b-44d6-8b12-512bfd2104a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:24.778310 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-1aeaa17d-578b-44d6-8b12-512bfd2104a8 None None] MFA Rules not processed for user `1c00a14fe4fb4b61bd36135ed0633584`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:24.779556 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-1aeaa17d-578b-44d6-8b12-512bfd2104a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:24.822231 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d2bb6c-1a33-4617-bbb1-9dfef0162952 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:24.828535 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0524b3ed-39b7-4d94-a4df-2a07cf330c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:24.829419 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524b3ed-39b7-4d94-a4df-2a07cf330c8e admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:24.829961 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524b3ed-39b7-4d94-a4df-2a07cf330c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:24.830342 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524b3ed-39b7-4d94-a4df-2a07cf330c8e admin admin] PATH_INFO: `/v3/projects` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:24.831099 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0524b3ed-39b7-4d94-a4df-2a07cf330c8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:24.833412 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0524b3ed-39b7-4d94-a4df-2a07cf330c8e admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:24.871163 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 784/1564] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:57:24 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:24.872426 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeaa17d-578b-44d6-8b12-512bfd2104a8 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:24.882334 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 781/1565] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 00:57:24 2022] POST /identity/v3/projects => generated 379 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:57:24.882334 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0524b3ed-39b7-4d94-a4df-2a07cf330c8e admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:24.893782 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeaa17d-578b-44d6-8b12-512bfd2104a8 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:24.938831 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:24.958849 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:24.979388 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3789b9d7-4ff6-4372-9230-4699ebd976d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:24.980236 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0524b3ed-39b7-4d94-a4df-2a07cf330c8e admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:24.980395 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789b9d7-4ff6-4372-9230-4699ebd976d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:24.980628 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789b9d7-4ff6-4372-9230-4699ebd976d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:24.980966 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789b9d7-4ff6-4372-9230-4699ebd976d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:24.981847 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3789b9d7-4ff6-4372-9230-4699ebd976d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:24.984169 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3789b9d7-4ff6-4372-9230-4699ebd976d2 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:24.985324 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a127407-35fd-49a8-845e-de63e4338a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:24.985958 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a127407-35fd-49a8-845e-de63e4338a3f admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:24.986265 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a127407-35fd-49a8-845e-de63e4338a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:24.986699 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a127407-35fd-49a8-845e-de63e4338a3f admin admin] PATH_INFO: `/v3/projects` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:24.987386 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a127407-35fd-49a8-845e-de63e4338a3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:24.989452 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a127407-35fd-49a8-845e-de63e4338a3f admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:25.027012 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 782/1566] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 00:57:24 2022] POST /identity/v3/projects => generated 377 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:57:25.027226 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 785/1567] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 00:57:24 2022] POST /identity/v3/projects => generated 367 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:57:25.027333 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a127407-35fd-49a8-845e-de63e4338a3f admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:25.027402 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3789b9d7-4ff6-4372-9230-4699ebd976d2 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:25.109683 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a127407-35fd-49a8-845e-de63e4338a3f admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:25.112708 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3789b9d7-4ff6-4372-9230-4699ebd976d2 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:25.117338 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22196004-1cc0-41be-996a-cba8fe67343c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:25.117918 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b63406-5c50-49c9-85a3-ec315214f4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:25.118512 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22196004-1cc0-41be-996a-cba8fe67343c admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:25.118604 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b63406-5c50-49c9-85a3-ec315214f4e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:25.118827 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b63406-5c50-49c9-85a3-ec315214f4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:25.118910 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22196004-1cc0-41be-996a-cba8fe67343c admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:25.119109 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b63406-5c50-49c9-85a3-ec315214f4e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:25.119511 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22196004-1cc0-41be-996a-cba8fe67343c admin admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:25.119823 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b63406-5c50-49c9-85a3-ec315214f4e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:57:25.120129 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b63406-5c50-49c9-85a3-ec315214f4e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:25.120596 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22196004-1cc0-41be-996a-cba8fe67343c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:25.121826 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b63406-5c50-49c9-85a3-ec315214f4e3 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:25.124183 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22196004-1cc0-41be-996a-cba8fe67343c admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:25.135772 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 786/1568] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 00:57:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:57:25.136993 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b63406-5c50-49c9-85a3-ec315214f4e3 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:25.152177 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b63406-5c50-49c9-85a3-ec315214f4e3 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:25.156426 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 783/1569] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 00:57:25 2022] POST /identity/v3/users => generated 289 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:57:25.157616 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22196004-1cc0-41be-996a-cba8fe67343c admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:25.158035 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a5346-910b-4b89-b70e-f7f99a7e9a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:25.158793 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a5346-910b-4b89-b70e-f7f99a7e9a6c admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:25.158995 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a5346-910b-4b89-b70e-f7f99a7e9a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:25.159273 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a5346-910b-4b89-b70e-f7f99a7e9a6c admin admin] PATH_INFO: `/v3/users` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:25.160154 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3a5346-910b-4b89-b70e-f7f99a7e9a6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:25.161477 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: WARNING py.warnings [None req-9b3a5346-910b-4b89-b70e-f7f99a7e9a6c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 00:57:25.161477 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: warnings.warn(msg) Aug 28 00:57:25.161477 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: Aug 28 00:57:25.162602 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3a5346-910b-4b89-b70e-f7f99a7e9a6c admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:25.170983 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22196004-1cc0-41be-996a-cba8fe67343c admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:25.177758 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900342e7-08cb-4bde-b111-76a0b060ce28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:25.178567 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900342e7-08cb-4bde-b111-76a0b060ce28 admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:25.179006 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900342e7-08cb-4bde-b111-76a0b060ce28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:25.179475 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900342e7-08cb-4bde-b111-76a0b060ce28 admin admin] PATH_INFO: `/v3/projects` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:25.180355 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900342e7-08cb-4bde-b111-76a0b060ce28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:25.183395 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900342e7-08cb-4bde-b111-76a0b060ce28 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:25.192989 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 787/1570] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 00:57:25 2022] POST /identity/v3/users => generated 296 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:57:25.194416 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a5346-910b-4b89-b70e-f7f99a7e9a6c admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:25.210640 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a5346-910b-4b89-b70e-f7f99a7e9a6c admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:25.217506 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf8ec8-9771-4751-9c4f-a9dd6bd7e8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:25.218459 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf8ec8-9771-4751-9c4f-a9dd6bd7e8be admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:25.218878 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf8ec8-9771-4751-9c4f-a9dd6bd7e8be admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:25.219333 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf8ec8-9771-4751-9c4f-a9dd6bd7e8be admin admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:25.220188 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bf8ec8-9771-4751-9c4f-a9dd6bd7e8be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:25.222650 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bf8ec8-9771-4751-9c4f-a9dd6bd7e8be admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:25.227030 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 784/1571] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 00:57:25 2022] POST /identity/v3/projects => generated 357 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:57:25.227981 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900342e7-08cb-4bde-b111-76a0b060ce28 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:25.266185 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 788/1572] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 00:57:25 2022] POST /identity/v3/projects => generated 409 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:57:25.267592 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf8ec8-9771-4751-9c4f-a9dd6bd7e8be admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:25.320899 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900342e7-08cb-4bde-b111-76a0b060ce28 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:25.345779 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf8ec8-9771-4751-9c4f-a9dd6bd7e8be admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:25.353236 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed013a6-0a97-49ba-81af-a1f421caf10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:25.354196 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed013a6-0a97-49ba-81af-a1f421caf10d admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:25.354642 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed013a6-0a97-49ba-81af-a1f421caf10d admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:25.355078 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed013a6-0a97-49ba-81af-a1f421caf10d admin admin] PATH_INFO: `/v3/users` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:25.356068 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed013a6-0a97-49ba-81af-a1f421caf10d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:25.359561 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed013a6-0a97-49ba-81af-a1f421caf10d admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:25.367377 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:25.388314 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 789/1573] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 00:57:25 2022] POST /identity/v3/users => generated 284 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:57:25.389548 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed013a6-0a97-49ba-81af-a1f421caf10d admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:25.401663 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed013a6-0a97-49ba-81af-a1f421caf10d admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:25.406632 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a950f812-97e2-41cd-996f-cb245f66563b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:25.407265 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a950f812-97e2-41cd-996f-cb245f66563b admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:25.407541 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a950f812-97e2-41cd-996f-cb245f66563b admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:25.407837 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a950f812-97e2-41cd-996f-cb245f66563b admin admin] PATH_INFO: `/v3/users` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:25.408487 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a950f812-97e2-41cd-996f-cb245f66563b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:25.410533 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a950f812-97e2-41cd-996f-cb245f66563b admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:25.412861 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b0600-cff4-49aa-b2cd-724f01500e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:25.413509 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b0600-cff4-49aa-b2cd-724f01500e4a admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:25.413784 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b0600-cff4-49aa-b2cd-724f01500e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:25.414050 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b0600-cff4-49aa-b2cd-724f01500e4a admin admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:25.414702 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414b0600-cff4-49aa-b2cd-724f01500e4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:25.416720 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414b0600-cff4-49aa-b2cd-724f01500e4a admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:25.434829 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:25.441294 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 785/1574] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 00:57:25 2022] POST /identity/v3/users => generated 290 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:57:25.445314 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b0600-cff4-49aa-b2cd-724f01500e4a admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:25.445913 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 790/1575] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 00:57:25 2022] POST /identity/v3/users => generated 289 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:57:25.445913 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a950f812-97e2-41cd-996f-cb245f66563b admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:25.459041 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b0600-cff4-49aa-b2cd-724f01500e4a admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:25.464157 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a950f812-97e2-41cd-996f-cb245f66563b admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:25.468027 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2738493f-03bc-46d5-8b4b-1bca3ba2117b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:25.469091 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738493f-03bc-46d5-8b4b-1bca3ba2117b admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:25.469592 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738493f-03bc-46d5-8b4b-1bca3ba2117b admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:25.470078 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738493f-03bc-46d5-8b4b-1bca3ba2117b admin admin] PATH_INFO: `/v3/projects` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:25.471284 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2738493f-03bc-46d5-8b4b-1bca3ba2117b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:25.471935 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97bd70d-cc9c-4b51-aeb8-0343c2bf253d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:25.472993 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97bd70d-cc9c-4b51-aeb8-0343c2bf253d admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:25.473477 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97bd70d-cc9c-4b51-aeb8-0343c2bf253d admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:25.473961 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97bd70d-cc9c-4b51-aeb8-0343c2bf253d admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:25.474514 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2738493f-03bc-46d5-8b4b-1bca3ba2117b admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:25.475121 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97bd70d-cc9c-4b51-aeb8-0343c2bf253d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:25.478237 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97bd70d-cc9c-4b51-aeb8-0343c2bf253d admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:25.501774 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 791/1576] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:57:25 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:57:25.501774 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97bd70d-cc9c-4b51-aeb8-0343c2bf253d admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:25.506620 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 786/1577] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 00:57:25 2022] POST /identity/v3/projects => generated 369 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:57:25.508380 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2738493f-03bc-46d5-8b4b-1bca3ba2117b admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:25.516145 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97bd70d-cc9c-4b51-aeb8-0343c2bf253d admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:25.587072 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb146a0-361c-4ac6-b457-74c567440de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:25.588137 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb146a0-361c-4ac6-b457-74c567440de0 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:25.588137 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb146a0-361c-4ac6-b457-74c567440de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:25.588347 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb146a0-361c-4ac6-b457-74c567440de0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:25.588913 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb146a0-361c-4ac6-b457-74c567440de0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:25.590571 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb146a0-361c-4ac6-b457-74c567440de0 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:25.601634 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2738493f-03bc-46d5-8b4b-1bca3ba2117b admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:25.607476 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 792/1578] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:57:25 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:57:25.607476 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb146a0-361c-4ac6-b457-74c567440de0 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:25.613585 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abae559f-e600-400e-a62c-06741d779a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:25.614542 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb146a0-361c-4ac6-b457-74c567440de0 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:25.614713 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae559f-e600-400e-a62c-06741d779a19 admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:25.615074 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae559f-e600-400e-a62c-06741d779a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:25.615551 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae559f-e600-400e-a62c-06741d779a19 admin admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:25.616615 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abae559f-e600-400e-a62c-06741d779a19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:25.619384 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abae559f-e600-400e-a62c-06741d779a19 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:25.620278 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66613c2a-e563-4709-8756-3e9bd66e702b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:25.620968 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66613c2a-e563-4709-8756-3e9bd66e702b admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:25.621243 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66613c2a-e563-4709-8756-3e9bd66e702b admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:25.621507 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66613c2a-e563-4709-8756-3e9bd66e702b admin admin] PATH_INFO: `/v3/users` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:25.622152 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66613c2a-e563-4709-8756-3e9bd66e702b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:25.624249 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66613c2a-e563-4709-8756-3e9bd66e702b admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:25.652703 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 787/1579] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 00:57:25 2022] POST /identity/v3/users => generated 279 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:57:25.653575 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abae559f-e600-400e-a62c-06741d779a19 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:25.663298 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 793/1580] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 00:57:25 2022] POST /identity/v3/users => generated 311 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:57:25.664826 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66613c2a-e563-4709-8756-3e9bd66e702b admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:25.674350 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abae559f-e600-400e-a62c-06741d779a19 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:25.676607 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66613c2a-e563-4709-8756-3e9bd66e702b admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:25.679695 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4339404-a2d9-40ad-b63a-2e23c8759eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:25.680392 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4339404-a2d9-40ad-b63a-2e23c8759eba admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:25.680670 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4339404-a2d9-40ad-b63a-2e23c8759eba admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:25.680941 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4339404-a2d9-40ad-b63a-2e23c8759eba admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:25.681608 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4339404-a2d9-40ad-b63a-2e23c8759eba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:25.682185 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1a07d3-c36a-4faa-954e-5579e97b1880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:25.682976 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a07d3-c36a-4faa-954e-5579e97b1880 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:25.683260 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4339404-a2d9-40ad-b63a-2e23c8759eba admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:25.683370 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a07d3-c36a-4faa-954e-5579e97b1880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:25.683741 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1a07d3-c36a-4faa-954e-5579e97b1880 admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:25.684717 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1a07d3-c36a-4faa-954e-5579e97b1880 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:25.686220 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1a07d3-c36a-4faa-954e-5579e97b1880 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:25.695197 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 788/1581] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:57:25 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:57:25.695197 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4339404-a2d9-40ad-b63a-2e23c8759eba admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:25.698522 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 794/1582] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:57:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:57:25.699094 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1a07d3-c36a-4faa-954e-5579e97b1880 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:25.708402 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4339404-a2d9-40ad-b63a-2e23c8759eba admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:25.713183 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12428bfe-7dce-4e8f-b6c9-cec8e78df0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:25.713812 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12428bfe-7dce-4e8f-b6c9-cec8e78df0b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:25.713983 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1a07d3-c36a-4faa-954e-5579e97b1880 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:25.714162 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12428bfe-7dce-4e8f-b6c9-cec8e78df0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:25.714339 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12428bfe-7dce-4e8f-b6c9-cec8e78df0b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:25.715000 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12428bfe-7dce-4e8f-b6c9-cec8e78df0b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:25.716691 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12428bfe-7dce-4e8f-b6c9-cec8e78df0b8 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:25.721021 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70ab6c-0dd5-4b7f-8213-483207e39bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:25.722270 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70ab6c-0dd5-4b7f-8213-483207e39bcc admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:25.722743 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70ab6c-0dd5-4b7f-8213-483207e39bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:25.723220 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70ab6c-0dd5-4b7f-8213-483207e39bcc admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:25.724480 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf70ab6c-0dd5-4b7f-8213-483207e39bcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:25.727633 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf70ab6c-0dd5-4b7f-8213-483207e39bcc admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:25.735071 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 789/1583] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:57:25 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:57:25.736034 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12428bfe-7dce-4e8f-b6c9-cec8e78df0b8 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:25.746665 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 795/1584] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:57:25 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:57:25.748073 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70ab6c-0dd5-4b7f-8213-483207e39bcc admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:25.748215 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12428bfe-7dce-4e8f-b6c9-cec8e78df0b8 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:25.753971 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522a58d0-2c74-45cd-b1a9-da315385795d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:25.754615 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a58d0-2c74-45cd-b1a9-da315385795d admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:25.754897 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a58d0-2c74-45cd-b1a9-da315385795d admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:25.755618 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a58d0-2c74-45cd-b1a9-da315385795d admin admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:25.755866 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522a58d0-2c74-45cd-b1a9-da315385795d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:25.757895 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522a58d0-2c74-45cd-b1a9-da315385795d admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:25.763979 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70ab6c-0dd5-4b7f-8213-483207e39bcc admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:25.769993 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e202c-cf06-4360-b3f0-5538ba961ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:25.770888 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e202c-cf06-4360-b3f0-5538ba961ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:25.771176 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e202c-cf06-4360-b3f0-5538ba961ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:25.771491 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e202c-cf06-4360-b3f0-5538ba961ef1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:25.772323 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389e202c-cf06-4360-b3f0-5538ba961ef1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:25.774566 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389e202c-cf06-4360-b3f0-5538ba961ef1 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:25.786769 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 790/1585] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 00:57:25 2022] POST /identity/v3/users => generated 285 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:57:25.788279 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 796/1586] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:57:25 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:57:25.788462 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522a58d0-2c74-45cd-b1a9-da315385795d admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:25.789003 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e202c-cf06-4360-b3f0-5538ba961ef1 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:25.800803 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e202c-cf06-4360-b3f0-5538ba961ef1 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:25.801917 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522a58d0-2c74-45cd-b1a9-da315385795d admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:25.805871 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e00a40-97cc-46be-8f29-ddddac150b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:25.806522 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e00a40-97cc-46be-8f29-ddddac150b20 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:25.806888 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e00a40-97cc-46be-8f29-ddddac150b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:25.807356 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e00a40-97cc-46be-8f29-ddddac150b20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:25.808260 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e00a40-97cc-46be-8f29-ddddac150b20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:25.808463 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01a0d0-f591-479d-9a5a-f18bc99e51f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:25.809202 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01a0d0-f591-479d-9a5a-f18bc99e51f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:25.809561 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01a0d0-f591-479d-9a5a-f18bc99e51f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:25.810013 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01a0d0-f591-479d-9a5a-f18bc99e51f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:25.810453 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e00a40-97cc-46be-8f29-ddddac150b20 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:25.810903 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff01a0d0-f591-479d-9a5a-f18bc99e51f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:25.812881 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff01a0d0-f591-479d-9a5a-f18bc99e51f5 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:25.827722 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 797/1587] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:57:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:57:25.827722 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e00a40-97cc-46be-8f29-ddddac150b20 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:25.827993 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 791/1588] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:57:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:57:25.827993 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01a0d0-f591-479d-9a5a-f18bc99e51f5 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:25.838529 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e00a40-97cc-46be-8f29-ddddac150b20 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:25.839405 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01a0d0-f591-479d-9a5a-f18bc99e51f5 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:25.843461 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5439c93-2c42-499c-8c2e-d79e9acf9a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:25.844371 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5439c93-2c42-499c-8c2e-d79e9acf9a6c admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:25.844541 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e18ef0-a47a-4871-a00c-ec2599605682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:25.844699 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5439c93-2c42-499c-8c2e-d79e9acf9a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:25.844914 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5439c93-2c42-499c-8c2e-d79e9acf9a6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:25.845204 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e18ef0-a47a-4871-a00c-ec2599605682 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:25.845487 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e18ef0-a47a-4871-a00c-ec2599605682 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:25.845632 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5439c93-2c42-499c-8c2e-d79e9acf9a6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:25.845792 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e18ef0-a47a-4871-a00c-ec2599605682 admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:25.846402 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e18ef0-a47a-4871-a00c-ec2599605682 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:25.847279 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5439c93-2c42-499c-8c2e-d79e9acf9a6c admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:25.848181 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e18ef0-a47a-4871-a00c-ec2599605682 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:25.860082 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 798/1589] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:57:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:57:25.860082 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5439c93-2c42-499c-8c2e-d79e9acf9a6c admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:25.860815 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 792/1590] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:57:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:57:25.861758 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e18ef0-a47a-4871-a00c-ec2599605682 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:25.875577 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5439c93-2c42-499c-8c2e-d79e9acf9a6c admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:25.879268 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e18ef0-a47a-4871-a00c-ec2599605682 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:25.880856 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb87cf-1d91-4815-818c-1ab067a1c353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:25.881486 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb87cf-1d91-4815-818c-1ab067a1c353 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:25.881764 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb87cf-1d91-4815-818c-1ab067a1c353 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:25.882077 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb87cf-1d91-4815-818c-1ab067a1c353 admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:25.882766 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebb87cf-1d91-4815-818c-1ab067a1c353 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:25.884443 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebb87cf-1d91-4815-818c-1ab067a1c353 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:25.885565 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5a82af-ba95-41a0-bc9e-aa07edea1750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:25.886252 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a82af-ba95-41a0-bc9e-aa07edea1750 admin admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:25.886530 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a82af-ba95-41a0-bc9e-aa07edea1750 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:25.886804 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5a82af-ba95-41a0-bc9e-aa07edea1750 admin admin] PATH_INFO: `/v3/projects/3391697c527c498c9897a9770aacbdbd/users/252f0ce67ecd4772a24b32c846ff8e17/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:25.896160 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 799/1591] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:57:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:57:25.897080 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb87cf-1d91-4815-818c-1ab067a1c353 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:25.907508 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5a82af-ba95-41a0-bc9e-aa07edea1750 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3391697c527c498c9897a9770aacbdbd, user_id=252f0ce67ecd4772a24b32c846ff8e17, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:25.908061 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb87cf-1d91-4815-818c-1ab067a1c353 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:25.910349 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5a82af-ba95-41a0-bc9e-aa07edea1750 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:25.913496 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518e0b8-41b0-4b1b-8fee-098a1ae14b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:25.914175 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518e0b8-41b0-4b1b-8fee-098a1ae14b35 admin admin] REQUEST_METHOD: `PUT` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:25.914451 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518e0b8-41b0-4b1b-8fee-098a1ae14b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:25.914716 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7518e0b8-41b0-4b1b-8fee-098a1ae14b35 admin admin] PATH_INFO: `/v3/projects/bb63a3136589450c9d45ff6b48e9276a/users/ed8fdd85be1e499e90843147bd931ae7/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:25.928469 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 793/1592] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 00:57:25 2022] PUT /identity/v3/projects/3391697c527c498c9897a9770aacbdbd/users/252f0ce67ecd4772a24b32c846ff8e17/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:57:25.929783 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5a82af-ba95-41a0-bc9e-aa07edea1750 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:25.933790 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7518e0b8-41b0-4b1b-8fee-098a1ae14b35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb63a3136589450c9d45ff6b48e9276a, user_id=ed8fdd85be1e499e90843147bd931ae7, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:25.936161 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:25.937566 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7518e0b8-41b0-4b1b-8fee-098a1ae14b35 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:25.959632 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 800/1593] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 00:57:25 2022] PUT /identity/v3/projects/bb63a3136589450c9d45ff6b48e9276a/users/ed8fdd85be1e499e90843147bd931ae7/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:57:25.971075 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518e0b8-41b0-4b1b-8fee-098a1ae14b35 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:26.007679 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:26.016518 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5a82af-ba95-41a0-bc9e-aa07edea1750 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:26.033724 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7518e0b8-41b0-4b1b-8fee-098a1ae14b35 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:26.039591 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2040c8b-6e7c-4667-89d4-fdd26ab42182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:26.040392 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2040c8b-6e7c-4667-89d4-fdd26ab42182 admin admin] REQUEST_METHOD: `PUT` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:26.040672 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2040c8b-6e7c-4667-89d4-fdd26ab42182 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:26.040947 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2040c8b-6e7c-4667-89d4-fdd26ab42182 admin admin] PATH_INFO: `/v3/projects/28ec14506dcd41f98044db206555410e/users/d9161fbdd32540de8b4eb85b1b2cd970/roles/2e4889bb71f9434392c0baba59f2534e` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:26.063036 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2040c8b-6e7c-4667-89d4-fdd26ab42182 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28ec14506dcd41f98044db206555410e, user_id=d9161fbdd32540de8b4eb85b1b2cd970, role_id=2e4889bb71f9434392c0baba59f2534e)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:26.065984 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2040c8b-6e7c-4667-89d4-fdd26ab42182 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:26.084805 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d586dc9a-5cd1-4d6d-9e5d-fc2bc41785dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:26.085433 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d586dc9a-5cd1-4d6d-9e5d-fc2bc41785dc admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:26.085714 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d586dc9a-5cd1-4d6d-9e5d-fc2bc41785dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:26.085987 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d586dc9a-5cd1-4d6d-9e5d-fc2bc41785dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:26.086687 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d586dc9a-5cd1-4d6d-9e5d-fc2bc41785dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:26.088452 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d586dc9a-5cd1-4d6d-9e5d-fc2bc41785dc admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:26.088565 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 801/1594] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 00:57:25 2022] PUT /identity/v3/projects/28ec14506dcd41f98044db206555410e/users/d9161fbdd32540de8b4eb85b1b2cd970/roles/2e4889bb71f9434392c0baba59f2534e => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:57:26.089296 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2040c8b-6e7c-4667-89d4-fdd26ab42182 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:26.104863 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 794/1595] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:57:25 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:57:26.106570 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d586dc9a-5cd1-4d6d-9e5d-fc2bc41785dc admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:26.125777 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d586dc9a-5cd1-4d6d-9e5d-fc2bc41785dc admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:26.165332 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2040c8b-6e7c-4667-89d4-fdd26ab42182 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:26.172248 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96819503-3738-4475-aea4-ed7b00c5a568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:26.174955 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96819503-3738-4475-aea4-ed7b00c5a568 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:26.175428 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96819503-3738-4475-aea4-ed7b00c5a568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:26.176037 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96819503-3738-4475-aea4-ed7b00c5a568 admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:26.177171 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96819503-3738-4475-aea4-ed7b00c5a568 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:26.180173 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96819503-3738-4475-aea4-ed7b00c5a568 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:26.199763 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 802/1596] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:57:26 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:57:26.199763 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96819503-3738-4475-aea4-ed7b00c5a568 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:26.208051 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2accaba0-6cc0-44a6-892e-87c7f3990e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:26.208734 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2accaba0-6cc0-44a6-892e-87c7f3990e74 admin admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:26.209014 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2accaba0-6cc0-44a6-892e-87c7f3990e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:26.209288 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2accaba0-6cc0-44a6-892e-87c7f3990e74 admin admin] PATH_INFO: `/v3/projects/c60e4af3c43647e29654026b64e88e36/users/cfec34d4145f4e188acdb2c1df19243a/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:26.215925 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96819503-3738-4475-aea4-ed7b00c5a568 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:26.223648 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b763face-0753-4839-93cc-5bdcf18cf17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:26.224088 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763face-0753-4839-93cc-5bdcf18cf17d admin admin] REQUEST_METHOD: `PUT` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:26.224374 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763face-0753-4839-93cc-5bdcf18cf17d admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:26.224653 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763face-0753-4839-93cc-5bdcf18cf17d admin admin] PATH_INFO: `/v3/projects/86bf22a051c44bf4aa5fda90be48ab8d/users/d7ab9a4634c9414596154b0f3229f55f/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:26.227554 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2accaba0-6cc0-44a6-892e-87c7f3990e74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c60e4af3c43647e29654026b64e88e36, user_id=cfec34d4145f4e188acdb2c1df19243a, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:26.230870 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2accaba0-6cc0-44a6-892e-87c7f3990e74 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:26.242660 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b763face-0753-4839-93cc-5bdcf18cf17d admin admin] RBAC: Authorizing `identity:create_grant(project_id=86bf22a051c44bf4aa5fda90be48ab8d, user_id=d7ab9a4634c9414596154b0f3229f55f, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:26.246346 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b763face-0753-4839-93cc-5bdcf18cf17d admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:26.254242 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 795/1597] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 00:57:26 2022] PUT /identity/v3/projects/c60e4af3c43647e29654026b64e88e36/users/cfec34d4145f4e188acdb2c1df19243a/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:57:26.255140 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2accaba0-6cc0-44a6-892e-87c7f3990e74 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:26.265345 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 803/1598] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 00:57:26 2022] PUT /identity/v3/projects/86bf22a051c44bf4aa5fda90be48ab8d/users/d7ab9a4634c9414596154b0f3229f55f/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:57:26.266748 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd83031-980a-4b7a-b0bc-f72ce7aa756f None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:26.267039 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd83031-980a-4b7a-b0bc-f72ce7aa756f None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:26.267314 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd83031-980a-4b7a-b0bc-f72ce7aa756f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:26.289016 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-3cd83031-980a-4b7a-b0bc-f72ce7aa756f None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:26.290347 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-3cd83031-980a-4b7a-b0bc-f72ce7aa756f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:26.303738 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:26.340297 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2accaba0-6cc0-44a6-892e-87c7f3990e74 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:26.357315 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 804/1599] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:57:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:26.358834 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997d4b8-fd80-4501-9ce9-d92ddf1706fc None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:26.359218 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997d4b8-fd80-4501-9ce9-d92ddf1706fc None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:26.359584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7997d4b8-fd80-4501-9ce9-d92ddf1706fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:26.391923 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-7997d4b8-fd80-4501-9ce9-d92ddf1706fc None None] MFA Rules not processed for user `ed8fdd85be1e499e90843147bd931ae7`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:26.393199 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-7997d4b8-fd80-4501-9ce9-d92ddf1706fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:26.424962 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a919456-5691-4d14-b3dd-61bb5182c3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:26.425388 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:26.425693 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a919456-5691-4d14-b3dd-61bb5182c3a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:26.425957 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a919456-5691-4d14-b3dd-61bb5182c3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:26.426229 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a919456-5691-4d14-b3dd-61bb5182c3a4 admin admin] PATH_INFO: `/v3/projects/aa3eff9641334c6681e73cb6a5f715fa/users/e85ff72921aa4af8a0dbc102e9cacf8f/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:26.445352 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a919456-5691-4d14-b3dd-61bb5182c3a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa3eff9641334c6681e73cb6a5f715fa, user_id=e85ff72921aa4af8a0dbc102e9cacf8f, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:26.449034 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a919456-5691-4d14-b3dd-61bb5182c3a4 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:26.469952 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 796/1600] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 00:57:26 2022] PUT /identity/v3/projects/aa3eff9641334c6681e73cb6a5f715fa/users/e85ff72921aa4af8a0dbc102e9cacf8f/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:57:26.471610 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a919456-5691-4d14-b3dd-61bb5182c3a4 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:26.494422 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 805/1601] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:57:26 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:26.495503 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7997d4b8-fd80-4501-9ce9-d92ddf1706fc None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:26.508785 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7997d4b8-fd80-4501-9ce9-d92ddf1706fc None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:26.561855 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a919456-5691-4d14-b3dd-61bb5182c3a4 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:26.568481 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af43800-090f-40d0-b4ba-3cab87616f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:26.569217 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af43800-090f-40d0-b4ba-3cab87616f70 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:26.569499 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af43800-090f-40d0-b4ba-3cab87616f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:26.569772 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af43800-090f-40d0-b4ba-3cab87616f70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:26.570431 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af43800-090f-40d0-b4ba-3cab87616f70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:26.572169 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af43800-090f-40d0-b4ba-3cab87616f70 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:26.576191 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2576df0-6066-447b-a8ae-dff3f88a446e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:26.576852 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2576df0-6066-447b-a8ae-dff3f88a446e admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:26.577441 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2576df0-6066-447b-a8ae-dff3f88a446e admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:26.577711 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2576df0-6066-447b-a8ae-dff3f88a446e admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:26.578462 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2576df0-6066-447b-a8ae-dff3f88a446e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:26.580299 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2576df0-6066-447b-a8ae-dff3f88a446e admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:26.588189 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 797/1602] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:57:26 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:57:26.589853 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af43800-090f-40d0-b4ba-3cab87616f70 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:26.594562 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 806/1603] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:57:26 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:57:26.595956 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb5164-56b8-45ba-a94c-1d2f94ab569e None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:26.596243 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb5164-56b8-45ba-a94c-1d2f94ab569e None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:26.596521 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeb5164-56b8-45ba-a94c-1d2f94ab569e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:26.609093 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af43800-090f-40d0-b4ba-3cab87616f70 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:26.616818 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db5e413-3ac4-4963-b75d-15a366381f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:26.617965 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5e413-3ac4-4963-b75d-15a366381f9b admin admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:26.618494 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5e413-3ac4-4963-b75d-15a366381f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:26.618932 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-ebeb5164-56b8-45ba-a94c-1d2f94ab569e None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:26.619090 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5e413-3ac4-4963-b75d-15a366381f9b admin admin] PATH_INFO: `/v3/projects/1a57b8e6dccd4e398c68c21b9f176dbf/users/26bccbe0c0c245239efafc6604c35403/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:26.620340 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-ebeb5164-56b8-45ba-a94c-1d2f94ab569e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:26.629411 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 807/1604] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:57:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:26.630949 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3661c2-7a18-41f0-886d-d4d9f8123f45 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:26.631245 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3661c2-7a18-41f0-886d-d4d9f8123f45 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:26.631648 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3661c2-7a18-41f0-886d-d4d9f8123f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:26.651145 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db5e413-3ac4-4963-b75d-15a366381f9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a57b8e6dccd4e398c68c21b9f176dbf, user_id=26bccbe0c0c245239efafc6604c35403, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:26.653872 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db5e413-3ac4-4963-b75d-15a366381f9b admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:26.668686 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-4e3661c2-7a18-41f0-886d-d4d9f8123f45 None None] MFA Rules not processed for user `d7ab9a4634c9414596154b0f3229f55f`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:26.669928 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-4e3661c2-7a18-41f0-886d-d4d9f8123f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:26.671508 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 798/1605] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 00:57:26 2022] PUT /identity/v3/projects/1a57b8e6dccd4e398c68c21b9f176dbf/users/26bccbe0c0c245239efafc6604c35403/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:57:26.672885 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db5e413-3ac4-4963-b75d-15a366381f9b admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:26.748512 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:26.760646 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 808/1606] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:57:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:26.763000 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01bdae1-b8d4-4970-afb0-8b4b18bf598d None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:26.763526 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01bdae1-b8d4-4970-afb0-8b4b18bf598d None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:26.764077 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01bdae1-b8d4-4970-afb0-8b4b18bf598d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:26.789577 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db5e413-3ac4-4963-b75d-15a366381f9b admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:26.789861 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-f01bdae1-b8d4-4970-afb0-8b4b18bf598d None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:26.790859 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-f01bdae1-b8d4-4970-afb0-8b4b18bf598d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:26.794267 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3b830c-bb23-4149-823e-cf5041630e36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:26.794902 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b830c-bb23-4149-823e-cf5041630e36 service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:26.795177 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b830c-bb23-4149-823e-cf5041630e36 service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:26.795446 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b830c-bb23-4149-823e-cf5041630e36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:26.841220 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:26.863772 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 809/1607] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:57:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:26.864861 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01bdae1-b8d4-4970-afb0-8b4b18bf598d None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:26.877068 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01bdae1-b8d4-4970-afb0-8b4b18bf598d None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:26.879333 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3b830c-bb23-4149-823e-cf5041630e36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:26.880933 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3b830c-bb23-4149-823e-cf5041630e36 service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:26.882446 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45738647-4aca-45b9-b95d-6bdd34f37f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:26.883100 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45738647-4aca-45b9-b95d-6bdd34f37f10 admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:26.883384 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45738647-4aca-45b9-b95d-6bdd34f37f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:26.883644 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45738647-4aca-45b9-b95d-6bdd34f37f10 admin admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:26.884366 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45738647-4aca-45b9-b95d-6bdd34f37f10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:26.886535 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45738647-4aca-45b9-b95d-6bdd34f37f10 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:26.891156 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 799/1608] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:57:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:57:26.892092 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3b830c-bb23-4149-823e-cf5041630e36 service neutron] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:26.901994 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3b830c-bb23-4149-823e-cf5041630e36 service neutron] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:26.907397 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d485b091-4e30-42a1-a8aa-aba28a1eed06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:26.908573 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485b091-4e30-42a1-a8aa-aba28a1eed06 admin admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:26.908865 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485b091-4e30-42a1-a8aa-aba28a1eed06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:26.909263 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485b091-4e30-42a1-a8aa-aba28a1eed06 admin admin] PATH_INFO: `/v3/projects/28ec14506dcd41f98044db206555410e/users/d9161fbdd32540de8b4eb85b1b2cd970/roles/2e4889bb71f9434392c0baba59f2534e` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:26.911695 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d485b091-4e30-42a1-a8aa-aba28a1eed06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28ec14506dcd41f98044db206555410e, user_id=d9161fbdd32540de8b4eb85b1b2cd970, role_id=2e4889bb71f9434392c0baba59f2534e)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:26.914427 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d485b091-4e30-42a1-a8aa-aba28a1eed06 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:26.928741 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 800/1609] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 00:57:26 2022] PUT /identity/v3/projects/28ec14506dcd41f98044db206555410e/users/d9161fbdd32540de8b4eb85b1b2cd970/roles/2e4889bb71f9434392c0baba59f2534e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:57:26.928822 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 810/1610] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 00:57:26 2022] POST /identity/v3/projects => generated 387 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:57:26.929641 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45738647-4aca-45b9-b95d-6bdd34f37f10 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:26.934148 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d485b091-4e30-42a1-a8aa-aba28a1eed06 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:27.028129 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45738647-4aca-45b9-b95d-6bdd34f37f10 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:27.031036 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d485b091-4e30-42a1-a8aa-aba28a1eed06 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:27.032688 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a40db0-3c6c-44fd-be53-e9d4633cc4ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:27.033320 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a40db0-3c6c-44fd-be53-e9d4633cc4ed service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:27.033584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a40db0-3c6c-44fd-be53-e9d4633cc4ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:27.033858 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a40db0-3c6c-44fd-be53-e9d4633cc4ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:27.122999 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a40db0-3c6c-44fd-be53-e9d4633cc4ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:27.124533 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a40db0-3c6c-44fd-be53-e9d4633cc4ed service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:27.136066 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 811/1611] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:57:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:57:27.137248 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3921d73f-eb82-4a78-ba9d-35af80c25993 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:27.137536 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3921d73f-eb82-4a78-ba9d-35af80c25993 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:27.137813 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3921d73f-eb82-4a78-ba9d-35af80c25993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:27.149258 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55616309-aa58-44c5-89c8-dd2b32d54a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:27.150442 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55616309-aa58-44c5-89c8-dd2b32d54a14 admin admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:27.150877 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55616309-aa58-44c5-89c8-dd2b32d54a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:27.151449 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55616309-aa58-44c5-89c8-dd2b32d54a14 admin admin] PATH_INFO: `/v3/projects/a50dca52a2e1455486a598bcdf68d615/users/2cd12b1d5bd74981b7098c32bb656f20/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:27.170425 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-3921d73f-eb82-4a78-ba9d-35af80c25993 None None] MFA Rules not processed for user `26bccbe0c0c245239efafc6604c35403`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:27.171909 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-3921d73f-eb82-4a78-ba9d-35af80c25993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:27.188584 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55616309-aa58-44c5-89c8-dd2b32d54a14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a50dca52a2e1455486a598bcdf68d615, user_id=2cd12b1d5bd74981b7098c32bb656f20, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:27.193431 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55616309-aa58-44c5-89c8-dd2b32d54a14 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:27.206386 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:27.212205 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 801/1612] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 00:57:26 2022] PUT /identity/v3/projects/a50dca52a2e1455486a598bcdf68d615/users/2cd12b1d5bd74981b7098c32bb656f20/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:57:27.213192 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55616309-aa58-44c5-89c8-dd2b32d54a14 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:27.294313 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:27.301675 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 812/1613] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:57:27 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:27.302323 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3921d73f-eb82-4a78-ba9d-35af80c25993 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:27.318089 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3921d73f-eb82-4a78-ba9d-35af80c25993 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:27.337903 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55616309-aa58-44c5-89c8-dd2b32d54a14 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:27.345269 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa684fc8-ef43-45dc-8ed9-72e565fd9a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:27.345905 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa684fc8-ef43-45dc-8ed9-72e565fd9a7c admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:27.346185 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa684fc8-ef43-45dc-8ed9-72e565fd9a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:27.347149 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa684fc8-ef43-45dc-8ed9-72e565fd9a7c admin admin] PATH_INFO: `/v3/projects` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:27.347872 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa684fc8-ef43-45dc-8ed9-72e565fd9a7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:27.349885 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa684fc8-ef43-45dc-8ed9-72e565fd9a7c admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:27.393682 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb4529f-0216-41bb-be90-77d368887d02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:27.394725 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb4529f-0216-41bb-be90-77d368887d02 service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:27.395010 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb4529f-0216-41bb-be90-77d368887d02 service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:27.395318 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb4529f-0216-41bb-be90-77d368887d02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:27.397429 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 802/1614] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 00:57:27 2022] POST /identity/v3/projects => generated 375 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:57:27.398536 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa684fc8-ef43-45dc-8ed9-72e565fd9a7c admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:27.411762 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb4529f-0216-41bb-be90-77d368887d02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:27.414642 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb4529f-0216-41bb-be90-77d368887d02 service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:27.432320 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 813/1615] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:57:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:57:27.433966 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5c098-4bab-4457-af13-6d4ddfc09051 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:27.434331 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5c098-4bab-4457-af13-6d4ddfc09051 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:27.434676 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5c098-4bab-4457-af13-6d4ddfc09051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:27.474960 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-b9e5c098-4bab-4457-af13-6d4ddfc09051 None None] MFA Rules not processed for user `d9161fbdd32540de8b4eb85b1b2cd970`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:27.477423 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-b9e5c098-4bab-4457-af13-6d4ddfc09051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:27.518047 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa684fc8-ef43-45dc-8ed9-72e565fd9a7c admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:27.524807 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c2336-809b-4338-8bc0-2433951f425b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:27.525613 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c2336-809b-4338-8bc0-2433951f425b admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:27.526023 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c2336-809b-4338-8bc0-2433951f425b admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:27.526486 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c2336-809b-4338-8bc0-2433951f425b admin admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:27.527465 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91c2336-809b-4338-8bc0-2433951f425b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:27.529649 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91c2336-809b-4338-8bc0-2433951f425b admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:27.561500 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 803/1616] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 00:57:27 2022] POST /identity/v3/users => generated 300 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:57:27.561500 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb1695-a1a2-4dd0-9377-c996b2b599ff None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:27.561500 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb1695-a1a2-4dd0-9377-c996b2b599ff None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:27.561500 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fb1695-a1a2-4dd0-9377-c996b2b599ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:27.580534 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 814/1617] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:57:27 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:27.581643 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e5c098-4bab-4457-af13-6d4ddfc09051 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:27.594475 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e5c098-4bab-4457-af13-6d4ddfc09051 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:27.600050 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-83fb1695-a1a2-4dd0-9377-c996b2b599ff None None] MFA Rules not processed for user `2cd12b1d5bd74981b7098c32bb656f20`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:27.601289 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-83fb1695-a1a2-4dd0-9377-c996b2b599ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:27.601420 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f74953-6d20-4bdc-9235-0e590a4bf3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:27.602330 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f74953-6d20-4bdc-9235-0e590a4bf3f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:27.602641 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f74953-6d20-4bdc-9235-0e590a4bf3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:27.603018 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f74953-6d20-4bdc-9235-0e590a4bf3f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:27.604116 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f74953-6d20-4bdc-9235-0e590a4bf3f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:27.606213 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f74953-6d20-4bdc-9235-0e590a4bf3f3 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:27.641186 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 815/1618] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 00:57:27 2022] POST /identity/v3/projects => generated 357 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:57:27.644792 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f74953-6d20-4bdc-9235-0e590a4bf3f3 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:27.699988 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 804/1619] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:57:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:27.701781 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb1695-a1a2-4dd0-9377-c996b2b599ff None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:27.709533 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:27.714626 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fb1695-a1a2-4dd0-9377-c996b2b599ff None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:27.737385 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f74953-6d20-4bdc-9235-0e590a4bf3f3 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:27.743827 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250cac37-f045-4454-b161-c92cd1e73e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:27.744472 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250cac37-f045-4454-b161-c92cd1e73e76 admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:27.745131 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250cac37-f045-4454-b161-c92cd1e73e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:27.745417 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250cac37-f045-4454-b161-c92cd1e73e76 admin admin] PATH_INFO: `/v3/users` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:27.746082 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250cac37-f045-4454-b161-c92cd1e73e76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:27.748598 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250cac37-f045-4454-b161-c92cd1e73e76 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:27.769300 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:27.787969 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 816/1620] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 00:57:27 2022] POST /identity/v3/users => generated 294 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:57:27.788702 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250cac37-f045-4454-b161-c92cd1e73e76 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:27.833147 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d56f07-b42e-4131-b013-a99dbe39070f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:27.833913 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d56f07-b42e-4131-b013-a99dbe39070f admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:27.834194 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d56f07-b42e-4131-b013-a99dbe39070f admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:27.834784 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d56f07-b42e-4131-b013-a99dbe39070f admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:27.835455 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d56f07-b42e-4131-b013-a99dbe39070f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:27.837224 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d56f07-b42e-4131-b013-a99dbe39070f admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:27.849887 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 805/1621] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:57:27 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:57:27.862489 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d56f07-b42e-4131-b013-a99dbe39070f admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:27.878063 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d56f07-b42e-4131-b013-a99dbe39070f admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:27.883565 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef8adec-2e00-4a5c-8062-5e81e86695d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:27.884351 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8adec-2e00-4a5c-8062-5e81e86695d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:27.884635 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8adec-2e00-4a5c-8062-5e81e86695d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:27.884906 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8adec-2e00-4a5c-8062-5e81e86695d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:27.885570 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef8adec-2e00-4a5c-8062-5e81e86695d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:27.888086 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef8adec-2e00-4a5c-8062-5e81e86695d6 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:27.893416 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250cac37-f045-4454-b161-c92cd1e73e76 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:27.900734 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607a029c-4834-4dfe-b5fe-c0cbae204ae1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:27.901561 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a029c-4834-4dfe-b5fe-c0cbae204ae1 service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:27.901868 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a029c-4834-4dfe-b5fe-c0cbae204ae1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:27.902204 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a029c-4834-4dfe-b5fe-c0cbae204ae1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:27.915957 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 806/1622] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 00:57:27 2022] POST /identity/v3/users => generated 285 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:57:27.916971 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef8adec-2e00-4a5c-8062-5e81e86695d6 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:27.931863 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef8adec-2e00-4a5c-8062-5e81e86695d6 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:27.939296 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b9964-fa1b-4b1d-96fe-4f4225459e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:27.939802 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b9964-fa1b-4b1d-96fe-4f4225459e4c admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:27.939950 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b9964-fa1b-4b1d-96fe-4f4225459e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:27.940216 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b9964-fa1b-4b1d-96fe-4f4225459e4c admin admin] PATH_INFO: `/v3/projects` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:27.940872 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1b9964-fa1b-4b1d-96fe-4f4225459e4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:27.943237 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1b9964-fa1b-4b1d-96fe-4f4225459e4c admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:27.997546 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 807/1623] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 00:57:27 2022] POST /identity/v3/projects => generated 369 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:57:28.002982 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b9964-fa1b-4b1d-96fe-4f4225459e4c admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:28.009367 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607a029c-4834-4dfe-b5fe-c0cbae204ae1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:28.013799 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607a029c-4834-4dfe-b5fe-c0cbae204ae1 service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:28.046100 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 817/1624] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:57:27 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:57:28.049044 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607a029c-4834-4dfe-b5fe-c0cbae204ae1 service neutron] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:28.084758 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607a029c-4834-4dfe-b5fe-c0cbae204ae1 service neutron] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:28.111057 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b9964-fa1b-4b1d-96fe-4f4225459e4c admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:28.120831 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bac49c-bd23-4871-a8c7-a7dc4d44ef76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:28.122435 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bac49c-bd23-4871-a8c7-a7dc4d44ef76 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:28.122723 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bac49c-bd23-4871-a8c7-a7dc4d44ef76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:28.122992 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bac49c-bd23-4871-a8c7-a7dc4d44ef76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:28.124701 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bac49c-bd23-4871-a8c7-a7dc4d44ef76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:28.126651 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bac49c-bd23-4871-a8c7-a7dc4d44ef76 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:28.159938 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 808/1625] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:57:28 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:57:28.162185 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bac49c-bd23-4871-a8c7-a7dc4d44ef76 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:28.181731 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bac49c-bd23-4871-a8c7-a7dc4d44ef76 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:28.188371 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfbb994-6932-438b-a5cb-c8db9d16afea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:28.189201 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfbb994-6932-438b-a5cb-c8db9d16afea admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:28.189521 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfbb994-6932-438b-a5cb-c8db9d16afea admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:28.189794 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfbb994-6932-438b-a5cb-c8db9d16afea admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:28.190547 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfbb994-6932-438b-a5cb-c8db9d16afea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:28.194030 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfbb994-6932-438b-a5cb-c8db9d16afea admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:28.206419 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a83432a-ba0d-4e56-bc44-a93a83f166b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:28.207139 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83432a-ba0d-4e56-bc44-a93a83f166b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:28.207425 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83432a-ba0d-4e56-bc44-a93a83f166b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:28.207726 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83432a-ba0d-4e56-bc44-a93a83f166b4 admin admin] PATH_INFO: `/v3/projects/5711212fc0a745c8a29a3922b23b0043/users/531d2f0b04fd48b2a12829e67c20d4f6/roles/2e4889bb71f9434392c0baba59f2534e` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:28.218262 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 809/1626] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:57:28 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:57:28.218262 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfbb994-6932-438b-a5cb-c8db9d16afea admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:28.242535 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfbb994-6932-438b-a5cb-c8db9d16afea admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:28.254471 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8002863d-7e36-4fd2-86a8-595ad565cc02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:28.255424 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002863d-7e36-4fd2-86a8-595ad565cc02 admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:28.256439 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002863d-7e36-4fd2-86a8-595ad565cc02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:28.256716 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8002863d-7e36-4fd2-86a8-595ad565cc02 admin admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:28.259024 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8002863d-7e36-4fd2-86a8-595ad565cc02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:28.260673 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a83432a-ba0d-4e56-bc44-a93a83f166b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5711212fc0a745c8a29a3922b23b0043, user_id=531d2f0b04fd48b2a12829e67c20d4f6, role_id=2e4889bb71f9434392c0baba59f2534e)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:28.264874 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a83432a-ba0d-4e56-bc44-a93a83f166b4 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:28.269307 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8002863d-7e36-4fd2-86a8-595ad565cc02 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:28.300820 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 818/1627] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 00:57:28 2022] PUT /identity/v3/projects/5711212fc0a745c8a29a3922b23b0043/users/531d2f0b04fd48b2a12829e67c20d4f6/roles/2e4889bb71f9434392c0baba59f2534e => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:57:28.302390 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a83432a-ba0d-4e56-bc44-a93a83f166b4 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:28.321210 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 810/1628] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 00:57:28 2022] POST /identity/v3/users => generated 291 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:57:28.322686 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8002863d-7e36-4fd2-86a8-595ad565cc02 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:28.339576 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8002863d-7e36-4fd2-86a8-595ad565cc02 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:28.375232 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:28.413632 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:28.431462 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f6805-8992-42d0-9581-b9e5dfe7ff88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:28.432474 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f6805-8992-42d0-9581-b9e5dfe7ff88 admin admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:28.432760 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f6805-8992-42d0-9581-b9e5dfe7ff88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:28.433036 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f6805-8992-42d0-9581-b9e5dfe7ff88 admin admin] PATH_INFO: `/v3/projects/da67e4225c0d47fda1c4f2c81054156a/users/5dd3703edc264d07ad62faf8f3138a84/roles/2e4889bb71f9434392c0baba59f2534e` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:28.461033 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100f6805-8992-42d0-9581-b9e5dfe7ff88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da67e4225c0d47fda1c4f2c81054156a, user_id=5dd3703edc264d07ad62faf8f3138a84, role_id=2e4889bb71f9434392c0baba59f2534e)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:28.466475 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100f6805-8992-42d0-9581-b9e5dfe7ff88 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:28.467223 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a83432a-ba0d-4e56-bc44-a93a83f166b4 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:28.473748 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab89ad8-1cfe-46d4-8806-7f364f7b07ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:28.474835 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab89ad8-1cfe-46d4-8806-7f364f7b07ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:28.475298 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab89ad8-1cfe-46d4-8806-7f364f7b07ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:28.475584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab89ad8-1cfe-46d4-8806-7f364f7b07ef admin admin] PATH_INFO: `/v3/projects/e783b8d655984258b7da22c3b111a783/users/0fb3ca7010b94eb49100eccdf529ec1b/roles/2e4889bb71f9434392c0baba59f2534e` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:28.486730 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 811/1629] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 00:57:28 2022] PUT /identity/v3/projects/da67e4225c0d47fda1c4f2c81054156a/users/5dd3703edc264d07ad62faf8f3138a84/roles/2e4889bb71f9434392c0baba59f2534e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:57:28.488404 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f6805-8992-42d0-9581-b9e5dfe7ff88 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:28.496506 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab89ad8-1cfe-46d4-8806-7f364f7b07ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=e783b8d655984258b7da22c3b111a783, user_id=0fb3ca7010b94eb49100eccdf529ec1b, role_id=2e4889bb71f9434392c0baba59f2534e)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:28.500036 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab89ad8-1cfe-46d4-8806-7f364f7b07ef admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:28.520949 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 819/1630] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 00:57:28 2022] PUT /identity/v3/projects/e783b8d655984258b7da22c3b111a783/users/0fb3ca7010b94eb49100eccdf529ec1b/roles/2e4889bb71f9434392c0baba59f2534e => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:57:28.524132 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab89ad8-1cfe-46d4-8806-7f364f7b07ef admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:28.660578 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f6805-8992-42d0-9581-b9e5dfe7ff88 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:28.688556 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab89ad8-1cfe-46d4-8806-7f364f7b07ef admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:28.697609 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e06de-a7fe-4f28-a9f5-94cefef39fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:28.698859 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e06de-a7fe-4f28-a9f5-94cefef39fb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:28.700045 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e06de-a7fe-4f28-a9f5-94cefef39fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:28.700576 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e06de-a7fe-4f28-a9f5-94cefef39fb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:28.701441 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5e06de-a7fe-4f28-a9f5-94cefef39fb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:28.706189 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5e06de-a7fe-4f28-a9f5-94cefef39fb9 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:28.735937 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 820/1631] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:57:28 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:57:28.737008 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e06de-a7fe-4f28-a9f5-94cefef39fb9 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:28.749671 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e06de-a7fe-4f28-a9f5-94cefef39fb9 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:28.757665 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc299f-6fe0-4c03-b32e-4245f53b5832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:28.758403 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc299f-6fe0-4c03-b32e-4245f53b5832 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:28.758742 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc299f-6fe0-4c03-b32e-4245f53b5832 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:28.759018 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc299f-6fe0-4c03-b32e-4245f53b5832 admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:28.761566 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cc299f-6fe0-4c03-b32e-4245f53b5832 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:28.765027 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cc299f-6fe0-4c03-b32e-4245f53b5832 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:28.780127 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 821/1632] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:57:28 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:57:28.782141 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc299f-6fe0-4c03-b32e-4245f53b5832 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:28.797615 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc299f-6fe0-4c03-b32e-4245f53b5832 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:28.804226 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77809556-304a-48eb-8463-0e2e4786ec5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:28.805767 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77809556-304a-48eb-8463-0e2e4786ec5b admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:28.806168 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77809556-304a-48eb-8463-0e2e4786ec5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:28.806647 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77809556-304a-48eb-8463-0e2e4786ec5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:28.807778 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77809556-304a-48eb-8463-0e2e4786ec5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:28.811154 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77809556-304a-48eb-8463-0e2e4786ec5b admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:28.839053 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5309e373-bb4e-46cc-8458-574b7af36add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:28.842076 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309e373-bb4e-46cc-8458-574b7af36add admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:28.845779 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 822/1633] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:57:28 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:57:28.845779 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77809556-304a-48eb-8463-0e2e4786ec5b admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:28.846386 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309e373-bb4e-46cc-8458-574b7af36add admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:28.847194 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309e373-bb4e-46cc-8458-574b7af36add admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:28.849747 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5309e373-bb4e-46cc-8458-574b7af36add admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:28.857865 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5309e373-bb4e-46cc-8458-574b7af36add admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:28.862042 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77809556-304a-48eb-8463-0e2e4786ec5b admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:28.873236 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66915d2c-a86f-48e7-9eff-c046edf6becd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:28.874196 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66915d2c-a86f-48e7-9eff-c046edf6becd admin admin] REQUEST_METHOD: `PUT` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:28.875922 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66915d2c-a86f-48e7-9eff-c046edf6becd admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:28.876460 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66915d2c-a86f-48e7-9eff-c046edf6becd admin admin] PATH_INFO: `/v3/projects/206d66903945403a8b90d6a6ec425bf6/users/8422f8d742ac4ad791d8b646fd38e8da/roles/2e4889bb71f9434392c0baba59f2534e` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:28.888930 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 812/1634] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:57:28 2022] GET /identity/v3/roles => generated 1420 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:57:28.891798 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5309e373-bb4e-46cc-8458-574b7af36add admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:28.905485 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66915d2c-a86f-48e7-9eff-c046edf6becd admin admin] RBAC: Authorizing `identity:create_grant(project_id=206d66903945403a8b90d6a6ec425bf6, user_id=8422f8d742ac4ad791d8b646fd38e8da, role_id=2e4889bb71f9434392c0baba59f2534e)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:28.909974 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66915d2c-a86f-48e7-9eff-c046edf6becd admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:28.916903 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5309e373-bb4e-46cc-8458-574b7af36add admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:28.923900 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7cdd53-a39e-4eb2-89cb-70a4071f5ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:28.925151 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7cdd53-a39e-4eb2-89cb-70a4071f5ae9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:28.925664 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7cdd53-a39e-4eb2-89cb-70a4071f5ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:28.926113 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7cdd53-a39e-4eb2-89cb-70a4071f5ae9 admin admin] PATH_INFO: `/v3/projects/da67e4225c0d47fda1c4f2c81054156a/users/5dd3703edc264d07ad62faf8f3138a84/roles/2e4889bb71f9434392c0baba59f2534e` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:28.929070 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7cdd53-a39e-4eb2-89cb-70a4071f5ae9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da67e4225c0d47fda1c4f2c81054156a, user_id=5dd3703edc264d07ad62faf8f3138a84, role_id=2e4889bb71f9434392c0baba59f2534e)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:28.932318 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7cdd53-a39e-4eb2-89cb-70a4071f5ae9 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:28.939118 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 823/1635] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 00:57:28 2022] PUT /identity/v3/projects/206d66903945403a8b90d6a6ec425bf6/users/8422f8d742ac4ad791d8b646fd38e8da/roles/2e4889bb71f9434392c0baba59f2534e => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:57:28.944197 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66915d2c-a86f-48e7-9eff-c046edf6becd admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:28.947913 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 813/1636] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 00:57:28 2022] PUT /identity/v3/projects/da67e4225c0d47fda1c4f2c81054156a/users/5dd3703edc264d07ad62faf8f3138a84/roles/2e4889bb71f9434392c0baba59f2534e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:57:28.949186 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7cdd53-a39e-4eb2-89cb-70a4071f5ae9 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:29.052947 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:29.087455 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7cdd53-a39e-4eb2-89cb-70a4071f5ae9 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:29.096511 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a1c3f-6635-4124-a6cf-c0361dc8774c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:29.097652 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a1c3f-6635-4124-a6cf-c0361dc8774c admin admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:29.097933 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a1c3f-6635-4124-a6cf-c0361dc8774c admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:29.098255 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a1c3f-6635-4124-a6cf-c0361dc8774c admin admin] PATH_INFO: `/v3/projects/5711212fc0a745c8a29a3922b23b0043/users/531d2f0b04fd48b2a12829e67c20d4f6/roles/2e4889bb71f9434392c0baba59f2534e` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:29.101887 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2a1c3f-6635-4124-a6cf-c0361dc8774c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5711212fc0a745c8a29a3922b23b0043, user_id=531d2f0b04fd48b2a12829e67c20d4f6, role_id=2e4889bb71f9434392c0baba59f2534e)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:29.106496 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2a1c3f-6635-4124-a6cf-c0361dc8774c admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:29.114610 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66915d2c-a86f-48e7-9eff-c046edf6becd admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:29.126899 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 814/1637] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 00:57:28 2022] PUT /identity/v3/projects/5711212fc0a745c8a29a3922b23b0043/users/531d2f0b04fd48b2a12829e67c20d4f6/roles/2e4889bb71f9434392c0baba59f2534e => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:57:29.138626 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:29.139762 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a1c3f-6635-4124-a6cf-c0361dc8774c admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:29.261717 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf2754-7e30-44f3-8b1a-84609d5ceb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:29.262418 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf2754-7e30-44f3-8b1a-84609d5ceb28 admin admin] REQUEST_METHOD: `PUT` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:29.262706 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf2754-7e30-44f3-8b1a-84609d5ceb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:29.262985 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf2754-7e30-44f3-8b1a-84609d5ceb28 admin admin] PATH_INFO: `/v3/projects/e783b8d655984258b7da22c3b111a783/users/0fb3ca7010b94eb49100eccdf529ec1b/roles/2e4889bb71f9434392c0baba59f2534e` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:29.270728 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bf2754-7e30-44f3-8b1a-84609d5ceb28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e783b8d655984258b7da22c3b111a783, user_id=0fb3ca7010b94eb49100eccdf529ec1b, role_id=2e4889bb71f9434392c0baba59f2534e)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:29.273998 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bf2754-7e30-44f3-8b1a-84609d5ceb28 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:29.288722 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a1c3f-6635-4124-a6cf-c0361dc8774c admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:29.298980 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d9286-c128-460b-b3fa-f63305829c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:29.301611 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d9286-c128-460b-b3fa-f63305829c36 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:29.302172 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d9286-c128-460b-b3fa-f63305829c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:29.302621 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d9286-c128-460b-b3fa-f63305829c36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:29.303052 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 824/1638] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 00:57:28 2022] PUT /identity/v3/projects/e783b8d655984258b7da22c3b111a783/users/0fb3ca7010b94eb49100eccdf529ec1b/roles/2e4889bb71f9434392c0baba59f2534e => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:57:29.303540 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635d9286-c128-460b-b3fa-f63305829c36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:29.305780 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec201a-fc81-43eb-949c-71b2690410b8 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:29.306150 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635d9286-c128-460b-b3fa-f63305829c36 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:29.307381 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec201a-fc81-43eb-949c-71b2690410b8 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:29.308134 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ec201a-fc81-43eb-949c-71b2690410b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:29.330177 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 815/1639] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:57:29.332040 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d669c-3486-4014-b2fd-694222a5cb90 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:29.332831 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d669c-3486-4014-b2fd-694222a5cb90 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:29.333111 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d669c-3486-4014-b2fd-694222a5cb90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:29.371518 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-c03d669c-3486-4014-b2fd-694222a5cb90 None None] MFA Rules not processed for user `531d2f0b04fd48b2a12829e67c20d4f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:29.373092 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-c03d669c-3486-4014-b2fd-694222a5cb90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:29.392026 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-34ec201a-fc81-43eb-949c-71b2690410b8 None None] MFA Rules not processed for user `5dd3703edc264d07ad62faf8f3138a84`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:29.394140 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-34ec201a-fc81-43eb-949c-71b2690410b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:29.472335 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 816/1640] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:57:29 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:29.473710 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab1402-11aa-4890-ab88-98962b41b830 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:29.474044 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab1402-11aa-4890-ab88-98962b41b830 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:29.474317 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab1402-11aa-4890-ab88-98962b41b830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:29.508572 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-dcab1402-11aa-4890-ab88-98962b41b830 None None] MFA Rules not processed for user `0fb3ca7010b94eb49100eccdf529ec1b`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:29.510055 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-dcab1402-11aa-4890-ab88-98962b41b830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:29.560421 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 825/1641] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:57:29 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:29.561697 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ec201a-fc81-43eb-949c-71b2690410b8 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:29.594005 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:29.749301 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 817/1642] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:57:29 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:29.749301 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab1402-11aa-4890-ab88-98962b41b830 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:29.750530 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ec201a-fc81-43eb-949c-71b2690410b8 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:29.773145 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff7d8a5-7a48-4190-a280-6831088c2d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:29.775972 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff7d8a5-7a48-4190-a280-6831088c2d7f admin admin] REQUEST_METHOD: `PUT` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:29.776394 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff7d8a5-7a48-4190-a280-6831088c2d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:29.776708 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff7d8a5-7a48-4190-a280-6831088c2d7f admin admin] PATH_INFO: `/v3/projects/206d66903945403a8b90d6a6ec425bf6/users/8422f8d742ac4ad791d8b646fd38e8da/roles/2e4889bb71f9434392c0baba59f2534e` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:29.783220 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff7d8a5-7a48-4190-a280-6831088c2d7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=206d66903945403a8b90d6a6ec425bf6, user_id=8422f8d742ac4ad791d8b646fd38e8da, role_id=2e4889bb71f9434392c0baba59f2534e)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:29.793271 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff7d8a5-7a48-4190-a280-6831088c2d7f admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:29.831394 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 826/1643] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 00:57:29 2022] PUT /identity/v3/projects/206d66903945403a8b90d6a6ec425bf6/users/8422f8d742ac4ad791d8b646fd38e8da/roles/2e4889bb71f9434392c0baba59f2534e => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:57:29.834177 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff7d8a5-7a48-4190-a280-6831088c2d7f admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:29.924036 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab1402-11aa-4890-ab88-98962b41b830 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:29.928932 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:30.055254 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff7d8a5-7a48-4190-a280-6831088c2d7f admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:30.060194 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca3f22b-222d-46cd-9360-0479ec41eb4a tempest-QuotasTest-1804856443 tempest-QuotasTest-1804856443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dd3703edc264d07ad62faf8f3138a84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da67e4225c0d47fda1c4f2c81054156a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:30.060825 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca3f22b-222d-46cd-9360-0479ec41eb4a tempest-QuotasTest-1804856443 tempest-QuotasTest-1804856443-project-admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:30.061109 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca3f22b-222d-46cd-9360-0479ec41eb4a tempest-QuotasTest-1804856443 tempest-QuotasTest-1804856443-project-admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:30.061386 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca3f22b-222d-46cd-9360-0479ec41eb4a tempest-QuotasTest-1804856443 tempest-QuotasTest-1804856443-project-admin] PATH_INFO: `/v3/domains` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:30.062057 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca3f22b-222d-46cd-9360-0479ec41eb4a tempest-QuotasTest-1804856443 tempest-QuotasTest-1804856443-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:57:30.062361 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca3f22b-222d-46cd-9360-0479ec41eb4a tempest-QuotasTest-1804856443 tempest-QuotasTest-1804856443-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:30.064299 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca3f22b-222d-46cd-9360-0479ec41eb4a tempest-QuotasTest-1804856443 tempest-QuotasTest-1804856443-project-admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:30.068627 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aea6ca4-2034-49f4-a955-25128d3365df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:30.069383 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea6ca4-2034-49f4-a955-25128d3365df service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:30.069685 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea6ca4-2034-49f4-a955-25128d3365df service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:30.070616 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea6ca4-2034-49f4-a955-25128d3365df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:30.089302 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 827/1644] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 00:57:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:57:30.093540 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca3f22b-222d-46cd-9360-0479ec41eb4a tempest-QuotasTest-1804856443 tempest-QuotasTest-1804856443-project-admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:30.115541 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca3f22b-222d-46cd-9360-0479ec41eb4a tempest-QuotasTest-1804856443 tempest-QuotasTest-1804856443-project-admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:30.120346 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9661c2-9dfe-41e2-b6ce-b373423b6fb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:30.121054 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9661c2-9dfe-41e2-b6ce-b373423b6fb6 service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:30.121404 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9661c2-9dfe-41e2-b6ce-b373423b6fb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:30.121900 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9661c2-9dfe-41e2-b6ce-b373423b6fb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:30.216913 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aea6ca4-2034-49f4-a955-25128d3365df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:30.219251 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aea6ca4-2034-49f4-a955-25128d3365df service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:30.241103 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 818/1645] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:57:29 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:57:30.243864 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03440dc7-ec00-4fe9-9091-a26403c1b5e1 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:30.244155 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03440dc7-ec00-4fe9-9091-a26403c1b5e1 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:30.244428 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03440dc7-ec00-4fe9-9091-a26403c1b5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:30.245305 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9661c2-9dfe-41e2-b6ce-b373423b6fb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:30.246808 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9661c2-9dfe-41e2-b6ce-b373423b6fb6 service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:30.286384 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 828/1646] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:57:30 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:57:30.287334 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9661c2-9dfe-41e2-b6ce-b373423b6fb6 service neutron] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:30.317346 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9661c2-9dfe-41e2-b6ce-b373423b6fb6 service neutron] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:30.322746 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb59f6-2316-4f5a-ab66-5480a09a83d0 tempest-QuotasTest-1804856443 tempest-QuotasTest-1804856443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dd3703edc264d07ad62faf8f3138a84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da67e4225c0d47fda1c4f2c81054156a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:30.323460 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb59f6-2316-4f5a-ab66-5480a09a83d0 tempest-QuotasTest-1804856443 tempest-QuotasTest-1804856443-project-admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:30.323855 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb59f6-2316-4f5a-ab66-5480a09a83d0 tempest-QuotasTest-1804856443 tempest-QuotasTest-1804856443-project-admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:30.324207 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb59f6-2316-4f5a-ab66-5480a09a83d0 tempest-QuotasTest-1804856443 tempest-QuotasTest-1804856443-project-admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:30.324958 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb59f6-2316-4f5a-ab66-5480a09a83d0 tempest-QuotasTest-1804856443 tempest-QuotasTest-1804856443-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:30.326974 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb59f6-2316-4f5a-ab66-5480a09a83d0 tempest-QuotasTest-1804856443 tempest-QuotasTest-1804856443-project-admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:30.353792 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-03440dc7-ec00-4fe9-9091-a26403c1b5e1 None None] MFA Rules not processed for user `8422f8d742ac4ad791d8b646fd38e8da`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:30.357480 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-03440dc7-ec00-4fe9-9091-a26403c1b5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:30.379092 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 829/1647] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 00:57:30 2022] POST /identity/v3/projects => generated 348 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:57:30.384397 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb59f6-2316-4f5a-ab66-5480a09a83d0 tempest-QuotasTest-1804856443 tempest-QuotasTest-1804856443-project-admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:30.455064 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:30.516451 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 819/1648] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:57:30 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:30.530468 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb59f6-2316-4f5a-ab66-5480a09a83d0 tempest-QuotasTest-1804856443 tempest-QuotasTest-1804856443-project-admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:30.533265 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03440dc7-ec00-4fe9-9091-a26403c1b5e1 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:30.543132 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe338e4-2865-413d-92f9-817d8fe8f8bc tempest-QuotasTest-1804856443 tempest-QuotasTest-1804856443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dd3703edc264d07ad62faf8f3138a84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da67e4225c0d47fda1c4f2c81054156a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:30.544261 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe338e4-2865-413d-92f9-817d8fe8f8bc tempest-QuotasTest-1804856443 tempest-QuotasTest-1804856443-project-admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:30.544603 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe338e4-2865-413d-92f9-817d8fe8f8bc tempest-QuotasTest-1804856443 tempest-QuotasTest-1804856443-project-admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:30.544955 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe338e4-2865-413d-92f9-817d8fe8f8bc tempest-QuotasTest-1804856443 tempest-QuotasTest-1804856443-project-admin] PATH_INFO: `/v3/domains` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:30.545679 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe338e4-2865-413d-92f9-817d8fe8f8bc tempest-QuotasTest-1804856443 tempest-QuotasTest-1804856443-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:57:30.546492 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe338e4-2865-413d-92f9-817d8fe8f8bc tempest-QuotasTest-1804856443 tempest-QuotasTest-1804856443-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:30.548459 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe338e4-2865-413d-92f9-817d8fe8f8bc tempest-QuotasTest-1804856443 tempest-QuotasTest-1804856443-project-admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:30.549071 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03440dc7-ec00-4fe9-9091-a26403c1b5e1 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:30.570278 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 830/1649] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 00:57:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:57:30.608085 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe338e4-2865-413d-92f9-817d8fe8f8bc tempest-QuotasTest-1804856443 tempest-QuotasTest-1804856443-project-admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:30.678336 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0902e4e5-f4c2-4f1d-b99d-1df1f33576ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:30.678993 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0902e4e5-f4c2-4f1d-b99d-1df1f33576ad service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:30.679278 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0902e4e5-f4c2-4f1d-b99d-1df1f33576ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:30.679547 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0902e4e5-f4c2-4f1d-b99d-1df1f33576ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:30.688936 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:30.758728 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe338e4-2865-413d-92f9-817d8fe8f8bc tempest-QuotasTest-1804856443 tempest-QuotasTest-1804856443-project-admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:30.771176 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78ada95-adf7-46af-93b6-9fe5631540a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:30.771845 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ada95-adf7-46af-93b6-9fe5631540a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:30.772124 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ada95-adf7-46af-93b6-9fe5631540a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:30.772389 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ada95-adf7-46af-93b6-9fe5631540a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:30.794294 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78ada95-adf7-46af-93b6-9fe5631540a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:30.796430 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78ada95-adf7-46af-93b6-9fe5631540a1 service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:30.811019 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0902e4e5-f4c2-4f1d-b99d-1df1f33576ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:30.812725 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0902e4e5-f4c2-4f1d-b99d-1df1f33576ad service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:30.825551 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 820/1650] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:57:30 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:57:30.830905 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 831/1651] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:57:30 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 00:57:32.214893 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0902e4e5-f4c2-4f1d-b99d-1df1f33576ad service neutron] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:32.274478 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0902e4e5-f4c2-4f1d-b99d-1df1f33576ad service neutron] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:32.294847 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4171fc8d-f94b-4fde-9e15-c3078ab9d64f tempest-QuotasTest-1804856443 tempest-QuotasTest-1804856443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5dd3703edc264d07ad62faf8f3138a84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da67e4225c0d47fda1c4f2c81054156a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:32.297408 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171fc8d-f94b-4fde-9e15-c3078ab9d64f tempest-QuotasTest-1804856443 tempest-QuotasTest-1804856443-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:32.297963 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171fc8d-f94b-4fde-9e15-c3078ab9d64f tempest-QuotasTest-1804856443 tempest-QuotasTest-1804856443-project-admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:32.298435 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171fc8d-f94b-4fde-9e15-c3078ab9d64f tempest-QuotasTest-1804856443 tempest-QuotasTest-1804856443-project-admin] PATH_INFO: `/v3/projects/a77df265db48491280365e57dc86e750` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:32.299920 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4171fc8d-f94b-4fde-9e15-c3078ab9d64f tempest-QuotasTest-1804856443 tempest-QuotasTest-1804856443-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a77df265db48491280365e57dc86e750)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:32.303394 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4171fc8d-f94b-4fde-9e15-c3078ab9d64f tempest-QuotasTest-1804856443 tempest-QuotasTest-1804856443-project-admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:32.487469 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-4171fc8d-f94b-4fde-9e15-c3078ab9d64f tempest-QuotasTest-1804856443 tempest-QuotasTest-1804856443-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a77df265db48491280365e57dc86e750', 'request_id': 'req-4171fc8d-f94b-4fde-9e15-c3078ab9d64f'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:32.500458 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-4171fc8d-f94b-4fde-9e15-c3078ab9d64f tempest-QuotasTest-1804856443 tempest-QuotasTest-1804856443-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a77df265db48491280365e57dc86e750', 'request_id': 'req-4171fc8d-f94b-4fde-9e15-c3078ab9d64f'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:32.547409 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-4171fc8d-f94b-4fde-9e15-c3078ab9d64f tempest-QuotasTest-1804856443 tempest-QuotasTest-1804856443-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a77df265db48491280365e57dc86e750', 'request_id': 'req-4171fc8d-f94b-4fde-9e15-c3078ab9d64f'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:32.608526 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-4171fc8d-f94b-4fde-9e15-c3078ab9d64f tempest-QuotasTest-1804856443 tempest-QuotasTest-1804856443-project-admin] The token cache is being invalidate because project a77df265db48491280365e57dc86e750 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81807) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:57:32.609051 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-4171fc8d-f94b-4fde-9e15-c3078ab9d64f tempest-QuotasTest-1804856443 tempest-QuotasTest-1804856443-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:32.611441 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-4171fc8d-f94b-4fde-9e15-c3078ab9d64f tempest-QuotasTest-1804856443 tempest-QuotasTest-1804856443-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:32.624094 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 821/1652] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 00:57:32 2022] DELETE /identity/v3/projects/a77df265db48491280365e57dc86e750 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:57:34.271977 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78ada95-adf7-46af-93b6-9fe5631540a1 service neutron] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:34.358281 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78ada95-adf7-46af-93b6-9fe5631540a1 service neutron] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:34.457597 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24b5b61-dcbf-4d05-b025-5d5110c735d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:34.458572 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b5b61-dcbf-4d05-b025-5d5110c735d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:34.458993 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b5b61-dcbf-4d05-b025-5d5110c735d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:34.463604 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b5b61-dcbf-4d05-b025-5d5110c735d3 admin admin] PATH_INFO: `/v3/users/26bccbe0c0c245239efafc6604c35403` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:34.465434 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24b5b61-dcbf-4d05-b025-5d5110c735d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26bccbe0c0c245239efafc6604c35403)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:34.468817 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24b5b61-dcbf-4d05-b025-5d5110c735d3 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:34.604307 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-b24b5b61-dcbf-4d05-b025-5d5110c735d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26bccbe0c0c245239efafc6604c35403'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:34.618307 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-b24b5b61-dcbf-4d05-b025-5d5110c735d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26bccbe0c0c245239efafc6604c35403'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:34.647238 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-b24b5b61-dcbf-4d05-b025-5d5110c735d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26bccbe0c0c245239efafc6604c35403'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:34.656451 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-b24b5b61-dcbf-4d05-b025-5d5110c735d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26bccbe0c0c245239efafc6604c35403'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:34.659015 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-b24b5b61-dcbf-4d05-b025-5d5110c735d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26bccbe0c0c245239efafc6604c35403'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:34.678168 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:34.697794 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 832/1653] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 00:57:34 2022] DELETE /identity/v3/users/26bccbe0c0c245239efafc6604c35403 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:57:34.702534 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851a0b4-3f0b-4121-8f96-04f41963dd68 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:34.703381 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851a0b4-3f0b-4121-8f96-04f41963dd68 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:34.703381 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1851a0b4-3f0b-4121-8f96-04f41963dd68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:34.734637 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-1851a0b4-3f0b-4121-8f96-04f41963dd68 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:34.735906 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-1851a0b4-3f0b-4121-8f96-04f41963dd68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:34.741874 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:34.831381 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 822/1654] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:57:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:34.912106 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24b5b61-dcbf-4d05-b025-5d5110c735d3 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:34.914314 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-b24b5b61-dcbf-4d05-b025-5d5110c735d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:35.034226 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24b5b61-dcbf-4d05-b025-5d5110c735d3 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:35.040823 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e5d33-4f86-4549-99c4-9ab4b5ced1ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:35.041591 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e5d33-4f86-4549-99c4-9ab4b5ced1ae service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:35.042484 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e5d33-4f86-4549-99c4-9ab4b5ced1ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:35.042484 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e5d33-4f86-4549-99c4-9ab4b5ced1ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:35.054248 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407e5d33-4f86-4549-99c4-9ab4b5ced1ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:35.055793 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407e5d33-4f86-4549-99c4-9ab4b5ced1ae service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:35.071403 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 833/1655] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:57:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 00:57:35.645320 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1851a0b4-3f0b-4121-8f96-04f41963dd68 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:35.647180 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-1851a0b4-3f0b-4121-8f96-04f41963dd68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:35.679080 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1851a0b4-3f0b-4121-8f96-04f41963dd68 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:35.700394 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb220f78-f452-461d-869c-c5c548437691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:35.701193 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb220f78-f452-461d-869c-c5c548437691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:35.701572 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb220f78-f452-461d-869c-c5c548437691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:35.702776 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb220f78-f452-461d-869c-c5c548437691 admin admin] PATH_INFO: `/v3/users/2cd12b1d5bd74981b7098c32bb656f20` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:35.706062 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb220f78-f452-461d-869c-c5c548437691 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cd12b1d5bd74981b7098c32bb656f20)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:35.707853 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: WARNING py.warnings [None req-eb220f78-f452-461d-869c-c5c548437691 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 00:57:35.707853 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: warnings.warn(msg) Aug 28 00:57:35.707853 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: Aug 28 00:57:35.711648 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb220f78-f452-461d-869c-c5c548437691 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:35.857566 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-eb220f78-f452-461d-869c-c5c548437691 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cd12b1d5bd74981b7098c32bb656f20'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:35.904707 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-eb220f78-f452-461d-869c-c5c548437691 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cd12b1d5bd74981b7098c32bb656f20'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:35.922188 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-eb220f78-f452-461d-869c-c5c548437691 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cd12b1d5bd74981b7098c32bb656f20'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:35.923648 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-eb220f78-f452-461d-869c-c5c548437691 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cd12b1d5bd74981b7098c32bb656f20'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:35.924528 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-eb220f78-f452-461d-869c-c5c548437691 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cd12b1d5bd74981b7098c32bb656f20'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:35.969605 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 823/1656] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 00:57:35 2022] DELETE /identity/v3/users/2cd12b1d5bd74981b7098c32bb656f20 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:57:35.971050 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b74601-8c5d-4f27-ba69-eed87f77e2a5 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:35.971606 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b74601-8c5d-4f27-ba69-eed87f77e2a5 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:35.971736 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b74601-8c5d-4f27-ba69-eed87f77e2a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:36.013867 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-88b74601-8c5d-4f27-ba69-eed87f77e2a5 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:36.015148 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-88b74601-8c5d-4f27-ba69-eed87f77e2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:36.106624 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 834/1657] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:57:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:57:36.130463 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb220f78-f452-461d-869c-c5c548437691 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:36.132144 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-eb220f78-f452-461d-869c-c5c548437691 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:36.272120 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb220f78-f452-461d-869c-c5c548437691 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:36.278351 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a29214-a081-442f-a36f-974cc09bb577 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:36.279003 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a29214-a081-442f-a36f-974cc09bb577 service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:36.279279 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a29214-a081-442f-a36f-974cc09bb577 service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:36.279564 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a29214-a081-442f-a36f-974cc09bb577 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:36.294022 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a29214-a081-442f-a36f-974cc09bb577 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:36.296841 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a29214-a081-442f-a36f-974cc09bb577 service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:36.323598 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 824/1658] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:57:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:57:36.765070 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b74601-8c5d-4f27-ba69-eed87f77e2a5 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:36.766886 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-88b74601-8c5d-4f27-ba69-eed87f77e2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:36.788374 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b74601-8c5d-4f27-ba69-eed87f77e2a5 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:36.804097 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be0210-2943-4b47-8604-2a8a24fdb672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:36.804774 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be0210-2943-4b47-8604-2a8a24fdb672 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:36.805106 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be0210-2943-4b47-8604-2a8a24fdb672 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:36.805451 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be0210-2943-4b47-8604-2a8a24fdb672 admin admin] PATH_INFO: `/v3/users/d7ab9a4634c9414596154b0f3229f55f` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:36.807009 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be0210-2943-4b47-8604-2a8a24fdb672 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7ab9a4634c9414596154b0f3229f55f)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:36.809118 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be0210-2943-4b47-8604-2a8a24fdb672 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:36.919293 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-c4be0210-2943-4b47-8604-2a8a24fdb672 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7ab9a4634c9414596154b0f3229f55f'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:36.939744 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-c4be0210-2943-4b47-8604-2a8a24fdb672 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7ab9a4634c9414596154b0f3229f55f'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:36.985996 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-c4be0210-2943-4b47-8604-2a8a24fdb672 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7ab9a4634c9414596154b0f3229f55f'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:36.986986 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-c4be0210-2943-4b47-8604-2a8a24fdb672 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7ab9a4634c9414596154b0f3229f55f'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:36.987631 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-c4be0210-2943-4b47-8604-2a8a24fdb672 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7ab9a4634c9414596154b0f3229f55f'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:37.029699 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 835/1659] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 00:57:36 2022] DELETE /identity/v3/users/d7ab9a4634c9414596154b0f3229f55f => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:57:37.032152 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899b2d77-dd40-45b4-83e7-9acc36728903 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:37.033424 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899b2d77-dd40-45b4-83e7-9acc36728903 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:37.033876 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899b2d77-dd40-45b4-83e7-9acc36728903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:37.091626 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-899b2d77-dd40-45b4-83e7-9acc36728903 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:37.092921 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-899b2d77-dd40-45b4-83e7-9acc36728903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:37.143747 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:37.194324 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be0210-2943-4b47-8604-2a8a24fdb672 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:37.196638 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-c4be0210-2943-4b47-8604-2a8a24fdb672 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:37.214387 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:37.240320 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 825/1660] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:57:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:37.275710 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899b2d77-dd40-45b4-83e7-9acc36728903 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:37.277021 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-899b2d77-dd40-45b4-83e7-9acc36728903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:37.405435 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be0210-2943-4b47-8604-2a8a24fdb672 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:37.419110 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844e20ab-c374-4b5a-86f4-4646d3d8eb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:37.420091 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e20ab-c374-4b5a-86f4-4646d3d8eb14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:37.420532 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e20ab-c374-4b5a-86f4-4646d3d8eb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:37.420904 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e20ab-c374-4b5a-86f4-4646d3d8eb14 admin admin] PATH_INFO: `/v3/users/1c00a14fe4fb4b61bd36135ed0633584` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:37.423204 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844e20ab-c374-4b5a-86f4-4646d3d8eb14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c00a14fe4fb4b61bd36135ed0633584)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:37.430100 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844e20ab-c374-4b5a-86f4-4646d3d8eb14 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:37.458808 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899b2d77-dd40-45b4-83e7-9acc36728903 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:37.464567 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218faab6-fd10-4a03-88f5-fe1719094118 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:37.470739 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218faab6-fd10-4a03-88f5-fe1719094118 service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:37.471731 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218faab6-fd10-4a03-88f5-fe1719094118 service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:37.472036 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218faab6-fd10-4a03-88f5-fe1719094118 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:37.490298 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218faab6-fd10-4a03-88f5-fe1719094118 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:37.492467 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218faab6-fd10-4a03-88f5-fe1719094118 service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:37.513862 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 826/1661] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:57:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 00:57:37.530659 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-844e20ab-c374-4b5a-86f4-4646d3d8eb14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c00a14fe4fb4b61bd36135ed0633584'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:37.550764 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-844e20ab-c374-4b5a-86f4-4646d3d8eb14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c00a14fe4fb4b61bd36135ed0633584'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:37.633854 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-844e20ab-c374-4b5a-86f4-4646d3d8eb14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c00a14fe4fb4b61bd36135ed0633584'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:37.639622 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-844e20ab-c374-4b5a-86f4-4646d3d8eb14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c00a14fe4fb4b61bd36135ed0633584'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:37.644113 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-844e20ab-c374-4b5a-86f4-4646d3d8eb14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c00a14fe4fb4b61bd36135ed0633584'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:37.677562 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218faab6-fd10-4a03-88f5-fe1719094118 service neutron] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:37.683969 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 836/1662] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 00:57:37 2022] DELETE /identity/v3/users/1c00a14fe4fb4b61bd36135ed0633584 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:57:37.685162 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-218faab6-fd10-4a03-88f5-fe1719094118 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:37.688889 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6a842-917f-4cd0-bcc9-85b2d8785136 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:37.688889 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6a842-917f-4cd0-bcc9-85b2d8785136 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:37.688889 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc6a842-917f-4cd0-bcc9-85b2d8785136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:37.737905 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-ffc6a842-917f-4cd0-bcc9-85b2d8785136 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:37.741497 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-ffc6a842-917f-4cd0-bcc9-85b2d8785136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:37.749691 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218faab6-fd10-4a03-88f5-fe1719094118 service neutron] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:37.888256 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 837/1663] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:57:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:37.985129 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ea98c-0f2f-4fde-88cc-9861fec69ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:37.986623 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ea98c-0f2f-4fde-88cc-9861fec69ead admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:37.987230 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ea98c-0f2f-4fde-88cc-9861fec69ead admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:37.987730 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ea98c-0f2f-4fde-88cc-9861fec69ead admin admin] PATH_INFO: `/v3/projects/1a57b8e6dccd4e398c68c21b9f176dbf` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:37.992693 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336ea98c-0f2f-4fde-88cc-9861fec69ead admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a57b8e6dccd4e398c68c21b9f176dbf)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:37.995259 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336ea98c-0f2f-4fde-88cc-9861fec69ead admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:38.109734 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-336ea98c-0f2f-4fde-88cc-9861fec69ead admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a57b8e6dccd4e398c68c21b9f176dbf', 'request_id': 'req-336ea98c-0f2f-4fde-88cc-9861fec69ead'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:38.153217 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-336ea98c-0f2f-4fde-88cc-9861fec69ead admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a57b8e6dccd4e398c68c21b9f176dbf', 'request_id': 'req-336ea98c-0f2f-4fde-88cc-9861fec69ead'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:38.153403 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6a842-917f-4cd0-bcc9-85b2d8785136 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:38.158118 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-ffc6a842-917f-4cd0-bcc9-85b2d8785136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:38.173964 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-336ea98c-0f2f-4fde-88cc-9861fec69ead admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a57b8e6dccd4e398c68c21b9f176dbf', 'request_id': 'req-336ea98c-0f2f-4fde-88cc-9861fec69ead'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:38.188803 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:38.196250 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-336ea98c-0f2f-4fde-88cc-9861fec69ead admin admin] The token cache is being invalidate because project 1a57b8e6dccd4e398c68c21b9f176dbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81807) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:57:38.199289 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-336ea98c-0f2f-4fde-88cc-9861fec69ead admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:38.200442 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-336ea98c-0f2f-4fde-88cc-9861fec69ead admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:38.207930 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 827/1664] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 00:57:37 2022] DELETE /identity/v3/projects/1a57b8e6dccd4e398c68c21b9f176dbf => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:57:38.211489 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ea98c-0f2f-4fde-88cc-9861fec69ead admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:38.226931 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-336ea98c-0f2f-4fde-88cc-9861fec69ead admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:38.247651 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:38.334173 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc6a842-917f-4cd0-bcc9-85b2d8785136 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:38.432454 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ea98c-0f2f-4fde-88cc-9861fec69ead admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:38.446940 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c64b86-c373-4a16-938f-993f1a57b445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:38.451548 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c64b86-c373-4a16-938f-993f1a57b445 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:38.452559 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c64b86-c373-4a16-938f-993f1a57b445 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:38.453051 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c64b86-c373-4a16-938f-993f1a57b445 admin admin] PATH_INFO: `/v3/users/5dd3703edc264d07ad62faf8f3138a84` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:38.456247 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c64b86-c373-4a16-938f-993f1a57b445 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dd3703edc264d07ad62faf8f3138a84)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:38.458379 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8acb845-f58f-4d45-8ca5-77781977fffb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:38.459036 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8acb845-f58f-4d45-8ca5-77781977fffb service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:38.459322 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8acb845-f58f-4d45-8ca5-77781977fffb service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:38.459599 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8acb845-f58f-4d45-8ca5-77781977fffb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:38.461622 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-b8acb845-f58f-4d45-8ca5-77781977fffb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:38.462074 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c64b86-c373-4a16-938f-993f1a57b445 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:38.485924 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8acb845-f58f-4d45-8ca5-77781977fffb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:38.487468 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8acb845-f58f-4d45-8ca5-77781977fffb service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:38.514440 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 838/1665] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:57:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:57:38.579293 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-b9c64b86-c373-4a16-938f-993f1a57b445 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dd3703edc264d07ad62faf8f3138a84'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:38.606359 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-b9c64b86-c373-4a16-938f-993f1a57b445 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dd3703edc264d07ad62faf8f3138a84'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:38.626963 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-b9c64b86-c373-4a16-938f-993f1a57b445 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dd3703edc264d07ad62faf8f3138a84'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:38.627636 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-b9c64b86-c373-4a16-938f-993f1a57b445 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dd3703edc264d07ad62faf8f3138a84'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:38.628387 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-b9c64b86-c373-4a16-938f-993f1a57b445 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dd3703edc264d07ad62faf8f3138a84'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:38.658180 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 828/1666] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 00:57:38 2022] DELETE /identity/v3/users/5dd3703edc264d07ad62faf8f3138a84 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:57:39.104988 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8acb845-f58f-4d45-8ca5-77781977fffb service neutron] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:39.106691 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-b8acb845-f58f-4d45-8ca5-77781977fffb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:39.133342 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8acb845-f58f-4d45-8ca5-77781977fffb service neutron] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:39.315544 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c72e0a9-4f79-4455-9559-363739e84397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:39.316305 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72e0a9-4f79-4455-9559-363739e84397 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:39.316539 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72e0a9-4f79-4455-9559-363739e84397 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:39.316983 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72e0a9-4f79-4455-9559-363739e84397 admin admin] PATH_INFO: `/v3/projects/a50dca52a2e1455486a598bcdf68d615` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:39.319286 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c72e0a9-4f79-4455-9559-363739e84397 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a50dca52a2e1455486a598bcdf68d615)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:39.320379 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: WARNING py.warnings [None req-0c72e0a9-4f79-4455-9559-363739e84397 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 28 00:57:39.320379 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: warnings.warn(msg) Aug 28 00:57:39.320379 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: Aug 28 00:57:39.322025 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c72e0a9-4f79-4455-9559-363739e84397 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:39.437576 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-0c72e0a9-4f79-4455-9559-363739e84397 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a50dca52a2e1455486a598bcdf68d615', 'request_id': 'req-0c72e0a9-4f79-4455-9559-363739e84397'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:39.490190 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-0c72e0a9-4f79-4455-9559-363739e84397 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a50dca52a2e1455486a598bcdf68d615', 'request_id': 'req-0c72e0a9-4f79-4455-9559-363739e84397'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:39.523958 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-0c72e0a9-4f79-4455-9559-363739e84397 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a50dca52a2e1455486a598bcdf68d615', 'request_id': 'req-0c72e0a9-4f79-4455-9559-363739e84397'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:39.547445 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-0c72e0a9-4f79-4455-9559-363739e84397 admin admin] The token cache is being invalidate because project a50dca52a2e1455486a598bcdf68d615 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81808) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:57:39.547959 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-0c72e0a9-4f79-4455-9559-363739e84397 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:39.549691 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-0c72e0a9-4f79-4455-9559-363739e84397 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:39.551956 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 839/1667] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 00:57:39 2022] DELETE /identity/v3/projects/a50dca52a2e1455486a598bcdf68d615 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:57:39.556276 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c64b86-c373-4a16-938f-993f1a57b445 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:39.558637 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-b9c64b86-c373-4a16-938f-993f1a57b445 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:39.616996 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c64b86-c373-4a16-938f-993f1a57b445 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:39.841307 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4959b25a-67de-4d4c-95d4-1afa25098b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:39.842233 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959b25a-67de-4d4c-95d4-1afa25098b62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:39.842622 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959b25a-67de-4d4c-95d4-1afa25098b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:39.842985 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959b25a-67de-4d4c-95d4-1afa25098b62 admin admin] PATH_INFO: `/v3/users/8422f8d742ac4ad791d8b646fd38e8da` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:39.849205 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4959b25a-67de-4d4c-95d4-1afa25098b62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8422f8d742ac4ad791d8b646fd38e8da)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:39.851595 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4959b25a-67de-4d4c-95d4-1afa25098b62 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:39.924959 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:39.988929 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-4959b25a-67de-4d4c-95d4-1afa25098b62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8422f8d742ac4ad791d8b646fd38e8da'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:40.039905 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-4959b25a-67de-4d4c-95d4-1afa25098b62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8422f8d742ac4ad791d8b646fd38e8da'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:40.057931 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-4959b25a-67de-4d4c-95d4-1afa25098b62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8422f8d742ac4ad791d8b646fd38e8da'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:40.059436 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-4959b25a-67de-4d4c-95d4-1afa25098b62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8422f8d742ac4ad791d8b646fd38e8da'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:40.060401 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-4959b25a-67de-4d4c-95d4-1afa25098b62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8422f8d742ac4ad791d8b646fd38e8da'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:40.085818 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 829/1668] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 00:57:39 2022] DELETE /identity/v3/users/8422f8d742ac4ad791d8b646fd38e8da => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:57:40.197921 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c72e0a9-4f79-4455-9559-363739e84397 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:40.199569 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-0c72e0a9-4f79-4455-9559-363739e84397 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:40.236328 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c72e0a9-4f79-4455-9559-363739e84397 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:40.269791 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:40.418171 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3600a9dc-5de1-427b-b61f-559fde4bd086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:40.418905 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600a9dc-5de1-427b-b61f-559fde4bd086 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:40.419126 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600a9dc-5de1-427b-b61f-559fde4bd086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:40.419630 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3600a9dc-5de1-427b-b61f-559fde4bd086 admin admin] PATH_INFO: `/v3/projects/86bf22a051c44bf4aa5fda90be48ab8d` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:40.427619 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3600a9dc-5de1-427b-b61f-559fde4bd086 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86bf22a051c44bf4aa5fda90be48ab8d)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:40.440679 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3600a9dc-5de1-427b-b61f-559fde4bd086 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:40.581194 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-3600a9dc-5de1-427b-b61f-559fde4bd086 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86bf22a051c44bf4aa5fda90be48ab8d', 'request_id': 'req-3600a9dc-5de1-427b-b61f-559fde4bd086'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:40.605887 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-3600a9dc-5de1-427b-b61f-559fde4bd086 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86bf22a051c44bf4aa5fda90be48ab8d', 'request_id': 'req-3600a9dc-5de1-427b-b61f-559fde4bd086'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:40.626306 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-3600a9dc-5de1-427b-b61f-559fde4bd086 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86bf22a051c44bf4aa5fda90be48ab8d', 'request_id': 'req-3600a9dc-5de1-427b-b61f-559fde4bd086'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:40.650088 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-3600a9dc-5de1-427b-b61f-559fde4bd086 admin admin] The token cache is being invalidate because project 86bf22a051c44bf4aa5fda90be48ab8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81808) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:57:40.652021 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-3600a9dc-5de1-427b-b61f-559fde4bd086 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:40.655296 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-3600a9dc-5de1-427b-b61f-559fde4bd086 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:40.663747 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 840/1669] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 00:57:40 2022] DELETE /identity/v3/projects/86bf22a051c44bf4aa5fda90be48ab8d => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:57:40.665061 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4959b25a-67de-4d4c-95d4-1afa25098b62 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:40.667538 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-4959b25a-67de-4d4c-95d4-1afa25098b62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:40.689608 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4959b25a-67de-4d4c-95d4-1afa25098b62 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:40.902802 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cdabe1-f2c6-42ce-a7e6-832a8dfd75ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:40.903596 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cdabe1-f2c6-42ce-a7e6-832a8dfd75ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:40.904018 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cdabe1-f2c6-42ce-a7e6-832a8dfd75ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:40.904394 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cdabe1-f2c6-42ce-a7e6-832a8dfd75ac admin admin] PATH_INFO: `/v3/users/0fb3ca7010b94eb49100eccdf529ec1b` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:40.907313 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cdabe1-f2c6-42ce-a7e6-832a8dfd75ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fb3ca7010b94eb49100eccdf529ec1b)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:40.916382 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cdabe1-f2c6-42ce-a7e6-832a8dfd75ac admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:41.017764 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-03cdabe1-f2c6-42ce-a7e6-832a8dfd75ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fb3ca7010b94eb49100eccdf529ec1b'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:41.053817 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-03cdabe1-f2c6-42ce-a7e6-832a8dfd75ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fb3ca7010b94eb49100eccdf529ec1b'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:41.072499 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-03cdabe1-f2c6-42ce-a7e6-832a8dfd75ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fb3ca7010b94eb49100eccdf529ec1b'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:41.074991 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-03cdabe1-f2c6-42ce-a7e6-832a8dfd75ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fb3ca7010b94eb49100eccdf529ec1b'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:41.076357 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-03cdabe1-f2c6-42ce-a7e6-832a8dfd75ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fb3ca7010b94eb49100eccdf529ec1b'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:41.099436 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3600a9dc-5de1-427b-b61f-559fde4bd086 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:41.100667 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 830/1670] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 00:57:40 2022] DELETE /identity/v3/users/0fb3ca7010b94eb49100eccdf529ec1b => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:57:41.104180 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-3600a9dc-5de1-427b-b61f-559fde4bd086 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:41.228353 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3600a9dc-5de1-427b-b61f-559fde4bd086 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:41.352786 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c7c9d-a2c8-440e-b484-1cc7073ddc45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:41.355604 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c7c9d-a2c8-440e-b484-1cc7073ddc45 service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:41.355942 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c7c9d-a2c8-440e-b484-1cc7073ddc45 service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:41.357475 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97c7c9d-a2c8-440e-b484-1cc7073ddc45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:41.363114 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-a97c7c9d-a2c8-440e-b484-1cc7073ddc45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:41.397579 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:41.543307 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97c7c9d-a2c8-440e-b484-1cc7073ddc45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:41.544652 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97c7c9d-a2c8-440e-b484-1cc7073ddc45 service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:41.561487 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 841/1671] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:57:41 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:57:41.591714 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cdabe1-f2c6-42ce-a7e6-832a8dfd75ac admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:41.614945 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-03cdabe1-f2c6-42ce-a7e6-832a8dfd75ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:41.748958 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:41.896884 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c7c9d-a2c8-440e-b484-1cc7073ddc45 service neutron] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:41.898504 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-a97c7c9d-a2c8-440e-b484-1cc7073ddc45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:41.921509 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cdabe1-f2c6-42ce-a7e6-832a8dfd75ac admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:41.926679 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97c7c9d-a2c8-440e-b484-1cc7073ddc45 service neutron] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:41.933768 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e6a007-673d-40bc-bbc0-502ff65d88b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:41.934808 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e6a007-673d-40bc-bbc0-502ff65d88b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:41.935222 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e6a007-673d-40bc-bbc0-502ff65d88b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:41.935763 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e6a007-673d-40bc-bbc0-502ff65d88b8 admin admin] PATH_INFO: `/v3/projects/da67e4225c0d47fda1c4f2c81054156a` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:41.938608 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e6a007-673d-40bc-bbc0-502ff65d88b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da67e4225c0d47fda1c4f2c81054156a)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:41.942003 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f02c7-3368-4549-9eb0-f3d63ce0f112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:41.942686 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f02c7-3368-4549-9eb0-f3d63ce0f112 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:41.942964 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f02c7-3368-4549-9eb0-f3d63ce0f112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:41.943241 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f02c7-3368-4549-9eb0-f3d63ce0f112 admin admin] PATH_INFO: `/v3/projects/7f70316f42b2426799cce19ff21a767a` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:41.945186 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60f02c7-3368-4549-9eb0-f3d63ce0f112 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f70316f42b2426799cce19ff21a767a)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:41.946200 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e6a007-673d-40bc-bbc0-502ff65d88b8 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:41.947178 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60f02c7-3368-4549-9eb0-f3d63ce0f112 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:42.045986 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-a2e6a007-673d-40bc-bbc0-502ff65d88b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da67e4225c0d47fda1c4f2c81054156a', 'request_id': 'req-a2e6a007-673d-40bc-bbc0-502ff65d88b8'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:42.062646 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-a2e6a007-673d-40bc-bbc0-502ff65d88b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da67e4225c0d47fda1c4f2c81054156a', 'request_id': 'req-a2e6a007-673d-40bc-bbc0-502ff65d88b8'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:42.082432 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-f60f02c7-3368-4549-9eb0-f3d63ce0f112 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f70316f42b2426799cce19ff21a767a', 'request_id': 'req-f60f02c7-3368-4549-9eb0-f3d63ce0f112'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:42.086026 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-a2e6a007-673d-40bc-bbc0-502ff65d88b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da67e4225c0d47fda1c4f2c81054156a', 'request_id': 'req-a2e6a007-673d-40bc-bbc0-502ff65d88b8'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:42.092181 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-f60f02c7-3368-4549-9eb0-f3d63ce0f112 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f70316f42b2426799cce19ff21a767a', 'request_id': 'req-f60f02c7-3368-4549-9eb0-f3d63ce0f112'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:42.107851 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-f60f02c7-3368-4549-9eb0-f3d63ce0f112 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f70316f42b2426799cce19ff21a767a', 'request_id': 'req-f60f02c7-3368-4549-9eb0-f3d63ce0f112'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:42.119873 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-a2e6a007-673d-40bc-bbc0-502ff65d88b8 admin admin] The token cache is being invalidate because project da67e4225c0d47fda1c4f2c81054156a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81807) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:57:42.121096 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-a2e6a007-673d-40bc-bbc0-502ff65d88b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:42.123282 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-a2e6a007-673d-40bc-bbc0-502ff65d88b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:42.127375 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 831/1672] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 00:57:41 2022] DELETE /identity/v3/projects/da67e4225c0d47fda1c4f2c81054156a => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:57:42.134492 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b3f05d-0621-4eaf-b411-dc27b6fc4703 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:42.134779 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b3f05d-0621-4eaf-b411-dc27b6fc4703 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:42.135054 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b3f05d-0621-4eaf-b411-dc27b6fc4703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:42.154526 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-f60f02c7-3368-4549-9eb0-f3d63ce0f112 admin admin] The token cache is being invalidate because project 7f70316f42b2426799cce19ff21a767a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81808) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:57:42.154739 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-f60f02c7-3368-4549-9eb0-f3d63ce0f112 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:42.155499 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-f60f02c7-3368-4549-9eb0-f3d63ce0f112 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:42.157450 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 842/1673] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 00:57:41 2022] DELETE /identity/v3/projects/7f70316f42b2426799cce19ff21a767a => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:57:42.161576 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f02c7-3368-4549-9eb0-f3d63ce0f112 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:42.163925 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-f60f02c7-3368-4549-9eb0-f3d63ce0f112 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:42.212654 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-88b3f05d-0621-4eaf-b411-dc27b6fc4703 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:42.216226 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-88b3f05d-0621-4eaf-b411-dc27b6fc4703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:42.339396 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f02c7-3368-4549-9eb0-f3d63ce0f112 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:42.356268 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c94d1c-07df-461d-a43a-02ad7d5eb800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:42.357200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c94d1c-07df-461d-a43a-02ad7d5eb800 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:42.357655 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c94d1c-07df-461d-a43a-02ad7d5eb800 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:42.358063 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c94d1c-07df-461d-a43a-02ad7d5eb800 admin admin] PATH_INFO: `/v3/users/d9161fbdd32540de8b4eb85b1b2cd970` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:42.359905 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c94d1c-07df-461d-a43a-02ad7d5eb800 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9161fbdd32540de8b4eb85b1b2cd970)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:42.362109 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c94d1c-07df-461d-a43a-02ad7d5eb800 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:42.376128 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 832/1674] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:57:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:42.379985 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80a133-dc52-4f75-a368-8f908aa2777a None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:42.380280 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80a133-dc52-4f75-a368-8f908aa2777a None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:42.380680 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80a133-dc52-4f75-a368-8f908aa2777a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:42.431021 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-5b80a133-dc52-4f75-a368-8f908aa2777a None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:42.432537 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-5b80a133-dc52-4f75-a368-8f908aa2777a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:42.445863 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 833/1675] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:57:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:42.451004 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b80a133-dc52-4f75-a368-8f908aa2777a None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:42.477084 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:42.487730 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b80a133-dc52-4f75-a368-8f908aa2777a None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:42.498113 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ea36e-c949-477f-ae1a-f5e702b09f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:42.499870 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ea36e-c949-477f-ae1a-f5e702b09f37 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:42.500552 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ea36e-c949-477f-ae1a-f5e702b09f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:42.501054 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ea36e-c949-477f-ae1a-f5e702b09f37 admin admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:42.502300 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39ea36e-c949-477f-ae1a-f5e702b09f37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:57:42.502873 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39ea36e-c949-477f-ae1a-f5e702b09f37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:42.505285 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39ea36e-c949-477f-ae1a-f5e702b09f37 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:42.511978 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-c9c94d1c-07df-461d-a43a-02ad7d5eb800 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9161fbdd32540de8b4eb85b1b2cd970'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:42.527003 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 834/1676] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 00:57:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:57:42.531919 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-c9c94d1c-07df-461d-a43a-02ad7d5eb800 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9161fbdd32540de8b4eb85b1b2cd970'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:42.532224 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ea36e-c949-477f-ae1a-f5e702b09f37 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:42.554740 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ea36e-c949-477f-ae1a-f5e702b09f37 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:42.564722 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-c9c94d1c-07df-461d-a43a-02ad7d5eb800 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9161fbdd32540de8b4eb85b1b2cd970'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:42.566256 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-c9c94d1c-07df-461d-a43a-02ad7d5eb800 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9161fbdd32540de8b4eb85b1b2cd970'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:42.567036 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-c9c94d1c-07df-461d-a43a-02ad7d5eb800 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9161fbdd32540de8b4eb85b1b2cd970'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:42.568048 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e99822-f717-4887-942f-eaec14241f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:42.568864 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e99822-f717-4887-942f-eaec14241f1f admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:42.569300 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e99822-f717-4887-942f-eaec14241f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:42.571877 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e99822-f717-4887-942f-eaec14241f1f admin admin] PATH_INFO: `/v3/projects` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:42.572906 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e99822-f717-4887-942f-eaec14241f1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:42.578464 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e99822-f717-4887-942f-eaec14241f1f admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:42.598672 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 843/1677] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 00:57:42 2022] DELETE /identity/v3/users/d9161fbdd32540de8b4eb85b1b2cd970 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:57:42.649435 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 835/1678] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 00:57:42 2022] POST /identity/v3/projects => generated 363 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:57:42.652872 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c94d1c-07df-461d-a43a-02ad7d5eb800 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:42.654547 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-c9c94d1c-07df-461d-a43a-02ad7d5eb800 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:42.814087 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c94d1c-07df-461d-a43a-02ad7d5eb800 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:42.931260 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ec8dd-f64b-4bb8-9049-409f097af17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:42.931857 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ec8dd-f64b-4bb8-9049-409f097af17a admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:42.932138 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ec8dd-f64b-4bb8-9049-409f097af17a admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:42.932404 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ec8dd-f64b-4bb8-9049-409f097af17a admin admin] PATH_INFO: `/v3/users` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:42.933066 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15ec8dd-f64b-4bb8-9049-409f097af17a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:42.936726 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15ec8dd-f64b-4bb8-9049-409f097af17a admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:42.972976 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 844/1679] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 00:57:42 2022] POST /identity/v3/users => generated 282 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:57:42.973503 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e99822-f717-4887-942f-eaec14241f1f admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:42.988691 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e99822-f717-4887-942f-eaec14241f1f admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:42.998338 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83699b73-b5ee-43d2-bd29-f7200c189466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:42.999063 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83699b73-b5ee-43d2-bd29-f7200c189466 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:42.999345 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83699b73-b5ee-43d2-bd29-f7200c189466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:43.000275 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83699b73-b5ee-43d2-bd29-f7200c189466 admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:43.001045 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83699b73-b5ee-43d2-bd29-f7200c189466 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:43.003246 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83699b73-b5ee-43d2-bd29-f7200c189466 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:43.005202 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:43.028242 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 836/1680] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:57:43.029886 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ec8dd-f64b-4bb8-9049-409f097af17a admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:43.051727 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ec8dd-f64b-4bb8-9049-409f097af17a admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:43.064143 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df1ae12-6c4f-49c4-bf5c-8dc766ae9c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:43.065110 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1ae12-6c4f-49c4-bf5c-8dc766ae9c25 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:43.065276 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1ae12-6c4f-49c4-bf5c-8dc766ae9c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:43.065442 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1ae12-6c4f-49c4-bf5c-8dc766ae9c25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:43.066126 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df1ae12-6c4f-49c4-bf5c-8dc766ae9c25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:43.067834 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df1ae12-6c4f-49c4-bf5c-8dc766ae9c25 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:43.087733 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 845/1681] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:57:43 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:57:43.090965 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83699b73-b5ee-43d2-bd29-f7200c189466 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:43.106279 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83699b73-b5ee-43d2-bd29-f7200c189466 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:43.114393 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff21ee57-8f66-47d3-8867-a9c6f0a49d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:43.114642 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21ee57-8f66-47d3-8867-a9c6f0a49d45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:43.114920 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21ee57-8f66-47d3-8867-a9c6f0a49d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:43.115258 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21ee57-8f66-47d3-8867-a9c6f0a49d45 admin admin] PATH_INFO: `/v3/projects/7d71889ec4974803b2cb258ce8bd65f2/users/95949e9325144d52ae1ea8baf46e3369/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:43.130517 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df1ae12-6c4f-49c4-bf5c-8dc766ae9c25 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:43.133773 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-5df1ae12-6c4f-49c4-bf5c-8dc766ae9c25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:43.167392 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df1ae12-6c4f-49c4-bf5c-8dc766ae9c25 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:43.174083 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff21ee57-8f66-47d3-8867-a9c6f0a49d45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d71889ec4974803b2cb258ce8bd65f2, user_id=95949e9325144d52ae1ea8baf46e3369, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:43.178080 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff21ee57-8f66-47d3-8867-a9c6f0a49d45 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:43.192384 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541dfc17-cdc1-469f-9ab2-df971e4e31d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:43.193358 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541dfc17-cdc1-469f-9ab2-df971e4e31d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:43.193657 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541dfc17-cdc1-469f-9ab2-df971e4e31d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:43.193909 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541dfc17-cdc1-469f-9ab2-df971e4e31d1 admin admin] PATH_INFO: `/v3/projects/206d66903945403a8b90d6a6ec425bf6` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:43.195319 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541dfc17-cdc1-469f-9ab2-df971e4e31d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=206d66903945403a8b90d6a6ec425bf6)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:43.197873 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541dfc17-cdc1-469f-9ab2-df971e4e31d1 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:43.207146 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 837/1682] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 00:57:43 2022] PUT /identity/v3/projects/7d71889ec4974803b2cb258ce8bd65f2/users/95949e9325144d52ae1ea8baf46e3369/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:57:43.218892 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff21ee57-8f66-47d3-8867-a9c6f0a49d45 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:43.225635 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-ff21ee57-8f66-47d3-8867-a9c6f0a49d45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:43.297693 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:43.317843 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-541dfc17-cdc1-469f-9ab2-df971e4e31d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '206d66903945403a8b90d6a6ec425bf6', 'request_id': 'req-541dfc17-cdc1-469f-9ab2-df971e4e31d1'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:43.359067 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-541dfc17-cdc1-469f-9ab2-df971e4e31d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '206d66903945403a8b90d6a6ec425bf6', 'request_id': 'req-541dfc17-cdc1-469f-9ab2-df971e4e31d1'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:43.385351 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-541dfc17-cdc1-469f-9ab2-df971e4e31d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '206d66903945403a8b90d6a6ec425bf6', 'request_id': 'req-541dfc17-cdc1-469f-9ab2-df971e4e31d1'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:43.387108 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff21ee57-8f66-47d3-8867-a9c6f0a49d45 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:43.418494 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-541dfc17-cdc1-469f-9ab2-df971e4e31d1 admin admin] The token cache is being invalidate because project 206d66903945403a8b90d6a6ec425bf6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81808) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:57:43.419482 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-541dfc17-cdc1-469f-9ab2-df971e4e31d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:43.422696 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-541dfc17-cdc1-469f-9ab2-df971e4e31d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:43.430813 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 846/1683] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 00:57:43 2022] DELETE /identity/v3/projects/206d66903945403a8b90d6a6ec425bf6 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:57:43.433390 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662cce55-a532-49ce-b95f-875888ba46e9 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:43.433686 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662cce55-a532-49ce-b95f-875888ba46e9 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:43.433960 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662cce55-a532-49ce-b95f-875888ba46e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:43.532528 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-662cce55-a532-49ce-b95f-875888ba46e9 None None] MFA Rules not processed for user `95949e9325144d52ae1ea8baf46e3369`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:43.533848 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-662cce55-a532-49ce-b95f-875888ba46e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:43.573948 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb9a9d8-35bb-4474-a42f-5bf83424ea9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:43.580463 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb9a9d8-35bb-4474-a42f-5bf83424ea9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:43.580774 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb9a9d8-35bb-4474-a42f-5bf83424ea9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:43.581051 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb9a9d8-35bb-4474-a42f-5bf83424ea9b admin admin] PATH_INFO: `/v3/projects/28ec14506dcd41f98044db206555410e` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:43.586463 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb9a9d8-35bb-4474-a42f-5bf83424ea9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=28ec14506dcd41f98044db206555410e)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:43.588634 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb9a9d8-35bb-4474-a42f-5bf83424ea9b admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:43.730596 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 847/1684] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:57:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:43.732767 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46790ab-d60a-4fcd-b759-00f0b84e4761 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:43.733282 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46790ab-d60a-4fcd-b759-00f0b84e4761 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:43.734092 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46790ab-d60a-4fcd-b759-00f0b84e4761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:43.744903 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-7eb9a9d8-35bb-4474-a42f-5bf83424ea9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28ec14506dcd41f98044db206555410e', 'request_id': 'req-7eb9a9d8-35bb-4474-a42f-5bf83424ea9b'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:43.763752 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-7eb9a9d8-35bb-4474-a42f-5bf83424ea9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28ec14506dcd41f98044db206555410e', 'request_id': 'req-7eb9a9d8-35bb-4474-a42f-5bf83424ea9b'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:43.779042 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-7eb9a9d8-35bb-4474-a42f-5bf83424ea9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28ec14506dcd41f98044db206555410e', 'request_id': 'req-7eb9a9d8-35bb-4474-a42f-5bf83424ea9b'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:43.814251 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-e46790ab-d60a-4fcd-b759-00f0b84e4761 None None] MFA Rules not processed for user `252f0ce67ecd4772a24b32c846ff8e17`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:43.821984 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-7eb9a9d8-35bb-4474-a42f-5bf83424ea9b admin admin] The token cache is being invalidate because project 28ec14506dcd41f98044db206555410e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81807) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:57:43.823074 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-e46790ab-d60a-4fcd-b759-00f0b84e4761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:43.823651 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-7eb9a9d8-35bb-4474-a42f-5bf83424ea9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:43.825543 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-7eb9a9d8-35bb-4474-a42f-5bf83424ea9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:43.834241 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 838/1685] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 00:57:43 2022] DELETE /identity/v3/projects/28ec14506dcd41f98044db206555410e => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:57:43.836029 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f7990-1729-4e8c-b81d-8dc59d2480da None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:43.836323 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f7990-1729-4e8c-b81d-8dc59d2480da None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:43.836601 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f7990-1729-4e8c-b81d-8dc59d2480da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:43.909355 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-269f7990-1729-4e8c-b81d-8dc59d2480da None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:43.910926 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-269f7990-1729-4e8c-b81d-8dc59d2480da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:43.925504 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:44.060897 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 848/1686] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:57:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:44.062360 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46790ab-d60a-4fcd-b759-00f0b84e4761 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:44.073960 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-e46790ab-d60a-4fcd-b759-00f0b84e4761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:44.077736 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 839/1687] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:57:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:44.088911 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a3aed-0045-46c5-b70d-bac1944345a5 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:44.089542 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a3aed-0045-46c5-b70d-bac1944345a5 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:44.093367 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53a3aed-0045-46c5-b70d-bac1944345a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:44.109067 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46790ab-d60a-4fcd-b759-00f0b84e4761 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:44.121801 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f31705-0ca2-4a7d-9b5f-2624bf52956e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:44.122443 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f31705-0ca2-4a7d-9b5f-2624bf52956e admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:44.122719 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f31705-0ca2-4a7d-9b5f-2624bf52956e admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:44.122987 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f31705-0ca2-4a7d-9b5f-2624bf52956e admin admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:44.123720 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f31705-0ca2-4a7d-9b5f-2624bf52956e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:44.125799 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f31705-0ca2-4a7d-9b5f-2624bf52956e admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:44.165699 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-b53a3aed-0045-46c5-b70d-bac1944345a5 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:44.167322 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-b53a3aed-0045-46c5-b70d-bac1944345a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:44.202471 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 849/1688] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 00:57:44 2022] POST /identity/v3/projects => generated 363 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:57:44.202660 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 840/1689] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:57:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:44.204949 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0928c83-dc31-410f-bc08-478eb28a5836 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:44.205230 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0928c83-dc31-410f-bc08-478eb28a5836 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:44.205505 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0928c83-dc31-410f-bc08-478eb28a5836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:44.206250 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f31705-0ca2-4a7d-9b5f-2624bf52956e admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:44.210839 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-29f31705-0ca2-4a7d-9b5f-2624bf52956e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:44.259628 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-e0928c83-dc31-410f-bc08-478eb28a5836 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:44.263055 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-e0928c83-dc31-410f-bc08-478eb28a5836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:44.269259 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:44.366247 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f31705-0ca2-4a7d-9b5f-2624bf52956e admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:44.381857 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f6311a-8e27-4116-830e-14029078c61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:44.383044 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6311a-8e27-4116-830e-14029078c61c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:44.383913 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6311a-8e27-4116-830e-14029078c61c admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:44.384326 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6311a-8e27-4116-830e-14029078c61c admin admin] PATH_INFO: `/v3/projects/e783b8d655984258b7da22c3b111a783` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:44.390042 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f6311a-8e27-4116-830e-14029078c61c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e783b8d655984258b7da22c3b111a783)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:44.393818 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f6311a-8e27-4116-830e-14029078c61c admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:44.421994 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 841/1690] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:57:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:44.424842 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a64f0-a63a-48f8-bbea-ef56df095de1 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:44.426740 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a64f0-a63a-48f8-bbea-ef56df095de1 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:44.427371 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a64f0-a63a-48f8-bbea-ef56df095de1 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:44.431299 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 842/1691] 10.222.0.49 () {54 vars in 962 bytes} [Sun Aug 28 00:57:44 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:57:44.443161 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346a64f0-a63a-48f8-bbea-ef56df095de1 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:44.473197 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346a64f0-a63a-48f8-bbea-ef56df095de1 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:44.501082 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e73478-a381-4668-abe8-934c2042a0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:44.504687 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e73478-a381-4668-abe8-934c2042a0b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:44.504687 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e73478-a381-4668-abe8-934c2042a0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:44.504687 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e73478-a381-4668-abe8-934c2042a0b1 admin admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:44.504974 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e73478-a381-4668-abe8-934c2042a0b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:44.511640 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e73478-a381-4668-abe8-934c2042a0b1 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:44.527298 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-e0f6311a-8e27-4116-830e-14029078c61c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e783b8d655984258b7da22c3b111a783', 'request_id': 'req-e0f6311a-8e27-4116-830e-14029078c61c'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:44.542985 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-e0f6311a-8e27-4116-830e-14029078c61c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e783b8d655984258b7da22c3b111a783', 'request_id': 'req-e0f6311a-8e27-4116-830e-14029078c61c'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:44.559412 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 843/1692] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 00:57:44 2022] POST /identity/v3/users => generated 288 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:57:44.559412 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6256cf-b5a8-4a72-80ab-f7fb0a94e915 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:44.559412 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6256cf-b5a8-4a72-80ab-f7fb0a94e915 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:44.559412 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6256cf-b5a8-4a72-80ab-f7fb0a94e915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:44.560570 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-e0f6311a-8e27-4116-830e-14029078c61c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e783b8d655984258b7da22c3b111a783', 'request_id': 'req-e0f6311a-8e27-4116-830e-14029078c61c'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:44.580072 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-e0f6311a-8e27-4116-830e-14029078c61c admin admin] The token cache is being invalidate because project e783b8d655984258b7da22c3b111a783 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81808) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:57:44.580374 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-e0f6311a-8e27-4116-830e-14029078c61c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:44.581220 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-e0f6311a-8e27-4116-830e-14029078c61c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:44.584559 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-fe6256cf-b5a8-4a72-80ab-f7fb0a94e915 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:44.587109 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-fe6256cf-b5a8-4a72-80ab-f7fb0a94e915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:44.587469 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 850/1693] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 00:57:44 2022] DELETE /identity/v3/projects/e783b8d655984258b7da22c3b111a783 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:57:44.589468 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f6311a-8e27-4116-830e-14029078c61c admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:44.596573 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-e0f6311a-8e27-4116-830e-14029078c61c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:44.750320 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 844/1694] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:57:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:44.751878 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea09246-6c9e-4811-bc50-b31dffd8a464 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:44.752325 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea09246-6c9e-4811-bc50-b31dffd8a464 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:44.752788 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea09246-6c9e-4811-bc50-b31dffd8a464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:44.765007 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f6311a-8e27-4116-830e-14029078c61c admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:44.771504 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54243e01-9e52-4913-a9b2-862926ce1f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:44.772688 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54243e01-9e52-4913-a9b2-862926ce1f7a admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:44.773164 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54243e01-9e52-4913-a9b2-862926ce1f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:44.773538 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54243e01-9e52-4913-a9b2-862926ce1f7a admin admin] PATH_INFO: `/v3/domains` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:44.774543 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54243e01-9e52-4913-a9b2-862926ce1f7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:57:44.775346 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54243e01-9e52-4913-a9b2-862926ce1f7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:44.778838 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54243e01-9e52-4913-a9b2-862926ce1f7a admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:44.814458 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 851/1695] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 00:57:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:57:44.814458 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59df960-5011-4632-9cc6-7a74cb7a0bf3 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:44.814458 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59df960-5011-4632-9cc6-7a74cb7a0bf3 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:44.814798 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59df960-5011-4632-9cc6-7a74cb7a0bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:44.835703 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-4ea09246-6c9e-4811-bc50-b31dffd8a464 None None] MFA Rules not processed for user `3dc0655c8156457a8fcb006c9fe85eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:44.837548 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-4ea09246-6c9e-4811-bc50-b31dffd8a464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:44.850881 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:44.900370 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-f59df960-5011-4632-9cc6-7a74cb7a0bf3 None None] MFA Rules not processed for user `e85ff72921aa4af8a0dbc102e9cacf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:44.901731 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-f59df960-5011-4632-9cc6-7a74cb7a0bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:44.953109 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:44.965124 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 845/1696] 10.222.0.49 () {58 vars in 1059 bytes} [Sun Aug 28 00:57:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:44.966753 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70cc079-6a82-4c5d-b6ea-084638530afd None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:44.967044 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70cc079-6a82-4c5d-b6ea-084638530afd None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:44.967320 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70cc079-6a82-4c5d-b6ea-084638530afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:45.029765 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-b70cc079-6a82-4c5d-b6ea-084638530afd None None] MFA Rules not processed for user `cfec34d4145f4e188acdb2c1df19243a`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:45.030827 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 852/1697] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:57:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:45.031914 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59df960-5011-4632-9cc6-7a74cb7a0bf3 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:45.032649 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-b70cc079-6a82-4c5d-b6ea-084638530afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:45.036312 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-f59df960-5011-4632-9cc6-7a74cb7a0bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:45.067911 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59df960-5011-4632-9cc6-7a74cb7a0bf3 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:45.082191 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3310e52-1b79-4a42-81e8-cdf2f54be1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:45.083005 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3310e52-1b79-4a42-81e8-cdf2f54be1d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:45.083352 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3310e52-1b79-4a42-81e8-cdf2f54be1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:45.084002 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3310e52-1b79-4a42-81e8-cdf2f54be1d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:45.084749 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3310e52-1b79-4a42-81e8-cdf2f54be1d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:45.086477 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3310e52-1b79-4a42-81e8-cdf2f54be1d6 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:45.115435 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 853/1698] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:57:45.119174 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7342ec5-ac50-4017-9991-545aab8b777b None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:45.121168 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7342ec5-ac50-4017-9991-545aab8b777b None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:45.123231 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7342ec5-ac50-4017-9991-545aab8b777b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:45.162183 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-d7342ec5-ac50-4017-9991-545aab8b777b None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:45.165621 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-d7342ec5-ac50-4017-9991-545aab8b777b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:45.196179 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 854/1699] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:57:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:45.197810 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7342ec5-ac50-4017-9991-545aab8b777b None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:45.199867 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 846/1700] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:57:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:45.200818 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70cc079-6a82-4c5d-b6ea-084638530afd None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:45.229017 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7342ec5-ac50-4017-9991-545aab8b777b None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:45.232609 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70cc079-6a82-4c5d-b6ea-084638530afd None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:45.236740 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73238a1f-20bb-441f-a420-de26568de7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:45.238121 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73238a1f-20bb-441f-a420-de26568de7e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:45.238780 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73238a1f-20bb-441f-a420-de26568de7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:45.243887 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73238a1f-20bb-441f-a420-de26568de7e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:45.246602 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73238a1f-20bb-441f-a420-de26568de7e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:57:45.248551 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73238a1f-20bb-441f-a420-de26568de7e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:45.253727 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5854f12e-25ef-4849-96f0-84081c016145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:45.254287 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73238a1f-20bb-441f-a420-de26568de7e8 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:45.255091 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5854f12e-25ef-4849-96f0-84081c016145 admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:45.256384 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5854f12e-25ef-4849-96f0-84081c016145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:45.258455 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5854f12e-25ef-4849-96f0-84081c016145 admin admin] PATH_INFO: `/v3/projects` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:45.261546 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5854f12e-25ef-4849-96f0-84081c016145 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:45.264876 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5854f12e-25ef-4849-96f0-84081c016145 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:45.284706 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 855/1701] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 00:57:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:57:45.287127 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73238a1f-20bb-441f-a420-de26568de7e8 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:45.317718 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73238a1f-20bb-441f-a420-de26568de7e8 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:45.325331 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 847/1702] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 00:57:45 2022] POST /identity/v3/projects => generated 399 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:57:45.330164 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005f18d-f453-47bd-9563-557de43b29a9 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:45.330364 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005f18d-f453-47bd-9563-557de43b29a9 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:45.330999 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005f18d-f453-47bd-9563-557de43b29a9 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:45.337166 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 848/1703] 10.222.0.49 () {54 vars in 962 bytes} [Sun Aug 28 00:57:45 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:57:45.337687 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2005f18d-f453-47bd-9563-557de43b29a9 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:45.445684 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262f18ef-2b19-4318-89cd-81d78c11d24d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:45.447226 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f18ef-2b19-4318-89cd-81d78c11d24d service nova] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:45.448047 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f18ef-2b19-4318-89cd-81d78c11d24d service nova] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:45.448188 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f18ef-2b19-4318-89cd-81d78c11d24d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:45.450538 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-262f18ef-2b19-4318-89cd-81d78c11d24d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:45.492373 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2005f18d-f453-47bd-9563-557de43b29a9 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:45.500389 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d1136d-1191-4212-b010-4a9c34c758ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:45.501353 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1136d-1191-4212-b010-4a9c34c758ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:45.501708 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1136d-1191-4212-b010-4a9c34c758ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:45.501982 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d1136d-1191-4212-b010-4a9c34c758ec admin admin] PATH_INFO: `/v3/projects/03a84d90d7f84929b6605130455a8c47/users/ea507863dd254df5823c126e7943e535/roles/2e4889bb71f9434392c0baba59f2534e` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:45.563121 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d1136d-1191-4212-b010-4a9c34c758ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=03a84d90d7f84929b6605130455a8c47, user_id=ea507863dd254df5823c126e7943e535, role_id=2e4889bb71f9434392c0baba59f2534e)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:45.569323 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d1136d-1191-4212-b010-4a9c34c758ec admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:45.574040 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262f18ef-2b19-4318-89cd-81d78c11d24d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:45.575079 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:45.577511 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262f18ef-2b19-4318-89cd-81d78c11d24d service nova] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:45.591582 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 856/1704] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:57:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:57:45.593253 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab516a2-d82d-4af9-b9a6-c70f3927146e None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:45.593711 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab516a2-d82d-4af9-b9a6-c70f3927146e None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:45.594131 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab516a2-d82d-4af9-b9a6-c70f3927146e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:45.604350 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 849/1705] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 00:57:45 2022] PUT /identity/v3/projects/03a84d90d7f84929b6605130455a8c47/users/ea507863dd254df5823c126e7943e535/roles/2e4889bb71f9434392c0baba59f2534e => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:57:45.608036 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d1136d-1191-4212-b010-4a9c34c758ec admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:45.626847 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-1ab516a2-d82d-4af9-b9a6-c70f3927146e None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:45.629631 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-1ab516a2-d82d-4af9-b9a6-c70f3927146e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:45.726062 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:45.728820 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d1136d-1191-4212-b010-4a9c34c758ec admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:45.734442 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa306344-5e8a-4a19-8f9a-58cde3297290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:45.735075 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa306344-5e8a-4a19-8f9a-58cde3297290 admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:45.735435 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa306344-5e8a-4a19-8f9a-58cde3297290 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:45.735751 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa306344-5e8a-4a19-8f9a-58cde3297290 admin admin] PATH_INFO: `/v3/projects` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:45.736453 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa306344-5e8a-4a19-8f9a-58cde3297290 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:45.738785 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa306344-5e8a-4a19-8f9a-58cde3297290 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:45.776349 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 850/1706] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 00:57:45 2022] POST /identity/v3/projects => generated 385 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:57:45.777920 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa306344-5e8a-4a19-8f9a-58cde3297290 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:45.814906 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 857/1707] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:57:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:45.818463 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0cc17-f0dd-4eb7-b5f5-e5c6b973d4fc None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:45.821021 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0cc17-f0dd-4eb7-b5f5-e5c6b973d4fc None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:45.821453 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0cc17-f0dd-4eb7-b5f5-e5c6b973d4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:45.867221 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa306344-5e8a-4a19-8f9a-58cde3297290 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:45.873376 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab87f195-d1ce-48a0-a897-18b8eea04cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:45.874641 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87f195-d1ce-48a0-a897-18b8eea04cf0 admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:45.875060 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87f195-d1ce-48a0-a897-18b8eea04cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:45.875350 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87f195-d1ce-48a0-a897-18b8eea04cf0 admin admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:45.876074 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab87f195-d1ce-48a0-a897-18b8eea04cf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:45.878239 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab87f195-d1ce-48a0-a897-18b8eea04cf0 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:45.888671 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-14c0cc17-f0dd-4eb7-b5f5-e5c6b973d4fc None None] MFA Rules not processed for user `3dc0655c8156457a8fcb006c9fe85eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:45.898201 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-14c0cc17-f0dd-4eb7-b5f5-e5c6b973d4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:45.915144 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 851/1708] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 00:57:45 2022] POST /identity/v3/users => generated 300 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:57:45.916425 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab87f195-d1ce-48a0-a897-18b8eea04cf0 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:45.943970 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab87f195-d1ce-48a0-a897-18b8eea04cf0 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:45.957286 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020e9ccd-de32-4d70-9e85-faf446b79941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:45.957933 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e9ccd-de32-4d70-9e85-faf446b79941 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:45.958208 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e9ccd-de32-4d70-9e85-faf446b79941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:45.961390 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e9ccd-de32-4d70-9e85-faf446b79941 admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:45.964602 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020e9ccd-de32-4d70-9e85-faf446b79941 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:45.966579 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020e9ccd-de32-4d70-9e85-faf446b79941 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:46.000888 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 852/1709] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:57:46.002059 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020e9ccd-de32-4d70-9e85-faf446b79941 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:46.029524 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020e9ccd-de32-4d70-9e85-faf446b79941 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:46.043999 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b02f42-f159-46c9-b3c9-cd79383e7795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:46.045737 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b02f42-f159-46c9-b3c9-cd79383e7795 admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:46.046020 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b02f42-f159-46c9-b3c9-cd79383e7795 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:46.048542 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b02f42-f159-46c9-b3c9-cd79383e7795 admin admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:46.049284 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b02f42-f159-46c9-b3c9-cd79383e7795 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:46.055183 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b02f42-f159-46c9-b3c9-cd79383e7795 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:46.111245 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 858/1710] 10.222.0.49 () {58 vars in 1059 bytes} [Sun Aug 28 00:57:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:46.112422 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c0cc17-f0dd-4eb7-b5f5-e5c6b973d4fc None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:46.136552 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 853/1711] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 00:57:46 2022] POST /identity/v3/users => generated 293 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:57:46.140178 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b02f42-f159-46c9-b3c9-cd79383e7795 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:46.147541 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c0cc17-f0dd-4eb7-b5f5-e5c6b973d4fc None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:46.161784 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f350728-9726-4729-b4b3-27d4c681a049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:46.162455 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f350728-9726-4729-b4b3-27d4c681a049 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:46.162743 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f350728-9726-4729-b4b3-27d4c681a049 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:46.163018 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f350728-9726-4729-b4b3-27d4c681a049 admin admin] PATH_INFO: `/v3/domains` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:46.165441 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b02f42-f159-46c9-b3c9-cd79383e7795 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:46.166616 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f350728-9726-4729-b4b3-27d4c681a049 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:57:46.167657 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f350728-9726-4729-b4b3-27d4c681a049 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:46.170377 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f350728-9726-4729-b4b3-27d4c681a049 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:46.178403 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf5353-f5c9-482c-9ed5-49e692df6516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:46.182037 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf5353-f5c9-482c-9ed5-49e692df6516 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:46.182341 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf5353-f5c9-482c-9ed5-49e692df6516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:46.183128 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf5353-f5c9-482c-9ed5-49e692df6516 admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:46.183304 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bf5353-f5c9-482c-9ed5-49e692df6516 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:46.187813 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bf5353-f5c9-482c-9ed5-49e692df6516 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:46.209047 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 859/1712] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 00:57:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:57:46.209047 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f350728-9726-4729-b4b3-27d4c681a049 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:46.222183 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 854/1713] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:57:46.222773 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf5353-f5c9-482c-9ed5-49e692df6516 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:46.224991 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f350728-9726-4729-b4b3-27d4c681a049 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:46.231839 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a43d03-544d-4100-bcd2-c78be18f7b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:46.232653 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a43d03-544d-4100-bcd2-c78be18f7b35 admin admin] REQUEST_METHOD: `PUT` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:46.234003 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a43d03-544d-4100-bcd2-c78be18f7b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:46.234277 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a43d03-544d-4100-bcd2-c78be18f7b35 admin admin] PATH_INFO: `/v3/projects/03a84d90d7f84929b6605130455a8c47/users/ea507863dd254df5823c126e7943e535/roles/2e4889bb71f9434392c0baba59f2534e` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:46.240025 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a43d03-544d-4100-bcd2-c78be18f7b35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03a84d90d7f84929b6605130455a8c47, user_id=ea507863dd254df5823c126e7943e535, role_id=2e4889bb71f9434392c0baba59f2534e)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:46.242659 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a43d03-544d-4100-bcd2-c78be18f7b35 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:46.251533 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bf5353-f5c9-482c-9ed5-49e692df6516 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:46.257120 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 860/1714] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 00:57:46 2022] PUT /identity/v3/projects/03a84d90d7f84929b6605130455a8c47/users/ea507863dd254df5823c126e7943e535/roles/2e4889bb71f9434392c0baba59f2534e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:57:46.258255 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a43d03-544d-4100-bcd2-c78be18f7b35 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:46.319965 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:46.396932 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2bce7-c967-4daf-9f44-0cb59df4e38b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:46.397574 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2bce7-c967-4daf-9f44-0cb59df4e38b service nova] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:46.397854 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2bce7-c967-4daf-9f44-0cb59df4e38b service nova] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:46.398285 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2bce7-c967-4daf-9f44-0cb59df4e38b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:46.483206 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a43d03-544d-4100-bcd2-c78be18f7b35 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:46.499069 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c3d2b-d380-4fa4-b3e6-cd9b465d03c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:46.501125 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c3d2b-d380-4fa4-b3e6-cd9b465d03c5 service nova] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:46.502957 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c3d2b-d380-4fa4-b3e6-cd9b465d03c5 service nova] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:46.503337 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c3d2b-d380-4fa4-b3e6-cd9b465d03c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:46.531488 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c2bce7-c967-4daf-9f44-0cb59df4e38b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:46.535766 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c2bce7-c967-4daf-9f44-0cb59df4e38b service nova] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:46.562238 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 855/1715] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:57:46 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:57:46.569289 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317f594-2ad4-4af7-baca-791377d4abf2 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:46.570003 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317f594-2ad4-4af7-baca-791377d4abf2 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:46.570429 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317f594-2ad4-4af7-baca-791377d4abf2 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:46.572391 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 856/1716] 10.222.0.49 () {54 vars in 921 bytes} [Sun Aug 28 00:57:46 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:57:46.575206 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6317f594-2ad4-4af7-baca-791377d4abf2 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:46.621396 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:46.659385 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196c3d2b-d380-4fa4-b3e6-cd9b465d03c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:46.661235 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196c3d2b-d380-4fa4-b3e6-cd9b465d03c5 service nova] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:46.684924 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 861/1717] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:57:46 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:57:46.685856 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c3d2b-d380-4fa4-b3e6-cd9b465d03c5 service nova] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:46.782655 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6317f594-2ad4-4af7-baca-791377d4abf2 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:46.795427 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a656a5c-03e8-44cb-89f6-f47d867a193d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:46.799202 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a656a5c-03e8-44cb-89f6-f47d867a193d admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:46.799758 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a656a5c-03e8-44cb-89f6-f47d867a193d admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:46.800192 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a656a5c-03e8-44cb-89f6-f47d867a193d admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:46.803140 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a656a5c-03e8-44cb-89f6-f47d867a193d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:46.805468 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a656a5c-03e8-44cb-89f6-f47d867a193d admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:46.843423 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 857/1718] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:57:46.843423 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a656a5c-03e8-44cb-89f6-f47d867a193d admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:46.866697 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a656a5c-03e8-44cb-89f6-f47d867a193d admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:46.880571 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db1e46d-85d2-43ad-a525-1fff44d1996a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:46.881471 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db1e46d-85d2-43ad-a525-1fff44d1996a admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:46.882577 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db1e46d-85d2-43ad-a525-1fff44d1996a admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:46.882871 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db1e46d-85d2-43ad-a525-1fff44d1996a admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:46.884660 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c3d2b-d380-4fa4-b3e6-cd9b465d03c5 service nova] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:46.899498 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db1e46d-85d2-43ad-a525-1fff44d1996a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:46.899498 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db1e46d-85d2-43ad-a525-1fff44d1996a admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:46.912234 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a563cef-11a6-4d22-9d12-0ef276f21c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:46.924082 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a563cef-11a6-4d22-9d12-0ef276f21c34 admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:46.924082 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a563cef-11a6-4d22-9d12-0ef276f21c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:46.924082 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a563cef-11a6-4d22-9d12-0ef276f21c34 admin admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:46.924082 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a563cef-11a6-4d22-9d12-0ef276f21c34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:46.924082 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a563cef-11a6-4d22-9d12-0ef276f21c34 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:46.940678 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 858/1719] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:57:46.950440 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05bc6e-34e0-45c2-8ffa-102a9f163b7e None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:46.950724 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05bc6e-34e0-45c2-8ffa-102a9f163b7e None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:46.950994 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05bc6e-34e0-45c2-8ffa-102a9f163b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:47.050713 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 862/1720] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 00:57:46 2022] POST /identity/v3/projects => generated 383 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:57:47.057359 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4065e-c6f3-44ba-8725-b7a74537a3f9 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:47.062257 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4065e-c6f3-44ba-8725-b7a74537a3f9 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:47.064220 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4065e-c6f3-44ba-8725-b7a74537a3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:47.114050 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-ec05bc6e-34e0-45c2-8ffa-102a9f163b7e None None] MFA Rules not processed for user `ea507863dd254df5823c126e7943e535`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:47.116869 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-ec05bc6e-34e0-45c2-8ffa-102a9f163b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:47.182109 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-39f4065e-c6f3-44ba-8725-b7a74537a3f9 None None] MFA Rules not processed for user `8f4fc1d11f5641b0b5f301b234282aa9`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:47.191094 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-39f4065e-c6f3-44ba-8725-b7a74537a3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:47.261749 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:47.342288 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 859/1721] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:57:46 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:47.343442 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec05bc6e-34e0-45c2-8ffa-102a9f163b7e None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:47.382310 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 863/1722] 10.222.0.49 () {58 vars in 1018 bytes} [Sun Aug 28 00:57:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:47.383223 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f4065e-c6f3-44ba-8725-b7a74537a3f9 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:47.449165 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec05bc6e-34e0-45c2-8ffa-102a9f163b7e None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:47.456559 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb9bfde-17b2-4e42-916e-a8dfe27de477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:47.457810 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9bfde-17b2-4e42-916e-a8dfe27de477 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:47.458405 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9bfde-17b2-4e42-916e-a8dfe27de477 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:47.459008 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9bfde-17b2-4e42-916e-a8dfe27de477 admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:47.460737 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb9bfde-17b2-4e42-916e-a8dfe27de477 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:47.466121 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb9bfde-17b2-4e42-916e-a8dfe27de477 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:47.498655 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 860/1723] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:57:47.500050 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb9bfde-17b2-4e42-916e-a8dfe27de477 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:47.524261 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f4065e-c6f3-44ba-8725-b7a74537a3f9 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:47.525780 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb9bfde-17b2-4e42-916e-a8dfe27de477 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:47.536003 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72aac4-c78e-4ce0-8a8b-942639564795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:47.536987 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72aac4-c78e-4ce0-8a8b-942639564795 admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:47.537501 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72aac4-c78e-4ce0-8a8b-942639564795 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:47.537924 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72aac4-c78e-4ce0-8a8b-942639564795 admin admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:47.539043 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e72aac4-c78e-4ce0-8a8b-942639564795 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:47.539168 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e2388-e63a-4bcb-84d8-9a99aef9da3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:47.539883 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e2388-e63a-4bcb-84d8-9a99aef9da3f admin admin] REQUEST_METHOD: `PUT` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:47.540161 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e2388-e63a-4bcb-84d8-9a99aef9da3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:47.540442 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e2388-e63a-4bcb-84d8-9a99aef9da3f admin admin] PATH_INFO: `/v3/projects/29cfb19ef5fd40878fb458e9f16508ad/users/e216451721954177b5a7709343038ab6/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:47.543063 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e72aac4-c78e-4ce0-8a8b-942639564795 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:47.560858 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:47.580610 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814e2388-e63a-4bcb-84d8-9a99aef9da3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=29cfb19ef5fd40878fb458e9f16508ad, user_id=e216451721954177b5a7709343038ab6, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:47.583350 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814e2388-e63a-4bcb-84d8-9a99aef9da3f admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:47.613069 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 861/1724] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 00:57:47 2022] POST /identity/v3/users => generated 292 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:57:47.615255 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72aac4-c78e-4ce0-8a8b-942639564795 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:47.618414 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-0e72aac4-c78e-4ce0-8a8b-942639564795 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:47.622928 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 864/1725] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 00:57:47 2022] PUT /identity/v3/projects/29cfb19ef5fd40878fb458e9f16508ad/users/e216451721954177b5a7709343038ab6/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:57:47.624222 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e2388-e63a-4bcb-84d8-9a99aef9da3f admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:47.627915 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-814e2388-e63a-4bcb-84d8-9a99aef9da3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:47.779947 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72aac4-c78e-4ce0-8a8b-942639564795 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:47.847904 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e2388-e63a-4bcb-84d8-9a99aef9da3f admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:47.864278 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b714db1c-2ed1-4c00-9955-5473f8019480 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4fc1d11f5641b0b5f301b234282aa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:47.865160 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714db1c-2ed1-4c00-9955-5473f8019480 service placement] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:47.865421 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714db1c-2ed1-4c00-9955-5473f8019480 service placement] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:47.866780 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714db1c-2ed1-4c00-9955-5473f8019480 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:47.885984 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b714db1c-2ed1-4c00-9955-5473f8019480 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:47.889833 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b714db1c-2ed1-4c00-9955-5473f8019480 service placement] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:47.921455 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3730c0-d86b-49c8-b96b-a561a6a518a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:47.922108 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3730c0-d86b-49c8-b96b-a561a6a518a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:47.922382 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3730c0-d86b-49c8-b96b-a561a6a518a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:47.922655 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3730c0-d86b-49c8-b96b-a561a6a518a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:47.928901 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 865/1726] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:57:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:57:47.929865 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b714db1c-2ed1-4c00-9955-5473f8019480 service placement] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:48.000530 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:48.065720 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3730c0-d86b-49c8-b96b-a561a6a518a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:48.067641 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3730c0-d86b-49c8-b96b-a561a6a518a6 service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:48.082055 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 862/1727] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:57:47 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:57:48.083278 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3730c0-d86b-49c8-b96b-a561a6a518a6 service neutron] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:48.110116 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b714db1c-2ed1-4c00-9955-5473f8019480 service placement] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:48.125984 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01974bdb-88f0-46ba-be70-5c9009a8dfd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:48.126622 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01974bdb-88f0-46ba-be70-5c9009a8dfd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:48.127050 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01974bdb-88f0-46ba-be70-5c9009a8dfd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:48.127363 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01974bdb-88f0-46ba-be70-5c9009a8dfd7 admin admin] PATH_INFO: `/v3/projects/5dcd90e3c572497e881b08f0b05f9978/users/dedb760c69aa49d8b878b9bb3a5d53e8/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:48.163175 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3730c0-d86b-49c8-b96b-a561a6a518a6 service neutron] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:48.169032 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a75da7b-6db4-46b7-85f8-5ffce9a06555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:48.169142 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01974bdb-88f0-46ba-be70-5c9009a8dfd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dcd90e3c572497e881b08f0b05f9978, user_id=dedb760c69aa49d8b878b9bb3a5d53e8, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:48.169449 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75da7b-6db4-46b7-85f8-5ffce9a06555 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:48.169728 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75da7b-6db4-46b7-85f8-5ffce9a06555 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:48.170000 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a75da7b-6db4-46b7-85f8-5ffce9a06555 admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:48.170883 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a75da7b-6db4-46b7-85f8-5ffce9a06555 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:48.171999 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01974bdb-88f0-46ba-be70-5c9009a8dfd7 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:48.172551 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a75da7b-6db4-46b7-85f8-5ffce9a06555 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:48.207238 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 863/1729] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:57:48 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:57:48.208821 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384146a4-c4ec-4fb9-ab7b-e709f3f87618 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:48.209114 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384146a4-c4ec-4fb9-ab7b-e709f3f87618 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:48.210095 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384146a4-c4ec-4fb9-ab7b-e709f3f87618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:48.210845 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 866/1729] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 00:57:47 2022] PUT /identity/v3/projects/5dcd90e3c572497e881b08f0b05f9978/users/dedb760c69aa49d8b878b9bb3a5d53e8/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:57:48.213293 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01974bdb-88f0-46ba-be70-5c9009a8dfd7 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:48.256528 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-384146a4-c4ec-4fb9-ab7b-e709f3f87618 None None] MFA Rules not processed for user `e216451721954177b5a7709343038ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:48.257865 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-384146a4-c4ec-4fb9-ab7b-e709f3f87618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:48.361107 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 864/1730] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:57:48 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:48.362824 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed926bd7-162a-4862-971e-694633268c8d None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:48.363228 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed926bd7-162a-4862-971e-694633268c8d None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:48.363656 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed926bd7-162a-4862-971e-694633268c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:48.377031 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01974bdb-88f0-46ba-be70-5c9009a8dfd7 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:48.392691 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1bba00-f4ed-4ad4-ba09-8c79d4548ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:48.393426 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1bba00-f4ed-4ad4-ba09-8c79d4548ddb admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:48.393703 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1bba00-f4ed-4ad4-ba09-8c79d4548ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:48.394393 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1bba00-f4ed-4ad4-ba09-8c79d4548ddb admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:48.395315 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1bba00-f4ed-4ad4-ba09-8c79d4548ddb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:48.397248 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1bba00-f4ed-4ad4-ba09-8c79d4548ddb admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:48.402760 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:48.425384 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-ed926bd7-162a-4862-971e-694633268c8d None None] MFA Rules not processed for user `dedb760c69aa49d8b878b9bb3a5d53e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:48.427272 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 867/1731] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:57:48 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:57:48.428167 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1bba00-f4ed-4ad4-ba09-8c79d4548ddb admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:48.432952 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-ed926bd7-162a-4862-971e-694633268c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:48.446301 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1bba00-f4ed-4ad4-ba09-8c79d4548ddb admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:48.466525 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3690dc88-999f-4aad-b25a-9aba2b3f0317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:48.467739 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690dc88-999f-4aad-b25a-9aba2b3f0317 admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:48.468096 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690dc88-999f-4aad-b25a-9aba2b3f0317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:48.468442 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690dc88-999f-4aad-b25a-9aba2b3f0317 admin admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:48.469572 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3690dc88-999f-4aad-b25a-9aba2b3f0317 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:48.473453 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3690dc88-999f-4aad-b25a-9aba2b3f0317 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:48.547042 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 868/1732] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 00:57:48 2022] POST /identity/v3/projects => generated 399 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:57:48.548015 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:48.549305 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3690dc88-999f-4aad-b25a-9aba2b3f0317 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:48.634311 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 865/1733] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:57:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:48.637894 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed926bd7-162a-4862-971e-694633268c8d None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:48.692599 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed926bd7-162a-4862-971e-694633268c8d None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:48.764200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3690dc88-999f-4aad-b25a-9aba2b3f0317 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:48.771875 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a9db12-8168-4c48-95b6-5fb2e04e5b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:48.774502 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a9db12-8168-4c48-95b6-5fb2e04e5b67 admin admin] REQUEST_METHOD: `PUT` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:48.774928 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a9db12-8168-4c48-95b6-5fb2e04e5b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:48.775279 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a9db12-8168-4c48-95b6-5fb2e04e5b67 admin admin] PATH_INFO: `/v3/projects/bfdde7f2f0f34d55a1439ecb884a5c4c/users/036e2cc309c4482ab9d1ea38574e1951/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:48.829396 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a9db12-8168-4c48-95b6-5fb2e04e5b67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfdde7f2f0f34d55a1439ecb884a5c4c, user_id=036e2cc309c4482ab9d1ea38574e1951, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:48.833418 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a9db12-8168-4c48-95b6-5fb2e04e5b67 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:48.879716 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 869/1734] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 00:57:48 2022] PUT /identity/v3/projects/bfdde7f2f0f34d55a1439ecb884a5c4c/users/036e2cc309c4482ab9d1ea38574e1951/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:57:48.887632 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a9db12-8168-4c48-95b6-5fb2e04e5b67 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:48.936665 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e61861-d988-427c-a73e-aac9a1e567de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:48.937603 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e61861-d988-427c-a73e-aac9a1e567de admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:48.937603 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e61861-d988-427c-a73e-aac9a1e567de admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:48.937883 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e61861-d988-427c-a73e-aac9a1e567de admin admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:48.938738 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e61861-d988-427c-a73e-aac9a1e567de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:48.948613 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e61861-d988-427c-a73e-aac9a1e567de admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:48.994656 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 866/1735] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 00:57:48 2022] POST /identity/v3/users => generated 306 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:57:48.996012 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2419dd7-2458-4452-8b27-24df7f6659d7 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:48.996215 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2419dd7-2458-4452-8b27-24df7f6659d7 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:48.996365 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2419dd7-2458-4452-8b27-24df7f6659d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:49.090253 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-f2419dd7-2458-4452-8b27-24df7f6659d7 None None] MFA Rules not processed for user `036e2cc309c4482ab9d1ea38574e1951`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:49.092861 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-f2419dd7-2458-4452-8b27-24df7f6659d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:49.273507 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a9db12-8168-4c48-95b6-5fb2e04e5b67 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:49.306792 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78756c69-db0e-4b9b-806c-30f51af0e455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:49.308442 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78756c69-db0e-4b9b-806c-30f51af0e455 admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:49.308738 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78756c69-db0e-4b9b-806c-30f51af0e455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:49.309540 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78756c69-db0e-4b9b-806c-30f51af0e455 admin admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:49.310183 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78756c69-db0e-4b9b-806c-30f51af0e455 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:49.319223 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78756c69-db0e-4b9b-806c-30f51af0e455 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:49.398273 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 867/1736] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:57:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:49.401459 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2419dd7-2458-4452-8b27-24df7f6659d7 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:49.418409 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 870/1737] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 00:57:48 2022] POST /identity/v3/projects => generated 383 bytes in 532 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:57:49.423238 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78756c69-db0e-4b9b-806c-30f51af0e455 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:49.444687 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2419dd7-2458-4452-8b27-24df7f6659d7 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:49.538962 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:49.575529 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:49.580272 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78756c69-db0e-4b9b-806c-30f51af0e455 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:49.584892 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd62fe-3b05-426f-8f7c-92b18eb64482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:49.585788 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd62fe-3b05-426f-8f7c-92b18eb64482 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:49.586629 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd62fe-3b05-426f-8f7c-92b18eb64482 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:49.587407 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd62fe-3b05-426f-8f7c-92b18eb64482 admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:49.588467 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bd62fe-3b05-426f-8f7c-92b18eb64482 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:49.591356 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bd62fe-3b05-426f-8f7c-92b18eb64482 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:49.592177 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8485a88-f7a9-4f00-a8f1-c5b846dca361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:49.592873 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8485a88-f7a9-4f00-a8f1-c5b846dca361 admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:49.593148 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8485a88-f7a9-4f00-a8f1-c5b846dca361 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:49.593414 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8485a88-f7a9-4f00-a8f1-c5b846dca361 admin admin] PATH_INFO: `/v3/users` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:49.595346 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8485a88-f7a9-4f00-a8f1-c5b846dca361 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:49.597900 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8485a88-f7a9-4f00-a8f1-c5b846dca361 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:49.617900 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 868/1738] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:57:49.617900 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd62fe-3b05-426f-8f7c-92b18eb64482 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:49.653992 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 871/1739] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 00:57:49 2022] POST /identity/v3/users => generated 298 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:57:49.656851 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8485a88-f7a9-4f00-a8f1-c5b846dca361 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:49.701091 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8485a88-f7a9-4f00-a8f1-c5b846dca361 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:49.737312 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b874446f-f351-42e6-be48-1360dfed8b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:49.738502 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b874446f-f351-42e6-be48-1360dfed8b47 admin admin] REQUEST_METHOD: `PUT` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:49.738990 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b874446f-f351-42e6-be48-1360dfed8b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:49.739469 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b874446f-f351-42e6-be48-1360dfed8b47 admin admin] PATH_INFO: `/v3/projects/fca1e147c1dd40118cc92661bcfe1027/users/2a4a67eb18b143fb8b36c18282ba19b8/roles/2e4889bb71f9434392c0baba59f2534e` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:49.796929 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b874446f-f351-42e6-be48-1360dfed8b47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fca1e147c1dd40118cc92661bcfe1027, user_id=2a4a67eb18b143fb8b36c18282ba19b8, role_id=2e4889bb71f9434392c0baba59f2534e)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:49.805559 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b874446f-f351-42e6-be48-1360dfed8b47 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:49.852054 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd62fe-3b05-426f-8f7c-92b18eb64482 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:49.855493 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 872/1740] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 00:57:49 2022] PUT /identity/v3/projects/fca1e147c1dd40118cc92661bcfe1027/users/2a4a67eb18b143fb8b36c18282ba19b8/roles/2e4889bb71f9434392c0baba59f2534e => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:57:49.856189 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b874446f-f351-42e6-be48-1360dfed8b47 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:50.006286 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a020d-7155-4dcb-aa3b-4ab09d6e65ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:50.007234 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a020d-7155-4dcb-aa3b-4ab09d6e65ca service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:50.009497 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a020d-7155-4dcb-aa3b-4ab09d6e65ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:50.009910 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a020d-7155-4dcb-aa3b-4ab09d6e65ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:50.037120 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b874446f-f351-42e6-be48-1360dfed8b47 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:50.053417 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9b1b52-c2d8-4d4a-a51c-ddfa53164009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:50.054751 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b1b52-c2d8-4d4a-a51c-ddfa53164009 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:50.055038 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b1b52-c2d8-4d4a-a51c-ddfa53164009 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:50.055312 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b1b52-c2d8-4d4a-a51c-ddfa53164009 admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:50.056111 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9b1b52-c2d8-4d4a-a51c-ddfa53164009 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:50.060120 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9b1b52-c2d8-4d4a-a51c-ddfa53164009 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:50.089621 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 873/1741] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:57:50.089881 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9b1b52-c2d8-4d4a-a51c-ddfa53164009 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:50.114820 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9b1b52-c2d8-4d4a-a51c-ddfa53164009 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:50.127416 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2364093c-99bf-4b2d-bc4f-9e428e4b9b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:50.128121 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2364093c-99bf-4b2d-bc4f-9e428e4b9b7d admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:50.128408 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2364093c-99bf-4b2d-bc4f-9e428e4b9b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:50.128677 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2364093c-99bf-4b2d-bc4f-9e428e4b9b7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:50.129375 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2364093c-99bf-4b2d-bc4f-9e428e4b9b7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:50.131041 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2364093c-99bf-4b2d-bc4f-9e428e4b9b7d admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:50.150500 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448a020d-7155-4dcb-aa3b-4ab09d6e65ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:50.152107 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448a020d-7155-4dcb-aa3b-4ab09d6e65ca service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:50.161382 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 874/1742] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:57:50.162518 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2364093c-99bf-4b2d-bc4f-9e428e4b9b7d admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:50.168786 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-2364093c-99bf-4b2d-bc4f-9e428e4b9b7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:50.187169 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 869/1743] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:57:49 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:57:50.188711 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a020d-7155-4dcb-aa3b-4ab09d6e65ca service neutron] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:50.203549 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2364093c-99bf-4b2d-bc4f-9e428e4b9b7d admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:50.210479 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a020d-7155-4dcb-aa3b-4ab09d6e65ca service neutron] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:50.214887 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab2809-5d77-408a-bd9d-a01807099c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:50.215598 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab2809-5d77-408a-bd9d-a01807099c49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:50.215926 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab2809-5d77-408a-bd9d-a01807099c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:50.216133 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab2809-5d77-408a-bd9d-a01807099c49 admin admin] PATH_INFO: `/v3/users/ed8fdd85be1e499e90843147bd931ae7` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:50.218220 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dab2809-5d77-408a-bd9d-a01807099c49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed8fdd85be1e499e90843147bd931ae7)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:50.221548 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dab2809-5d77-408a-bd9d-a01807099c49 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:50.228064 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf821d3f-bf73-4764-a4ef-0f10d80b9f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:50.229376 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf821d3f-bf73-4764-a4ef-0f10d80b9f4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:50.229874 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf821d3f-bf73-4764-a4ef-0f10d80b9f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:50.230379 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf821d3f-bf73-4764-a4ef-0f10d80b9f4a admin admin] PATH_INFO: `/v3/projects/f8e0351ffc6f49a18dcb93bade12788b/users/2a5d4aca8e0e497181c3c908afb92d32/roles/2e4889bb71f9434392c0baba59f2534e` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:50.273645 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf821d3f-bf73-4764-a4ef-0f10d80b9f4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8e0351ffc6f49a18dcb93bade12788b, user_id=2a5d4aca8e0e497181c3c908afb92d32, role_id=2e4889bb71f9434392c0baba59f2534e)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:50.280100 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf821d3f-bf73-4764-a4ef-0f10d80b9f4a admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:50.320955 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 870/1744] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 00:57:50 2022] PUT /identity/v3/projects/f8e0351ffc6f49a18dcb93bade12788b/users/2a5d4aca8e0e497181c3c908afb92d32/roles/2e4889bb71f9434392c0baba59f2534e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:57:50.321971 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf821d3f-bf73-4764-a4ef-0f10d80b9f4a admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:50.430544 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-3dab2809-5d77-408a-bd9d-a01807099c49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed8fdd85be1e499e90843147bd931ae7'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:50.456533 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:50.461265 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-3dab2809-5d77-408a-bd9d-a01807099c49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed8fdd85be1e499e90843147bd931ae7'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:50.497811 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf821d3f-bf73-4764-a4ef-0f10d80b9f4a admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:50.503417 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-3dab2809-5d77-408a-bd9d-a01807099c49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed8fdd85be1e499e90843147bd931ae7'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:50.504370 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-3dab2809-5d77-408a-bd9d-a01807099c49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed8fdd85be1e499e90843147bd931ae7'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:50.505050 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-3dab2809-5d77-408a-bd9d-a01807099c49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed8fdd85be1e499e90843147bd931ae7'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:50.506800 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c0110-621c-40c7-9a5b-49ce2d420ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:50.507573 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c0110-621c-40c7-9a5b-49ce2d420ac6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:50.507889 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c0110-621c-40c7-9a5b-49ce2d420ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:50.508159 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c0110-621c-40c7-9a5b-49ce2d420ac6 admin admin] PATH_INFO: `/v3/projects/fca1e147c1dd40118cc92661bcfe1027/users/2a4a67eb18b143fb8b36c18282ba19b8/roles/2e4889bb71f9434392c0baba59f2534e` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:50.514996 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7c0110-621c-40c7-9a5b-49ce2d420ac6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fca1e147c1dd40118cc92661bcfe1027, user_id=2a4a67eb18b143fb8b36c18282ba19b8, role_id=2e4889bb71f9434392c0baba59f2534e)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:50.521437 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7c0110-621c-40c7-9a5b-49ce2d420ac6 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:50.536301 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 875/1745] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 00:57:50 2022] DELETE /identity/v3/users/ed8fdd85be1e499e90843147bd931ae7 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:57:50.537522 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab2809-5d77-408a-bd9d-a01807099c49 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:50.540221 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-3dab2809-5d77-408a-bd9d-a01807099c49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:50.549291 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:50.588212 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 871/1746] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 00:57:50 2022] PUT /identity/v3/projects/fca1e147c1dd40118cc92661bcfe1027/users/2a4a67eb18b143fb8b36c18282ba19b8/roles/2e4889bb71f9434392c0baba59f2534e => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:57:50.598571 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d44d39e-5102-4fe6-982f-a02fd2d27bbb None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:50.598855 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d44d39e-5102-4fe6-982f-a02fd2d27bbb None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:50.599198 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d44d39e-5102-4fe6-982f-a02fd2d27bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:50.652980 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-8d44d39e-5102-4fe6-982f-a02fd2d27bbb None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:50.654308 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-8d44d39e-5102-4fe6-982f-a02fd2d27bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:50.654657 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab2809-5d77-408a-bd9d-a01807099c49 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:50.767781 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d0b0da-47d1-45f4-b123-9b2a45e91462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:50.768451 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0b0da-47d1-45f4-b123-9b2a45e91462 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:50.768794 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0b0da-47d1-45f4-b123-9b2a45e91462 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:50.769134 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0b0da-47d1-45f4-b123-9b2a45e91462 admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:50.770407 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d0b0da-47d1-45f4-b123-9b2a45e91462 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:50.777420 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d0b0da-47d1-45f4-b123-9b2a45e91462 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:50.807552 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 876/1747] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:57:50.807552 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c35298-5545-4f20-8aff-3ddbea751415 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:50.807552 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c35298-5545-4f20-8aff-3ddbea751415 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:50.807552 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c35298-5545-4f20-8aff-3ddbea751415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:50.813247 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 872/1748] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:57:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:50.814155 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d44d39e-5102-4fe6-982f-a02fd2d27bbb None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:50.839652 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d44d39e-5102-4fe6-982f-a02fd2d27bbb None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:50.857082 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eab3241-dfe2-4443-9543-989724ba5d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:50.857794 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab3241-dfe2-4443-9543-989724ba5d64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:50.858074 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab3241-dfe2-4443-9543-989724ba5d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:50.858348 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab3241-dfe2-4443-9543-989724ba5d64 admin admin] PATH_INFO: `/v3/projects/f8e0351ffc6f49a18dcb93bade12788b/users/2a5d4aca8e0e497181c3c908afb92d32/roles/2e4889bb71f9434392c0baba59f2534e` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:50.864721 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eab3241-dfe2-4443-9543-989724ba5d64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8e0351ffc6f49a18dcb93bade12788b, user_id=2a5d4aca8e0e497181c3c908afb92d32, role_id=2e4889bb71f9434392c0baba59f2534e)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:50.868626 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eab3241-dfe2-4443-9543-989724ba5d64 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:50.874607 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-96c35298-5545-4f20-8aff-3ddbea751415 None None] MFA Rules not processed for user `2a4a67eb18b143fb8b36c18282ba19b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:50.877627 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-96c35298-5545-4f20-8aff-3ddbea751415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:50.898931 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 873/1749] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 00:57:50 2022] PUT /identity/v3/projects/f8e0351ffc6f49a18dcb93bade12788b/users/2a5d4aca8e0e497181c3c908afb92d32/roles/2e4889bb71f9434392c0baba59f2534e => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:57:50.899947 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eab3241-dfe2-4443-9543-989724ba5d64 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:50.903606 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-2eab3241-dfe2-4443-9543-989724ba5d64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:51.066492 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eab3241-dfe2-4443-9543-989724ba5d64 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:51.068835 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 877/1750] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:57:50 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:51.071998 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675fbf2-fb76-4eff-afc1-5fa34622b002 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:51.072708 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675fbf2-fb76-4eff-afc1-5fa34622b002 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:51.073177 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675fbf2-fb76-4eff-afc1-5fa34622b002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:51.074298 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3236fc71-4abb-46f4-b079-8a98f5af685b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:51.075267 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236fc71-4abb-46f4-b079-8a98f5af685b service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:51.075956 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236fc71-4abb-46f4-b079-8a98f5af685b service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:51.080089 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236fc71-4abb-46f4-b079-8a98f5af685b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:51.128880 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-7675fbf2-fb76-4eff-afc1-5fa34622b002 None None] MFA Rules not processed for user `2a5d4aca8e0e497181c3c908afb92d32`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:51.131006 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-7675fbf2-fb76-4eff-afc1-5fa34622b002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:51.173104 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:51.249903 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3236fc71-4abb-46f4-b079-8a98f5af685b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:51.252620 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3236fc71-4abb-46f4-b079-8a98f5af685b service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:51.268342 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 874/1751] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:57:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:57:51.270377 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3236fc71-4abb-46f4-b079-8a98f5af685b service neutron] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:51.271994 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-3236fc71-4abb-46f4-b079-8a98f5af685b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:51.287124 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3236fc71-4abb-46f4-b079-8a98f5af685b service neutron] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:51.296614 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d310a2-cc3c-4c1d-a4a0-35fa9473e5d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:51.296852 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 878/1752] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:57:51 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:51.296936 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d310a2-cc3c-4c1d-a4a0-35fa9473e5d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:51.296936 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d310a2-cc3c-4c1d-a4a0-35fa9473e5d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:51.296936 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d310a2-cc3c-4c1d-a4a0-35fa9473e5d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:51.297123 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82be7d3-56fa-4526-b186-5763a4e76117 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:51.297123 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82be7d3-56fa-4526-b186-5763a4e76117 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:51.297123 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82be7d3-56fa-4526-b186-5763a4e76117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:51.297312 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-53d310a2-cc3c-4c1d-a4a0-35fa9473e5d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:51.313789 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:51.326117 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-d82be7d3-56fa-4526-b186-5763a4e76117 None None] MFA Rules not processed for user `252f0ce67ecd4772a24b32c846ff8e17`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:51.327874 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-d82be7d3-56fa-4526-b186-5763a4e76117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:51.402126 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d310a2-cc3c-4c1d-a4a0-35fa9473e5d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:51.404482 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d310a2-cc3c-4c1d-a4a0-35fa9473e5d6 service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:51.431580 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 875/1753] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:57:51 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:57:51.433205 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d310a2-cc3c-4c1d-a4a0-35fa9473e5d6 service neutron] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:51.435313 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 879/1754] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:57:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:51.451019 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d310a2-cc3c-4c1d-a4a0-35fa9473e5d6 service neutron] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:51.461913 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dfea60-0262-44a0-bd18-b42408a0996e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:51.462658 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dfea60-0262-44a0-bd18-b42408a0996e service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:51.463032 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dfea60-0262-44a0-bd18-b42408a0996e service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:51.463190 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dfea60-0262-44a0-bd18-b42408a0996e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:51.483339 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dfea60-0262-44a0-bd18-b42408a0996e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:51.485513 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dfea60-0262-44a0-bd18-b42408a0996e service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:51.497680 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 876/1755] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:57:51 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:57:51.582112 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903dbf6b-f946-4e9e-bbe0-fe35e5cbeb00 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:51.582437 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903dbf6b-f946-4e9e-bbe0-fe35e5cbeb00 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:51.582658 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903dbf6b-f946-4e9e-bbe0-fe35e5cbeb00 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:51.588634 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 880/1756] 10.222.0.49 () {54 vars in 912 bytes} [Sun Aug 28 00:57:51 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:57:51.606526 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452bf36-c173-44c7-8307-ced5d83df67f None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:51.606885 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452bf36-c173-44c7-8307-ced5d83df67f None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:51.608266 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452bf36-c173-44c7-8307-ced5d83df67f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:51.645279 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-1452bf36-c173-44c7-8307-ced5d83df67f None None] MFA Rules not processed for user `3dc0655c8156457a8fcb006c9fe85eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:51.646828 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-1452bf36-c173-44c7-8307-ced5d83df67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:51.823909 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 877/1757] 10.222.0.49 () {58 vars in 1009 bytes} [Sun Aug 28 00:57:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:51.850757 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903dbf6b-f946-4e9e-bbe0-fe35e5cbeb00 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:51.854723 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-903dbf6b-f946-4e9e-bbe0-fe35e5cbeb00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:52.030878 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903dbf6b-f946-4e9e-bbe0-fe35e5cbeb00 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:52.037432 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e6a7d8-5d2e-46ab-9236-93d7377f50d9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22053bd9632346aab63814f740415f69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:52.038764 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6a7d8-5d2e-46ab-9236-93d7377f50d9 service glance] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:52.039288 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6a7d8-5d2e-46ab-9236-93d7377f50d9 service glance] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:52.039799 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e6a7d8-5d2e-46ab-9236-93d7377f50d9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:52.059584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e6a7d8-5d2e-46ab-9236-93d7377f50d9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:52.061616 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e6a7d8-5d2e-46ab-9236-93d7377f50d9 service glance] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:52.108663 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 881/1758] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:57:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 00:57:52.373680 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1452bf36-c173-44c7-8307-ced5d83df67f None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:52.375370 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-1452bf36-c173-44c7-8307-ced5d83df67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:52.408398 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1452bf36-c173-44c7-8307-ced5d83df67f None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:52.422088 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05641e4-3f0c-4a72-a5a8-99ce7c1dfaf8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:52.422832 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05641e4-3f0c-4a72-a5a8-99ce7c1dfaf8 service nova] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:52.423289 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05641e4-3f0c-4a72-a5a8-99ce7c1dfaf8 service nova] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:52.423658 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05641e4-3f0c-4a72-a5a8-99ce7c1dfaf8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:52.589660 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05641e4-3f0c-4a72-a5a8-99ce7c1dfaf8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:52.597519 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05641e4-3f0c-4a72-a5a8-99ce7c1dfaf8 service nova] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:52.621989 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 878/1759] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:57:52 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:57:53.058514 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e6a7d8-5d2e-46ab-9236-93d7377f50d9 service glance] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:53.061299 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-56e6a7d8-5d2e-46ab-9236-93d7377f50d9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:53.085663 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e6a7d8-5d2e-46ab-9236-93d7377f50d9 service glance] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:53.094295 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a535a4-5f19-41dd-bf18-677cfee4a34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:53.095388 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a535a4-5f19-41dd-bf18-677cfee4a34e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:53.095867 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a535a4-5f19-41dd-bf18-677cfee4a34e admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:53.096350 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a535a4-5f19-41dd-bf18-677cfee4a34e admin admin] PATH_INFO: `/v3/projects/bb63a3136589450c9d45ff6b48e9276a` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:53.097892 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a535a4-5f19-41dd-bf18-677cfee4a34e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb63a3136589450c9d45ff6b48e9276a)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:53.100375 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a535a4-5f19-41dd-bf18-677cfee4a34e admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:53.158245 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:53.169443 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-74a535a4-5f19-41dd-bf18-677cfee4a34e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb63a3136589450c9d45ff6b48e9276a', 'request_id': 'req-74a535a4-5f19-41dd-bf18-677cfee4a34e'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:53.182758 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-74a535a4-5f19-41dd-bf18-677cfee4a34e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb63a3136589450c9d45ff6b48e9276a', 'request_id': 'req-74a535a4-5f19-41dd-bf18-677cfee4a34e'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:53.194577 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-74a535a4-5f19-41dd-bf18-677cfee4a34e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb63a3136589450c9d45ff6b48e9276a', 'request_id': 'req-74a535a4-5f19-41dd-bf18-677cfee4a34e'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:53.224411 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-74a535a4-5f19-41dd-bf18-677cfee4a34e admin admin] The token cache is being invalidate because project bb63a3136589450c9d45ff6b48e9276a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81808) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:57:53.225174 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-74a535a4-5f19-41dd-bf18-677cfee4a34e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:53.227151 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-74a535a4-5f19-41dd-bf18-677cfee4a34e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:53.230502 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 882/1760] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 00:57:53 2022] DELETE /identity/v3/projects/bb63a3136589450c9d45ff6b48e9276a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:57:53.235868 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05641e4-3f0c-4a72-a5a8-99ce7c1dfaf8 service nova] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:53.261735 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05641e4-3f0c-4a72-a5a8-99ce7c1dfaf8 service nova] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:53.292083 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:53.372779 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a59165-7a9f-4c75-8592-7ff2f8d144c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:53.373493 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a59165-7a9f-4c75-8592-7ff2f8d144c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:53.374328 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a59165-7a9f-4c75-8592-7ff2f8d144c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:53.374609 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a59165-7a9f-4c75-8592-7ff2f8d144c2 admin admin] PATH_INFO: `/v3/users/531d2f0b04fd48b2a12829e67c20d4f6` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:53.376088 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a59165-7a9f-4c75-8592-7ff2f8d144c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=531d2f0b04fd48b2a12829e67c20d4f6)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:53.378736 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a59165-7a9f-4c75-8592-7ff2f8d144c2 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:53.429742 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf043c8-1a93-4f1d-a564-64d40c85dc73 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:53.430476 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf043c8-1a93-4f1d-a564-64d40c85dc73 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:53.430964 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf043c8-1a93-4f1d-a564-64d40c85dc73 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:53.433010 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 883/1761] 10.222.0.49 () {54 vars in 912 bytes} [Sun Aug 28 00:57:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:57:53.440630 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d535c-0608-4823-8db0-7c53f6f7103c None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:53.441199 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d535c-0608-4823-8db0-7c53f6f7103c None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:53.441635 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79d535c-0608-4823-8db0-7c53f6f7103c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:53.477708 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-81a59165-7a9f-4c75-8592-7ff2f8d144c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '531d2f0b04fd48b2a12829e67c20d4f6'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:53.514001 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-81a59165-7a9f-4c75-8592-7ff2f8d144c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '531d2f0b04fd48b2a12829e67c20d4f6'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:53.533999 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-81a59165-7a9f-4c75-8592-7ff2f8d144c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '531d2f0b04fd48b2a12829e67c20d4f6'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:53.535154 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-81a59165-7a9f-4c75-8592-7ff2f8d144c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '531d2f0b04fd48b2a12829e67c20d4f6'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:53.536384 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-81a59165-7a9f-4c75-8592-7ff2f8d144c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '531d2f0b04fd48b2a12829e67c20d4f6'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:53.547037 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-c79d535c-0608-4823-8db0-7c53f6f7103c None None] MFA Rules not processed for user `2d14dcd0cb25427291ab8831924184e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:53.550588 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-c79d535c-0608-4823-8db0-7c53f6f7103c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:53.582028 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 879/1762] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 00:57:53 2022] DELETE /identity/v3/users/531d2f0b04fd48b2a12829e67c20d4f6 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:57:53.691064 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 884/1763] 10.222.0.49 () {58 vars in 1009 bytes} [Sun Aug 28 00:57:53 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:53.730407 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a59165-7a9f-4c75-8592-7ff2f8d144c2 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:53.732017 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-81a59165-7a9f-4c75-8592-7ff2f8d144c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:53.879648 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a59165-7a9f-4c75-8592-7ff2f8d144c2 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:53.885768 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75b2350-aefa-45c4-a703-9139980acfc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:53.887610 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b2350-aefa-45c4-a703-9139980acfc0 service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:53.888130 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b2350-aefa-45c4-a703-9139980acfc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:53.888625 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b2350-aefa-45c4-a703-9139980acfc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:53.908737 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75b2350-aefa-45c4-a703-9139980acfc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:53.910639 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75b2350-aefa-45c4-a703-9139980acfc0 service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:53.932788 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 880/1764] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:57:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:57:54.729622 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d535c-0608-4823-8db0-7c53f6f7103c None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:54.755111 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79d535c-0608-4823-8db0-7c53f6f7103c None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:54.761822 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9d1847-6c83-466d-ab65-776e6fdaf839 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:54.762529 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d1847-6c83-466d-ab65-776e6fdaf839 service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:54.762958 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d1847-6c83-466d-ab65-776e6fdaf839 service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:54.763328 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d1847-6c83-466d-ab65-776e6fdaf839 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:54.766575 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-aa9d1847-6c83-466d-ab65-776e6fdaf839 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:54.786697 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efa63f-fd04-4e3e-8caf-8d6c182c7fbc None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:54.787393 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efa63f-fd04-4e3e-8caf-8d6c182c7fbc None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:54.787796 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efa63f-fd04-4e3e-8caf-8d6c182c7fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:54.827278 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-56efa63f-fd04-4e3e-8caf-8d6c182c7fbc None None] MFA Rules not processed for user `e85ff72921aa4af8a0dbc102e9cacf8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:54.833586 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-56efa63f-fd04-4e3e-8caf-8d6c182c7fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:54.916211 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9d1847-6c83-466d-ab65-776e6fdaf839 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:54.919762 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:54.920906 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9d1847-6c83-466d-ab65-776e6fdaf839 service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:54.940779 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 885/1765] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:57:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:57:54.951588 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 881/1766] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:57:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:55.016253 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8ccd9-40d2-4aa4-814a-69f828e826a8 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:55.016886 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8ccd9-40d2-4aa4-814a-69f828e826a8 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:55.017351 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8ccd9-40d2-4aa4-814a-69f828e826a8 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:55.019792 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 886/1767] 10.222.0.49 () {54 vars in 912 bytes} [Sun Aug 28 00:57:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:57:55.026081 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef226d-faa7-490b-b2f5-dcd2d6b441fd None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:55.026871 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef226d-faa7-490b-b2f5-dcd2d6b441fd None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:55.027420 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef226d-faa7-490b-b2f5-dcd2d6b441fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:55.051353 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d8ccd9-40d2-4aa4-814a-69f828e826a8 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:55.054255 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-69d8ccd9-40d2-4aa4-814a-69f828e826a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:55.080480 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-baef226d-faa7-490b-b2f5-dcd2d6b441fd None None] MFA Rules not processed for user `3dc0655c8156457a8fcb006c9fe85eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:55.081713 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-baef226d-faa7-490b-b2f5-dcd2d6b441fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:55.203731 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d8ccd9-40d2-4aa4-814a-69f828e826a8 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:55.213508 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76fbe39-a929-4eb7-b6fd-81295f1d8d6c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4fc1d11f5641b0b5f301b234282aa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:55.215338 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76fbe39-a929-4eb7-b6fd-81295f1d8d6c service placement] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:55.216057 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76fbe39-a929-4eb7-b6fd-81295f1d8d6c service placement] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:55.216334 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76fbe39-a929-4eb7-b6fd-81295f1d8d6c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:55.218462 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-a76fbe39-a929-4eb7-b6fd-81295f1d8d6c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:55.230665 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:55.236629 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 882/1768] 10.222.0.49 () {58 vars in 1009 bytes} [Sun Aug 28 00:57:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:55.239032 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76fbe39-a929-4eb7-b6fd-81295f1d8d6c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:55.240979 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76fbe39-a929-4eb7-b6fd-81295f1d8d6c service placement] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:55.261204 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 887/1769] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:57:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:57:55.292445 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef226d-faa7-490b-b2f5-dcd2d6b441fd None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:55.293966 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-baef226d-faa7-490b-b2f5-dcd2d6b441fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:55.316992 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef226d-faa7-490b-b2f5-dcd2d6b441fd None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:55.331838 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a7c798-c6a9-455e-88c0-60eef2a3a7dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:55.332579 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7c798-c6a9-455e-88c0-60eef2a3a7dc service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:55.332978 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7c798-c6a9-455e-88c0-60eef2a3a7dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:55.333307 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7c798-c6a9-455e-88c0-60eef2a3a7dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:55.354043 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a7c798-c6a9-455e-88c0-60eef2a3a7dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:55.355689 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a7c798-c6a9-455e-88c0-60eef2a3a7dc service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:55.388157 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 883/1770] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:57:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:57:55.477449 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76fbe39-a929-4eb7-b6fd-81295f1d8d6c service placement] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:55.480216 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-a76fbe39-a929-4eb7-b6fd-81295f1d8d6c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:55.661006 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76fbe39-a929-4eb7-b6fd-81295f1d8d6c service placement] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:55.666811 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94479f9c-e6a6-4f2c-b5b6-c02c95572a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:55.667836 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94479f9c-e6a6-4f2c-b5b6-c02c95572a48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:55.668673 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94479f9c-e6a6-4f2c-b5b6-c02c95572a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:55.668673 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94479f9c-e6a6-4f2c-b5b6-c02c95572a48 admin admin] PATH_INFO: `/v3/projects/5711212fc0a745c8a29a3922b23b0043` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:55.671428 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94479f9c-e6a6-4f2c-b5b6-c02c95572a48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5711212fc0a745c8a29a3922b23b0043)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:55.674284 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94479f9c-e6a6-4f2c-b5b6-c02c95572a48 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:55.800565 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-94479f9c-e6a6-4f2c-b5b6-c02c95572a48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5711212fc0a745c8a29a3922b23b0043', 'request_id': 'req-94479f9c-e6a6-4f2c-b5b6-c02c95572a48'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:55.829339 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-94479f9c-e6a6-4f2c-b5b6-c02c95572a48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5711212fc0a745c8a29a3922b23b0043', 'request_id': 'req-94479f9c-e6a6-4f2c-b5b6-c02c95572a48'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:55.860507 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-94479f9c-e6a6-4f2c-b5b6-c02c95572a48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5711212fc0a745c8a29a3922b23b0043', 'request_id': 'req-94479f9c-e6a6-4f2c-b5b6-c02c95572a48'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:55.878766 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-94479f9c-e6a6-4f2c-b5b6-c02c95572a48 admin admin] The token cache is being invalidate because project 5711212fc0a745c8a29a3922b23b0043 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81808) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:57:55.879222 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-94479f9c-e6a6-4f2c-b5b6-c02c95572a48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:55.879983 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-94479f9c-e6a6-4f2c-b5b6-c02c95572a48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:55.882368 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 888/1771] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 00:57:55 2022] DELETE /identity/v3/projects/5711212fc0a745c8a29a3922b23b0043 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:57:55.889019 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc30456-89ad-49a7-b347-969b8d32da0b None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:55.890545 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc30456-89ad-49a7-b347-969b8d32da0b None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:55.891077 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc30456-89ad-49a7-b347-969b8d32da0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:55.959344 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-1dc30456-89ad-49a7-b347-969b8d32da0b None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:55.960777 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-1dc30456-89ad-49a7-b347-969b8d32da0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:56.075924 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 884/1772] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:57:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:56.085183 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ff74e-ccc1-445f-ac31-c2313c86bbc1 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:56.086811 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ff74e-ccc1-445f-ac31-c2313c86bbc1 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:56.087578 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ff74e-ccc1-445f-ac31-c2313c86bbc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:56.121669 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-251ff74e-ccc1-445f-ac31-c2313c86bbc1 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:56.123258 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-251ff74e-ccc1-445f-ac31-c2313c86bbc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:56.138299 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 889/1773] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:57:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:56.139160 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc30456-89ad-49a7-b347-969b8d32da0b None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:56.151617 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc30456-89ad-49a7-b347-969b8d32da0b None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:56.159769 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e6e45b-7d64-45fb-87f7-07d8d38d417e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:56.162017 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e6e45b-7d64-45fb-87f7-07d8d38d417e admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:56.162303 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e6e45b-7d64-45fb-87f7-07d8d38d417e admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:56.162618 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e6e45b-7d64-45fb-87f7-07d8d38d417e admin admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:56.163574 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e6e45b-7d64-45fb-87f7-07d8d38d417e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:57:56.163936 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e6e45b-7d64-45fb-87f7-07d8d38d417e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:56.166762 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e6e45b-7d64-45fb-87f7-07d8d38d417e admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:56.186601 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 885/1774] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 00:57:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:57:56.191855 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251ff74e-ccc1-445f-ac31-c2313c86bbc1 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:56.206852 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251ff74e-ccc1-445f-ac31-c2313c86bbc1 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:56.228892 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc0eee2-446e-4731-949b-95694c3d548c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:56.231528 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0eee2-446e-4731-949b-95694c3d548c admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:56.231973 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0eee2-446e-4731-949b-95694c3d548c admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:56.232629 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0eee2-446e-4731-949b-95694c3d548c admin admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:56.233352 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc0eee2-446e-4731-949b-95694c3d548c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:56.235850 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc0eee2-446e-4731-949b-95694c3d548c admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:56.304764 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 890/1775] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 00:57:56 2022] POST /identity/v3/projects => generated 373 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:57:56.305312 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e6e45b-7d64-45fb-87f7-07d8d38d417e admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:56.318509 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e6e45b-7d64-45fb-87f7-07d8d38d417e admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:56.410108 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:56.422958 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2e77cc-a5d1-4e46-abf8-72ae29074938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:56.424121 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e77cc-a5d1-4e46-abf8-72ae29074938 admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:56.424408 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e77cc-a5d1-4e46-abf8-72ae29074938 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:56.431239 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e77cc-a5d1-4e46-abf8-72ae29074938 admin admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:56.431933 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2e77cc-a5d1-4e46-abf8-72ae29074938 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:56.433931 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2e77cc-a5d1-4e46-abf8-72ae29074938 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:56.452151 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92355fba-16b8-43fd-96e4-e391e0e88777 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:56.452151 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92355fba-16b8-43fd-96e4-e391e0e88777 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:56.452415 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92355fba-16b8-43fd-96e4-e391e0e88777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:56.476952 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 886/1776] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 00:57:56 2022] POST /identity/v3/users => generated 287 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:57:56.491275 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2e77cc-a5d1-4e46-abf8-72ae29074938 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:56.492465 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-92355fba-16b8-43fd-96e4-e391e0e88777 None None] MFA Rules not processed for user `cfec34d4145f4e188acdb2c1df19243a`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:56.494034 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-92355fba-16b8-43fd-96e4-e391e0e88777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:56.511828 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2e77cc-a5d1-4e46-abf8-72ae29074938 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:56.534618 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d2333a-36d2-4111-b827-0cf374acfd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:56.536569 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2333a-36d2-4111-b827-0cf374acfd4d admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:56.536932 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2333a-36d2-4111-b827-0cf374acfd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:56.537349 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2333a-36d2-4111-b827-0cf374acfd4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:56.539434 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d2333a-36d2-4111-b827-0cf374acfd4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:56.542086 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d2333a-36d2-4111-b827-0cf374acfd4d admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:56.561084 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 887/1777] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:57:56.563385 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d2333a-36d2-4111-b827-0cf374acfd4d admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:56.586553 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d2333a-36d2-4111-b827-0cf374acfd4d admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:56.595626 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf92d4b-900e-4bca-9ced-8e89ee0581a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:56.596345 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf92d4b-900e-4bca-9ced-8e89ee0581a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:56.599139 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf92d4b-900e-4bca-9ced-8e89ee0581a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:56.599573 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf92d4b-900e-4bca-9ced-8e89ee0581a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:56.600307 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf92d4b-900e-4bca-9ced-8e89ee0581a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:56.603002 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:56.603922 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf92d4b-900e-4bca-9ced-8e89ee0581a2 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:56.620382 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 891/1778] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:57:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:57:56.638929 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 888/1779] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 00:57:56.643658 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92355fba-16b8-43fd-96e4-e391e0e88777 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:56.663201 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92355fba-16b8-43fd-96e4-e391e0e88777 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:56.673642 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dacc13f-99e6-4d19-b528-78ee4a9f83da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:56.675114 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dacc13f-99e6-4d19-b528-78ee4a9f83da admin admin] REQUEST_METHOD: `PUT` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:56.675591 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dacc13f-99e6-4d19-b528-78ee4a9f83da admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:56.676170 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dacc13f-99e6-4d19-b528-78ee4a9f83da admin admin] PATH_INFO: `/v3/projects/8fdeccfb264843fb8e05a6616c583a57/users/7f5e127f43a94b83a8795c5e975048b5/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:56.697922 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dacc13f-99e6-4d19-b528-78ee4a9f83da admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fdeccfb264843fb8e05a6616c583a57, user_id=7f5e127f43a94b83a8795c5e975048b5, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:56.700857 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dacc13f-99e6-4d19-b528-78ee4a9f83da admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:56.731947 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 892/1780] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 00:57:56 2022] PUT /identity/v3/projects/8fdeccfb264843fb8e05a6616c583a57/users/7f5e127f43a94b83a8795c5e975048b5/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:57:56.742686 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c155c86-97c7-4a8c-9348-9a9b84ea42cc None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:56.743437 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c155c86-97c7-4a8c-9348-9a9b84ea42cc None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:56.743760 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c155c86-97c7-4a8c-9348-9a9b84ea42cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:56.790996 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-1c155c86-97c7-4a8c-9348-9a9b84ea42cc None None] MFA Rules not processed for user `7f5e127f43a94b83a8795c5e975048b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:56.792472 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-1c155c86-97c7-4a8c-9348-9a9b84ea42cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:56.889581 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dacc13f-99e6-4d19-b528-78ee4a9f83da admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:56.892456 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 889/1781] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:57:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:57.010813 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dacc13f-99e6-4d19-b528-78ee4a9f83da admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:57.020089 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796808e-b7cc-432b-9f37-99d89f3d1423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:57.021071 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796808e-b7cc-432b-9f37-99d89f3d1423 admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:57.021599 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796808e-b7cc-432b-9f37-99d89f3d1423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:57.022016 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796808e-b7cc-432b-9f37-99d89f3d1423 admin admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:57.024191 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3796808e-b7cc-432b-9f37-99d89f3d1423 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:57.027084 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3796808e-b7cc-432b-9f37-99d89f3d1423 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:57.083455 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 893/1782] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 00:57:56 2022] POST /identity/v3/projects => generated 373 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:57:57.084861 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c155c86-97c7-4a8c-9348-9a9b84ea42cc None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:57.112445 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796808e-b7cc-432b-9f37-99d89f3d1423 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:57.118240 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-3796808e-b7cc-432b-9f37-99d89f3d1423 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:57.122076 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c155c86-97c7-4a8c-9348-9a9b84ea42cc None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:57.286070 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796808e-b7cc-432b-9f37-99d89f3d1423 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:57.296938 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae22feec-b279-4c8b-bd10-b54a612a7035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:57.297582 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22feec-b279-4c8b-bd10-b54a612a7035 admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:57.297858 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22feec-b279-4c8b-bd10-b54a612a7035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:57.298134 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22feec-b279-4c8b-bd10-b54a612a7035 admin admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:57.298776 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae22feec-b279-4c8b-bd10-b54a612a7035 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:57.300835 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0be439-ed0a-42d2-a2a6-bf51cd8da5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:57.300966 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae22feec-b279-4c8b-bd10-b54a612a7035 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:57.304156 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0be439-ed0a-42d2-a2a6-bf51cd8da5e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:57.305352 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0be439-ed0a-42d2-a2a6-bf51cd8da5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:57.305853 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0be439-ed0a-42d2-a2a6-bf51cd8da5e9 admin admin] PATH_INFO: `/v3/users/95949e9325144d52ae1ea8baf46e3369` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:57.311033 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0be439-ed0a-42d2-a2a6-bf51cd8da5e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95949e9325144d52ae1ea8baf46e3369)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:57.317832 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0be439-ed0a-42d2-a2a6-bf51cd8da5e9 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:57.343891 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 890/1783] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 00:57:57 2022] POST /identity/v3/users => generated 293 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:57:57.347591 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae22feec-b279-4c8b-bd10-b54a612a7035 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:57.369923 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae22feec-b279-4c8b-bd10-b54a612a7035 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:57.385542 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741e2f60-74f2-45d1-a234-dbce723c512d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:57.386178 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e2f60-74f2-45d1-a234-dbce723c512d admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:57.386453 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e2f60-74f2-45d1-a234-dbce723c512d admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:57.386720 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e2f60-74f2-45d1-a234-dbce723c512d admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:57.387379 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741e2f60-74f2-45d1-a234-dbce723c512d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:57.389079 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741e2f60-74f2-45d1-a234-dbce723c512d admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:57.416163 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 891/1784] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 00:57:57.417127 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741e2f60-74f2-45d1-a234-dbce723c512d admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:57.440872 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741e2f60-74f2-45d1-a234-dbce723c512d admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:57.457129 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11584899-0771-4503-b526-c118bd7e63da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:57.458123 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11584899-0771-4503-b526-c118bd7e63da admin admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:57.458500 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11584899-0771-4503-b526-c118bd7e63da admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:57.458819 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11584899-0771-4503-b526-c118bd7e63da admin admin] PATH_INFO: `/v3/projects/b715577b6d314593860e1ab80fc5340b/users/dabd2a1a373b40bdb4dee30510a5364a/roles/2e4889bb71f9434392c0baba59f2534e` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:57.459325 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-ea0be439-ed0a-42d2-a2a6-bf51cd8da5e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95949e9325144d52ae1ea8baf46e3369'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:57.474018 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-ea0be439-ed0a-42d2-a2a6-bf51cd8da5e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95949e9325144d52ae1ea8baf46e3369'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:57.494792 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:57.495198 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11584899-0771-4503-b526-c118bd7e63da admin admin] RBAC: Authorizing `identity:create_grant(project_id=b715577b6d314593860e1ab80fc5340b, user_id=dabd2a1a373b40bdb4dee30510a5364a, role_id=2e4889bb71f9434392c0baba59f2534e)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:57.498186 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11584899-0771-4503-b526-c118bd7e63da admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:57.522521 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-ea0be439-ed0a-42d2-a2a6-bf51cd8da5e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95949e9325144d52ae1ea8baf46e3369'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:57.524068 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-ea0be439-ed0a-42d2-a2a6-bf51cd8da5e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95949e9325144d52ae1ea8baf46e3369'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:57.526784 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-ea0be439-ed0a-42d2-a2a6-bf51cd8da5e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95949e9325144d52ae1ea8baf46e3369'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:57:57.534521 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 892/1785] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 00:57:57 2022] PUT /identity/v3/projects/b715577b6d314593860e1ab80fc5340b/users/dabd2a1a373b40bdb4dee30510a5364a/roles/2e4889bb71f9434392c0baba59f2534e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:57:57.543246 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11584899-0771-4503-b526-c118bd7e63da admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:57.553508 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-11584899-0771-4503-b526-c118bd7e63da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:57.565476 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 894/1786] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 00:57:57 2022] DELETE /identity/v3/users/95949e9325144d52ae1ea8baf46e3369 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:57:57.573474 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7f830-c32e-40c6-a7b7-a9bde32861c3 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:57.573769 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7f830-c32e-40c6-a7b7-a9bde32861c3 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:57.575219 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7f830-c32e-40c6-a7b7-a9bde32861c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:57.578663 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:57.632836 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-50f7f830-c32e-40c6-a7b7-a9bde32861c3 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:57.634090 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-50f7f830-c32e-40c6-a7b7-a9bde32861c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:57.739741 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 895/1787] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:57:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:57.776694 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11584899-0771-4503-b526-c118bd7e63da admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:57.820076 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2648672-054a-4e32-b232-126c48564051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:57.820705 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2648672-054a-4e32-b232-126c48564051 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:57.820986 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2648672-054a-4e32-b232-126c48564051 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:57.821256 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2648672-054a-4e32-b232-126c48564051 admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:57.825692 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2648672-054a-4e32-b232-126c48564051 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:57.852858 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2648672-054a-4e32-b232-126c48564051 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:57.873705 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 893/1788] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:57:57.878192 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f7f830-c32e-40c6-a7b7-a9bde32861c3 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:57.901381 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2648672-054a-4e32-b232-126c48564051 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:57.904797 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f7f830-c32e-40c6-a7b7-a9bde32861c3 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:57.906266 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-a2648672-054a-4e32-b232-126c48564051 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:57.928101 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6a3319-8e69-4ffd-8dc0-9c248d2c3f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:57.928799 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a3319-8e69-4ffd-8dc0-9c248d2c3f39 admin admin] REQUEST_METHOD: `PUT` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:57.929078 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a3319-8e69-4ffd-8dc0-9c248d2c3f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:57.929350 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a3319-8e69-4ffd-8dc0-9c248d2c3f39 admin admin] PATH_INFO: `/v3/projects/b715577b6d314593860e1ab80fc5340b/users/dabd2a1a373b40bdb4dee30510a5364a/roles/2e4889bb71f9434392c0baba59f2534e` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:57.947212 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6a3319-8e69-4ffd-8dc0-9c248d2c3f39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b715577b6d314593860e1ab80fc5340b, user_id=dabd2a1a373b40bdb4dee30510a5364a, role_id=2e4889bb71f9434392c0baba59f2534e)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:57.964169 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6a3319-8e69-4ffd-8dc0-9c248d2c3f39 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:58.003241 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 896/1789] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 00:57:57 2022] PUT /identity/v3/projects/b715577b6d314593860e1ab80fc5340b/users/dabd2a1a373b40bdb4dee30510a5364a/roles/2e4889bb71f9434392c0baba59f2534e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:57:58.019576 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27affe-feac-4638-8f53-3ab9e2595e1d None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:58.019901 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27affe-feac-4638-8f53-3ab9e2595e1d None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:58.020164 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27affe-feac-4638-8f53-3ab9e2595e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:58.091393 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2648672-054a-4e32-b232-126c48564051 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:58.142958 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-7c27affe-feac-4638-8f53-3ab9e2595e1d None None] MFA Rules not processed for user `dabd2a1a373b40bdb4dee30510a5364a`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:58.150285 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-7c27affe-feac-4638-8f53-3ab9e2595e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:58.193000 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c904a-b4e1-4a63-a4ee-0479622ef094 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:58.193976 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c904a-b4e1-4a63-a4ee-0479622ef094 service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:58.194350 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c904a-b4e1-4a63-a4ee-0479622ef094 service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:58.194738 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c904a-b4e1-4a63-a4ee-0479622ef094 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:58.280403 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8c904a-b4e1-4a63-a4ee-0479622ef094 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:58.282281 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8c904a-b4e1-4a63-a4ee-0479622ef094 service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:58.295710 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 894/1790] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:57:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:57:58.454550 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 897/1791] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:57:58 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 437 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:58.459943 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c904a-b4e1-4a63-a4ee-0479622ef094 service neutron] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:58.474523 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c904a-b4e1-4a63-a4ee-0479622ef094 service neutron] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:58.488929 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ede1e-1b52-4406-be67-426128e20676 tempest-QuotasNegativeTest-1542266005 tempest-QuotasNegativeTest-1542266005-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dabd2a1a373b40bdb4dee30510a5364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b715577b6d314593860e1ab80fc5340b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:58.489755 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ede1e-1b52-4406-be67-426128e20676 tempest-QuotasNegativeTest-1542266005 tempest-QuotasNegativeTest-1542266005-project-admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:58.490191 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ede1e-1b52-4406-be67-426128e20676 tempest-QuotasNegativeTest-1542266005 tempest-QuotasNegativeTest-1542266005-project-admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:58.490564 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ede1e-1b52-4406-be67-426128e20676 tempest-QuotasNegativeTest-1542266005 tempest-QuotasNegativeTest-1542266005-project-admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:58.491624 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992ede1e-1b52-4406-be67-426128e20676 tempest-QuotasNegativeTest-1542266005 tempest-QuotasNegativeTest-1542266005-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:57:58.492496 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992ede1e-1b52-4406-be67-426128e20676 tempest-QuotasNegativeTest-1542266005 tempest-QuotasNegativeTest-1542266005-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:58.495357 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992ede1e-1b52-4406-be67-426128e20676 tempest-QuotasNegativeTest-1542266005 tempest-QuotasNegativeTest-1542266005-project-admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:58.499806 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:58.517314 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 895/1792] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 00:57:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:57:58.521200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c27affe-feac-4638-8f53-3ab9e2595e1d None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:58.536803 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c27affe-feac-4638-8f53-3ab9e2595e1d None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:58.558765 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8a4aee-9355-42ba-8539-ddd6f3560628 tempest-QuotasNegativeTest-1542266005 tempest-QuotasNegativeTest-1542266005-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dabd2a1a373b40bdb4dee30510a5364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b715577b6d314593860e1ab80fc5340b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:58.559935 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a4aee-9355-42ba-8539-ddd6f3560628 tempest-QuotasNegativeTest-1542266005 tempest-QuotasNegativeTest-1542266005-project-admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:58.562729 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a4aee-9355-42ba-8539-ddd6f3560628 tempest-QuotasNegativeTest-1542266005 tempest-QuotasNegativeTest-1542266005-project-admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:58.563183 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a4aee-9355-42ba-8539-ddd6f3560628 tempest-QuotasNegativeTest-1542266005 tempest-QuotasNegativeTest-1542266005-project-admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:58.564214 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8a4aee-9355-42ba-8539-ddd6f3560628 tempest-QuotasNegativeTest-1542266005 tempest-QuotasNegativeTest-1542266005-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:58.569980 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8a4aee-9355-42ba-8539-ddd6f3560628 tempest-QuotasNegativeTest-1542266005 tempest-QuotasNegativeTest-1542266005-project-admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:58.635073 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 898/1793] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 00:57:58 2022] POST /identity/v3/projects => generated 347 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:57:58.637176 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ede1e-1b52-4406-be67-426128e20676 tempest-QuotasNegativeTest-1542266005 tempest-QuotasNegativeTest-1542266005-project-admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:58.652923 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ede1e-1b52-4406-be67-426128e20676 tempest-QuotasNegativeTest-1542266005 tempest-QuotasNegativeTest-1542266005-project-admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:58.737542 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c67759-9c17-4b42-9ded-c6cedd82d36d tempest-QuotasNegativeTest-1542266005 tempest-QuotasNegativeTest-1542266005-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dabd2a1a373b40bdb4dee30510a5364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b715577b6d314593860e1ab80fc5340b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:58.738351 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c67759-9c17-4b42-9ded-c6cedd82d36d tempest-QuotasNegativeTest-1542266005 tempest-QuotasNegativeTest-1542266005-project-admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:58.738723 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c67759-9c17-4b42-9ded-c6cedd82d36d tempest-QuotasNegativeTest-1542266005 tempest-QuotasNegativeTest-1542266005-project-admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:58.739085 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c67759-9c17-4b42-9ded-c6cedd82d36d tempest-QuotasNegativeTest-1542266005 tempest-QuotasNegativeTest-1542266005-project-admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:58.740031 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c67759-9c17-4b42-9ded-c6cedd82d36d tempest-QuotasNegativeTest-1542266005 tempest-QuotasNegativeTest-1542266005-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:57:58.740438 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c67759-9c17-4b42-9ded-c6cedd82d36d tempest-QuotasNegativeTest-1542266005 tempest-QuotasNegativeTest-1542266005-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:58.742542 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c67759-9c17-4b42-9ded-c6cedd82d36d tempest-QuotasNegativeTest-1542266005 tempest-QuotasNegativeTest-1542266005-project-admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:58.763880 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 896/1794] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 00:57:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:57:58.803528 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8a4aee-9355-42ba-8539-ddd6f3560628 tempest-QuotasNegativeTest-1542266005 tempest-QuotasNegativeTest-1542266005-project-admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:58.818780 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc57182-05b4-4495-8882-e99228566607 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:58.820267 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc57182-05b4-4495-8882-e99228566607 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:58.820652 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc57182-05b4-4495-8882-e99228566607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:58.891907 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:57:58.966627 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8a4aee-9355-42ba-8539-ddd6f3560628 tempest-QuotasNegativeTest-1542266005 tempest-QuotasNegativeTest-1542266005-project-admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:58.976716 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c6b266-92fb-4ac6-96b6-e1b2ace87e2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:58.977622 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6b266-92fb-4ac6-96b6-e1b2ace87e2a service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:58.978110 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6b266-92fb-4ac6-96b6-e1b2ace87e2a service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:58.978642 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6b266-92fb-4ac6-96b6-e1b2ace87e2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:58.981342 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-1fc57182-05b4-4495-8882-e99228566607 None None] MFA Rules not processed for user `cbe0653ed0c04a9080b5c337392de8ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:58.988830 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-1fc57182-05b4-4495-8882-e99228566607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:59.001675 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c6b266-92fb-4ac6-96b6-e1b2ace87e2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:59.003369 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c6b266-92fb-4ac6-96b6-e1b2ace87e2a service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:59.025992 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 899/1795] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:57:58 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:57:59.030281 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1df0aa-de61-4b4b-ad7b-875506f92fd7 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:59.033934 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1df0aa-de61-4b4b-ad7b-875506f92fd7 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:59.034368 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1df0aa-de61-4b4b-ad7b-875506f92fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:59.078396 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-ba1df0aa-de61-4b4b-ad7b-875506f92fd7 None None] MFA Rules not processed for user `2d14dcd0cb25427291ab8831924184e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:57:59.092604 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-ba1df0aa-de61-4b4b-ad7b-875506f92fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:59.104261 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 900/1796] 10.222.0.49 () {58 vars in 1009 bytes} [Sun Aug 28 00:57:59 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:59.133309 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 897/1797] 10.222.0.49 () {58 vars in 1009 bytes} [Sun Aug 28 00:57:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:57:59.252014 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1df0aa-de61-4b4b-ad7b-875506f92fd7 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:59.255068 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-ba1df0aa-de61-4b4b-ad7b-875506f92fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:57:59.375914 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc57182-05b4-4495-8882-e99228566607 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:57:59.392227 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc57182-05b4-4495-8882-e99228566607 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:59.397521 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68836053-4956-49e2-8340-64052540e123 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:59.399041 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68836053-4956-49e2-8340-64052540e123 service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:59.399041 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68836053-4956-49e2-8340-64052540e123 service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:59.399041 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68836053-4956-49e2-8340-64052540e123 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:59.416777 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68836053-4956-49e2-8340-64052540e123 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:59.418347 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68836053-4956-49e2-8340-64052540e123 service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:59.435498 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 898/1798] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:57:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:57:59.447616 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1df0aa-de61-4b4b-ad7b-875506f92fd7 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:57:59.465944 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c02b59-71e7-4c18-9c0c-fae8d3bc2c1a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ce463b940db4f83a6df7e0561a88567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:57:59.468173 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c02b59-71e7-4c18-9c0c-fae8d3bc2c1a service swift] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:57:59.469360 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c02b59-71e7-4c18-9c0c-fae8d3bc2c1a service swift] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:57:59.469893 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c02b59-71e7-4c18-9c0c-fae8d3bc2c1a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:57:59.498088 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c02b59-71e7-4c18-9c0c-fae8d3bc2c1a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:57:59.500904 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c02b59-71e7-4c18-9c0c-fae8d3bc2c1a service swift] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:57:59.516635 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 901/1799] 10.222.0.49 () {60 vars in 1384 bytes} [Sun Aug 28 00:57:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 00:58:00.192783 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68836053-4956-49e2-8340-64052540e123 service neutron] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:00.194444 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-68836053-4956-49e2-8340-64052540e123 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:00.454047 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:00.530581 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68836053-4956-49e2-8340-64052540e123 service neutron] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:00.576800 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a45c65e-e450-4074-9f2a-d7aa58a4f927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:00.577757 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a45c65e-e450-4074-9f2a-d7aa58a4f927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:00.578050 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a45c65e-e450-4074-9f2a-d7aa58a4f927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:00.578299 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a45c65e-e450-4074-9f2a-d7aa58a4f927 admin admin] PATH_INFO: `/v3/projects/7d71889ec4974803b2cb258ce8bd65f2` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:00.579627 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a45c65e-e450-4074-9f2a-d7aa58a4f927 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d71889ec4974803b2cb258ce8bd65f2)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:00.581762 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a45c65e-e450-4074-9f2a-d7aa58a4f927 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:00.782257 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-9a45c65e-e450-4074-9f2a-d7aa58a4f927 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d71889ec4974803b2cb258ce8bd65f2', 'request_id': 'req-9a45c65e-e450-4074-9f2a-d7aa58a4f927'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:00.813140 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-9a45c65e-e450-4074-9f2a-d7aa58a4f927 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d71889ec4974803b2cb258ce8bd65f2', 'request_id': 'req-9a45c65e-e450-4074-9f2a-d7aa58a4f927'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:00.853628 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-9a45c65e-e450-4074-9f2a-d7aa58a4f927 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d71889ec4974803b2cb258ce8bd65f2', 'request_id': 'req-9a45c65e-e450-4074-9f2a-d7aa58a4f927'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:00.894846 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-9a45c65e-e450-4074-9f2a-d7aa58a4f927 admin admin] The token cache is being invalidate because project 7d71889ec4974803b2cb258ce8bd65f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81807) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:58:00.895478 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-9a45c65e-e450-4074-9f2a-d7aa58a4f927 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:00.897205 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-9a45c65e-e450-4074-9f2a-d7aa58a4f927 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:00.915805 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 899/1800] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 00:58:00 2022] DELETE /identity/v3/projects/7d71889ec4974803b2cb258ce8bd65f2 => generated 0 bytes in 724 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:58:00.921518 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c02b59-71e7-4c18-9c0c-fae8d3bc2c1a service swift] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:00.963110 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c02b59-71e7-4c18-9c0c-fae8d3bc2c1a service swift] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:01.223706 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6a5b88-35e8-4e4f-b3b7-e3b2f6375a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:01.224509 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a5b88-35e8-4e4f-b3b7-e3b2f6375a0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:01.224821 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a5b88-35e8-4e4f-b3b7-e3b2f6375a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:01.225143 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a5b88-35e8-4e4f-b3b7-e3b2f6375a0a admin admin] PATH_INFO: `/v3/users/ea507863dd254df5823c126e7943e535` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:01.232952 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6a5b88-35e8-4e4f-b3b7-e3b2f6375a0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea507863dd254df5823c126e7943e535)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:01.235959 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6a5b88-35e8-4e4f-b3b7-e3b2f6375a0a admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:01.434822 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:01.488530 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-1b6a5b88-35e8-4e4f-b3b7-e3b2f6375a0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea507863dd254df5823c126e7943e535'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:01.523165 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-1b6a5b88-35e8-4e4f-b3b7-e3b2f6375a0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea507863dd254df5823c126e7943e535'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:01.620071 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-1b6a5b88-35e8-4e4f-b3b7-e3b2f6375a0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea507863dd254df5823c126e7943e535'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:01.626220 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-1b6a5b88-35e8-4e4f-b3b7-e3b2f6375a0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea507863dd254df5823c126e7943e535'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:01.629642 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-1b6a5b88-35e8-4e4f-b3b7-e3b2f6375a0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea507863dd254df5823c126e7943e535'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:01.735002 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 902/1801] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 00:58:00 2022] DELETE /identity/v3/users/ea507863dd254df5823c126e7943e535 => generated 0 bytes in 816 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:58:02.438291 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a45c65e-e450-4074-9f2a-d7aa58a4f927 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:02.440122 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-9a45c65e-e450-4074-9f2a-d7aa58a4f927 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:02.477659 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a45c65e-e450-4074-9f2a-d7aa58a4f927 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:02.666121 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69d0e02-0628-4fbe-83f2-30d9e31af09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:02.668721 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d0e02-0628-4fbe-83f2-30d9e31af09b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:02.669189 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d0e02-0628-4fbe-83f2-30d9e31af09b admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:02.669636 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69d0e02-0628-4fbe-83f2-30d9e31af09b admin admin] PATH_INFO: `/v3/users/dedb760c69aa49d8b878b9bb3a5d53e8` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:02.678374 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69d0e02-0628-4fbe-83f2-30d9e31af09b admin admin] RBAC: Authorizing `identity:delete_user(user_id=dedb760c69aa49d8b878b9bb3a5d53e8)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:02.684230 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69d0e02-0628-4fbe-83f2-30d9e31af09b admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:02.868685 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-b69d0e02-0628-4fbe-83f2-30d9e31af09b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dedb760c69aa49d8b878b9bb3a5d53e8'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:02.925634 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-b69d0e02-0628-4fbe-83f2-30d9e31af09b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dedb760c69aa49d8b878b9bb3a5d53e8'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:02.941821 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c8a71-d137-4c2a-a722-28b15cae855b None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:02.942973 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c8a71-d137-4c2a-a722-28b15cae855b None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:02.942973 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c8a71-d137-4c2a-a722-28b15cae855b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:02.957242 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-b69d0e02-0628-4fbe-83f2-30d9e31af09b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dedb760c69aa49d8b878b9bb3a5d53e8'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:02.959500 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-b69d0e02-0628-4fbe-83f2-30d9e31af09b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dedb760c69aa49d8b878b9bb3a5d53e8'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:02.962350 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-b69d0e02-0628-4fbe-83f2-30d9e31af09b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dedb760c69aa49d8b878b9bb3a5d53e8'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:02.986893 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-778c8a71-d137-4c2a-a722-28b15cae855b None None] MFA Rules not processed for user `2d14dcd0cb25427291ab8831924184e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:58:02.988258 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-778c8a71-d137-4c2a-a722-28b15cae855b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:03.011602 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:03.061260 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 900/1802] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 00:58:02 2022] DELETE /identity/v3/users/dedb760c69aa49d8b878b9bb3a5d53e8 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:58:03.068498 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8899ce9-422e-4815-8f8f-0cb1edf54f70 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:03.068828 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8899ce9-422e-4815-8f8f-0cb1edf54f70 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:03.071132 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8899ce9-422e-4815-8f8f-0cb1edf54f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:03.149214 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-b8899ce9-422e-4815-8f8f-0cb1edf54f70 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:58:03.156307 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 903/1803] 10.222.0.47 () {58 vars in 1015 bytes} [Sun Aug 28 00:58:02 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:58:03.158252 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-b8899ce9-422e-4815-8f8f-0cb1edf54f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:03.377672 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 901/1804] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:58:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:58:03.486386 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c8a71-d137-4c2a-a722-28b15cae855b None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:03.489071 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-778c8a71-d137-4c2a-a722-28b15cae855b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:03.510779 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c8a71-d137-4c2a-a722-28b15cae855b None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:03.608543 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8899ce9-422e-4815-8f8f-0cb1edf54f70 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:03.612000 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-b8899ce9-422e-4815-8f8f-0cb1edf54f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:03.684326 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df9b47-e5bd-437e-8d43-acf5ef0fc2e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:03.685523 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df9b47-e5bd-437e-8d43-acf5ef0fc2e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:03.687254 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df9b47-e5bd-437e-8d43-acf5ef0fc2e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:03.689164 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df9b47-e5bd-437e-8d43-acf5ef0fc2e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:03.745819 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76df9b47-e5bd-437e-8d43-acf5ef0fc2e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:03.747452 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76df9b47-e5bd-437e-8d43-acf5ef0fc2e0 service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:03.783565 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 904/1805] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:58:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:58:03.786692 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8899ce9-422e-4815-8f8f-0cb1edf54f70 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:03.799161 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef6803-d9e5-4196-8382-ab503399c41f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:03.800096 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef6803-d9e5-4196-8382-ab503399c41f service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:03.800237 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef6803-d9e5-4196-8382-ab503399c41f service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:03.800505 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef6803-d9e5-4196-8382-ab503399c41f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:03.825768 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cef6803-d9e5-4196-8382-ab503399c41f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:03.830258 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cef6803-d9e5-4196-8382-ab503399c41f service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:03.903552 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 902/1806] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:58:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 00:58:04.750284 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df9b47-e5bd-437e-8d43-acf5ef0fc2e0 service neutron] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:04.752716 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-76df9b47-e5bd-437e-8d43-acf5ef0fc2e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:04.793524 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df9b47-e5bd-437e-8d43-acf5ef0fc2e0 service neutron] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:04.807418 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ab7c8-8dbc-4067-9255-c9d5a2de2f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:04.808159 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ab7c8-8dbc-4067-9255-c9d5a2de2f68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:04.808512 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ab7c8-8dbc-4067-9255-c9d5a2de2f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:04.809149 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ab7c8-8dbc-4067-9255-c9d5a2de2f68 admin admin] PATH_INFO: `/v3/projects/03a84d90d7f84929b6605130455a8c47` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:04.812775 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09ab7c8-8dbc-4067-9255-c9d5a2de2f68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03a84d90d7f84929b6605130455a8c47)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:04.817969 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09ab7c8-8dbc-4067-9255-c9d5a2de2f68 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:05.075917 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-a09ab7c8-8dbc-4067-9255-c9d5a2de2f68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03a84d90d7f84929b6605130455a8c47', 'request_id': 'req-a09ab7c8-8dbc-4067-9255-c9d5a2de2f68'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:05.120820 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-a09ab7c8-8dbc-4067-9255-c9d5a2de2f68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03a84d90d7f84929b6605130455a8c47', 'request_id': 'req-a09ab7c8-8dbc-4067-9255-c9d5a2de2f68'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:05.151393 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-a09ab7c8-8dbc-4067-9255-c9d5a2de2f68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03a84d90d7f84929b6605130455a8c47', 'request_id': 'req-a09ab7c8-8dbc-4067-9255-c9d5a2de2f68'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:05.160964 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:05.188624 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-a09ab7c8-8dbc-4067-9255-c9d5a2de2f68 admin admin] The token cache is being invalidate because project 03a84d90d7f84929b6605130455a8c47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81808) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:58:05.189402 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-a09ab7c8-8dbc-4067-9255-c9d5a2de2f68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:05.193889 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-a09ab7c8-8dbc-4067-9255-c9d5a2de2f68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:05.210594 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 905/1807] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 00:58:04 2022] DELETE /identity/v3/projects/03a84d90d7f84929b6605130455a8c47 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:58:05.216430 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899d058-4876-476e-8d82-52166186079d None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:05.217477 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899d058-4876-476e-8d82-52166186079d None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:05.218072 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899d058-4876-476e-8d82-52166186079d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:05.263732 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-f899d058-4876-476e-8d82-52166186079d None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:58:05.265238 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-f899d058-4876-476e-8d82-52166186079d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:05.486143 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 903/1808] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:58:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:58:05.490846 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861f359-73f2-4cf9-82f6-243515a63566 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:05.491409 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861f359-73f2-4cf9-82f6-243515a63566 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:05.491958 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861f359-73f2-4cf9-82f6-243515a63566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:05.549181 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-1861f359-73f2-4cf9-82f6-243515a63566 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:58:05.557597 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-1861f359-73f2-4cf9-82f6-243515a63566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:05.567532 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 906/1809] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:58:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:58:05.574664 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f899d058-4876-476e-8d82-52166186079d None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:05.618731 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f899d058-4876-476e-8d82-52166186079d None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:05.646135 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d227bb0e-9b4b-4d9b-9fbc-6993eda67338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:05.647323 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227bb0e-9b4b-4d9b-9fbc-6993eda67338 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:05.648105 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227bb0e-9b4b-4d9b-9fbc-6993eda67338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:05.648640 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d227bb0e-9b4b-4d9b-9fbc-6993eda67338 admin admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:05.649528 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d227bb0e-9b4b-4d9b-9fbc-6993eda67338 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:58:05.650056 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d227bb0e-9b4b-4d9b-9fbc-6993eda67338 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:05.652355 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d227bb0e-9b4b-4d9b-9fbc-6993eda67338 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:05.692177 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 904/1810] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 00:58:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:58:05.698310 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1861f359-73f2-4cf9-82f6-243515a63566 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:05.714385 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1861f359-73f2-4cf9-82f6-243515a63566 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:05.728395 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83220593-4e40-4abf-819e-f9f5bf112d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:05.729043 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83220593-4e40-4abf-819e-f9f5bf112d8f admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:05.729386 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83220593-4e40-4abf-819e-f9f5bf112d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:05.729603 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83220593-4e40-4abf-819e-f9f5bf112d8f admin admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:05.730281 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83220593-4e40-4abf-819e-f9f5bf112d8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:05.738544 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83220593-4e40-4abf-819e-f9f5bf112d8f admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:05.792787 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 907/1811] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 00:58:05 2022] POST /identity/v3/projects => generated 371 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:58:05.798319 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d227bb0e-9b4b-4d9b-9fbc-6993eda67338 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:05.816993 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d227bb0e-9b4b-4d9b-9fbc-6993eda67338 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:05.862901 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:05.925720 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c6808-f258-43bb-bd7a-ff664303d2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:05.926453 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c6808-f258-43bb-bd7a-ff664303d2ef admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:05.926639 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c6808-f258-43bb-bd7a-ff664303d2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:05.927524 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c6808-f258-43bb-bd7a-ff664303d2ef admin admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:05.929625 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778c6808-f258-43bb-bd7a-ff664303d2ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:05.933279 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778c6808-f258-43bb-bd7a-ff664303d2ef admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:06.021014 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 905/1812] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 00:58:05 2022] POST /identity/v3/users => generated 286 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:58:06.022448 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83220593-4e40-4abf-819e-f9f5bf112d8f admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:06.040819 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83220593-4e40-4abf-819e-f9f5bf112d8f admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:06.057331 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19246f67-1ee3-49ad-8b43-9ace488de22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:06.058985 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19246f67-1ee3-49ad-8b43-9ace488de22c admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:06.058985 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19246f67-1ee3-49ad-8b43-9ace488de22c admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:06.058985 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19246f67-1ee3-49ad-8b43-9ace488de22c admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:06.059570 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19246f67-1ee3-49ad-8b43-9ace488de22c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:06.062597 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19246f67-1ee3-49ad-8b43-9ace488de22c admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:06.109781 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 908/1813] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:58:06 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:58:06.110818 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c6808-f258-43bb-bd7a-ff664303d2ef admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:06.125765 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c6808-f258-43bb-bd7a-ff664303d2ef admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:06.137997 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a46cb1-3b04-4c6c-b9e0-c551450c50b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:06.138776 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a46cb1-3b04-4c6c-b9e0-c551450c50b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:06.139119 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a46cb1-3b04-4c6c-b9e0-c551450c50b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:06.139454 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a46cb1-3b04-4c6c-b9e0-c551450c50b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:06.140640 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a46cb1-3b04-4c6c-b9e0-c551450c50b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:06.145265 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a46cb1-3b04-4c6c-b9e0-c551450c50b7 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:06.173431 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 906/1814] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:58:06 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 00:58:06.175041 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19246f67-1ee3-49ad-8b43-9ace488de22c admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:06.190462 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19246f67-1ee3-49ad-8b43-9ace488de22c admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:06.240798 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e3144-64de-432c-ba24-301bfb36e56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:06.242545 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e3144-64de-432c-ba24-301bfb36e56c admin admin] REQUEST_METHOD: `PUT` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:06.243105 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e3144-64de-432c-ba24-301bfb36e56c admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:06.244649 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e3144-64de-432c-ba24-301bfb36e56c admin admin] PATH_INFO: `/v3/projects/9152ef7c7b934a12b9830274ec4eaa5f/users/253c6ab482d2437cb855d76ce6c8bfee/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:06.316545 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78e3144-64de-432c-ba24-301bfb36e56c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9152ef7c7b934a12b9830274ec4eaa5f, user_id=253c6ab482d2437cb855d76ce6c8bfee, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:06.319384 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78e3144-64de-432c-ba24-301bfb36e56c admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:06.360939 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 909/1815] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 00:58:06 2022] PUT /identity/v3/projects/9152ef7c7b934a12b9830274ec4eaa5f/users/253c6ab482d2437cb855d76ce6c8bfee/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:58:06.371655 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd568e9-7c6f-4610-be4c-0695463e9de0 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:06.372444 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd568e9-7c6f-4610-be4c-0695463e9de0 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:06.372444 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd568e9-7c6f-4610-be4c-0695463e9de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:06.459388 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-6dd568e9-7c6f-4610-be4c-0695463e9de0 None None] MFA Rules not processed for user `253c6ab482d2437cb855d76ce6c8bfee`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:58:06.461340 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-6dd568e9-7c6f-4610-be4c-0695463e9de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:06.635580 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 907/1816] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:58:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:58:06.686273 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e3144-64de-432c-ba24-301bfb36e56c admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:06.687959 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-d78e3144-64de-432c-ba24-301bfb36e56c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:06.782274 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd568e9-7c6f-4610-be4c-0695463e9de0 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:06.785683 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-6dd568e9-7c6f-4610-be4c-0695463e9de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:06.841043 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e3144-64de-432c-ba24-301bfb36e56c admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:06.853287 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8404a240-a68d-4cb4-95d0-a22f6e18ddc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:06.854291 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8404a240-a68d-4cb4-95d0-a22f6e18ddc1 service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:06.854740 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8404a240-a68d-4cb4-95d0-a22f6e18ddc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:06.855171 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8404a240-a68d-4cb4-95d0-a22f6e18ddc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:06.876383 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8404a240-a68d-4cb4-95d0-a22f6e18ddc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:06.878670 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8404a240-a68d-4cb4-95d0-a22f6e18ddc1 service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:06.907247 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 910/1817] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:58:06 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 00:58:06.950525 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd568e9-7c6f-4610-be4c-0695463e9de0 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:06.963195 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff04b7-73be-41b1-a139-edd1f993d506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:06.964255 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff04b7-73be-41b1-a139-edd1f993d506 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:06.964741 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff04b7-73be-41b1-a139-edd1f993d506 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:06.965253 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff04b7-73be-41b1-a139-edd1f993d506 admin admin] PATH_INFO: `/v3/projects/5dcd90e3c572497e881b08f0b05f9978` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:06.966775 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ff04b7-73be-41b1-a139-edd1f993d506 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dcd90e3c572497e881b08f0b05f9978)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:06.969269 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ff04b7-73be-41b1-a139-edd1f993d506 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:07.035551 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:07.047554 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-31ff04b7-73be-41b1-a139-edd1f993d506 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dcd90e3c572497e881b08f0b05f9978', 'request_id': 'req-31ff04b7-73be-41b1-a139-edd1f993d506'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:07.059806 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-31ff04b7-73be-41b1-a139-edd1f993d506 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dcd90e3c572497e881b08f0b05f9978', 'request_id': 'req-31ff04b7-73be-41b1-a139-edd1f993d506'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:07.084647 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-31ff04b7-73be-41b1-a139-edd1f993d506 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dcd90e3c572497e881b08f0b05f9978', 'request_id': 'req-31ff04b7-73be-41b1-a139-edd1f993d506'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:07.115563 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-31ff04b7-73be-41b1-a139-edd1f993d506 admin admin] The token cache is being invalidate because project 5dcd90e3c572497e881b08f0b05f9978 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81807) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:58:07.116082 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-31ff04b7-73be-41b1-a139-edd1f993d506 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:07.117264 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-31ff04b7-73be-41b1-a139-edd1f993d506 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:07.122739 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 908/1818] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 00:58:06 2022] DELETE /identity/v3/projects/5dcd90e3c572497e881b08f0b05f9978 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:58:07.124317 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8404a240-a68d-4cb4-95d0-a22f6e18ddc1 service neutron] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:07.154224 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8404a240-a68d-4cb4-95d0-a22f6e18ddc1 service neutron] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:07.359884 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42638f-aa65-48e9-af81-4a886804c347 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:07.360342 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42638f-aa65-48e9-af81-4a886804c347 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:07.360740 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42638f-aa65-48e9-af81-4a886804c347 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:07.362972 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 909/1819] 10.222.0.49 () {54 vars in 921 bytes} [Sun Aug 28 00:58:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:58:07.409961 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9c0764-66f0-496d-ace6-11ff35c35b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:07.410824 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c0764-66f0-496d-ace6-11ff35c35b97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:07.411091 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c0764-66f0-496d-ace6-11ff35c35b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:07.411395 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c0764-66f0-496d-ace6-11ff35c35b97 admin admin] PATH_INFO: `/v3/users/2a5d4aca8e0e497181c3c908afb92d32` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:07.413606 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9c0764-66f0-496d-ace6-11ff35c35b97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a5d4aca8e0e497181c3c908afb92d32)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:07.415561 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9c0764-66f0-496d-ace6-11ff35c35b97 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:07.428581 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bab01c-c657-4896-ba77-c1d5fd77e9ec None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:07.429163 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bab01c-c657-4896-ba77-c1d5fd77e9ec None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:07.429345 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bab01c-c657-4896-ba77-c1d5fd77e9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:07.475298 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-48bab01c-c657-4896-ba77-c1d5fd77e9ec None None] MFA Rules not processed for user `3dc0655c8156457a8fcb006c9fe85eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:58:07.477399 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-48bab01c-c657-4896-ba77-c1d5fd77e9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:07.503715 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:07.561982 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-ca9c0764-66f0-496d-ace6-11ff35c35b97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a5d4aca8e0e497181c3c908afb92d32'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:07.574853 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-ca9c0764-66f0-496d-ace6-11ff35c35b97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a5d4aca8e0e497181c3c908afb92d32'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:07.626156 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-ca9c0764-66f0-496d-ace6-11ff35c35b97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a5d4aca8e0e497181c3c908afb92d32'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:07.628796 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-ca9c0764-66f0-496d-ace6-11ff35c35b97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a5d4aca8e0e497181c3c908afb92d32'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:07.636010 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-ca9c0764-66f0-496d-ace6-11ff35c35b97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a5d4aca8e0e497181c3c908afb92d32'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:07.655883 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 910/1820] 10.222.0.49 () {58 vars in 1018 bytes} [Sun Aug 28 00:58:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:58:07.678007 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 911/1821] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 00:58:07 2022] DELETE /identity/v3/users/2a5d4aca8e0e497181c3c908afb92d32 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:58:07.824516 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bab01c-c657-4896-ba77-c1d5fd77e9ec None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:07.825995 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-48bab01c-c657-4896-ba77-c1d5fd77e9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:07.858321 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bab01c-c657-4896-ba77-c1d5fd77e9ec None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:07.957105 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a9466a-03d4-4d0e-b6b9-0ca27823b5b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:07.958346 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a9466a-03d4-4d0e-b6b9-0ca27823b5b8 service nova] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:07.958849 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a9466a-03d4-4d0e-b6b9-0ca27823b5b8 service nova] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:07.959284 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a9466a-03d4-4d0e-b6b9-0ca27823b5b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:07.978571 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a9466a-03d4-4d0e-b6b9-0ca27823b5b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:07.982069 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a9466a-03d4-4d0e-b6b9-0ca27823b5b8 service nova] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:08.005116 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 911/1822] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:58:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:58:09.866752 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9c0764-66f0-496d-ace6-11ff35c35b97 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:09.870359 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-ca9c0764-66f0-496d-ace6-11ff35c35b97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:10.123955 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9c0764-66f0-496d-ace6-11ff35c35b97 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:10.145660 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d494a4-976e-48fd-8047-c4d31b8af162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:10.147086 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d494a4-976e-48fd-8047-c4d31b8af162 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:10.147851 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d494a4-976e-48fd-8047-c4d31b8af162 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:10.148530 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d494a4-976e-48fd-8047-c4d31b8af162 admin admin] PATH_INFO: `/v3/projects/f8e0351ffc6f49a18dcb93bade12788b` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:10.151453 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d494a4-976e-48fd-8047-c4d31b8af162 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8e0351ffc6f49a18dcb93bade12788b)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:10.157355 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d494a4-976e-48fd-8047-c4d31b8af162 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:10.354500 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-61d494a4-976e-48fd-8047-c4d31b8af162 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8e0351ffc6f49a18dcb93bade12788b', 'request_id': 'req-61d494a4-976e-48fd-8047-c4d31b8af162'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:10.368663 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-61d494a4-976e-48fd-8047-c4d31b8af162 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8e0351ffc6f49a18dcb93bade12788b', 'request_id': 'req-61d494a4-976e-48fd-8047-c4d31b8af162'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:10.388546 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-61d494a4-976e-48fd-8047-c4d31b8af162 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8e0351ffc6f49a18dcb93bade12788b', 'request_id': 'req-61d494a4-976e-48fd-8047-c4d31b8af162'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:10.417883 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-61d494a4-976e-48fd-8047-c4d31b8af162 admin admin] The token cache is being invalidate because project f8e0351ffc6f49a18dcb93bade12788b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81808) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:58:10.418416 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-61d494a4-976e-48fd-8047-c4d31b8af162 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:10.419154 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-61d494a4-976e-48fd-8047-c4d31b8af162 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:10.427019 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 912/1823] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 00:58:09 2022] DELETE /identity/v3/projects/f8e0351ffc6f49a18dcb93bade12788b => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:58:10.428740 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af159a4-ba12-4432-89b4-7246bf1d3ab8 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:10.429591 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af159a4-ba12-4432-89b4-7246bf1d3ab8 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:10.429591 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af159a4-ba12-4432-89b4-7246bf1d3ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:10.473513 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-2af159a4-ba12-4432-89b4-7246bf1d3ab8 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:58:10.478564 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-2af159a4-ba12-4432-89b4-7246bf1d3ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:10.580553 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:10.627729 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 912/1824] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:58:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:58:10.634358 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44795003-0c79-4a94-b60d-79f915067ed9 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:10.634668 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44795003-0c79-4a94-b60d-79f915067ed9 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:10.635870 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44795003-0c79-4a94-b60d-79f915067ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:10.683532 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-44795003-0c79-4a94-b60d-79f915067ed9 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:58:10.683532 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-44795003-0c79-4a94-b60d-79f915067ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:10.695945 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 913/1825] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:58:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:58:10.700173 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af159a4-ba12-4432-89b4-7246bf1d3ab8 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:10.734242 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af159a4-ba12-4432-89b4-7246bf1d3ab8 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:10.759019 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ffa2c7-fda0-4afb-a54f-39545a679655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:10.764429 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ffa2c7-fda0-4afb-a54f-39545a679655 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:10.768239 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ffa2c7-fda0-4afb-a54f-39545a679655 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:10.772568 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ffa2c7-fda0-4afb-a54f-39545a679655 admin admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:10.774939 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ffa2c7-fda0-4afb-a54f-39545a679655 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:58:10.778478 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ffa2c7-fda0-4afb-a54f-39545a679655 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:10.786823 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ffa2c7-fda0-4afb-a54f-39545a679655 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:10.873163 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 913/1826] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 00:58:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:58:10.876348 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44795003-0c79-4a94-b60d-79f915067ed9 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:10.921164 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44795003-0c79-4a94-b60d-79f915067ed9 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:10.936843 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec10b6e-4ed8-43c5-9c57-9ee302eb14a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:10.940456 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec10b6e-4ed8-43c5-9c57-9ee302eb14a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:10.940957 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec10b6e-4ed8-43c5-9c57-9ee302eb14a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:10.943864 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec10b6e-4ed8-43c5-9c57-9ee302eb14a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:10.946788 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec10b6e-4ed8-43c5-9c57-9ee302eb14a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:10.958323 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec10b6e-4ed8-43c5-9c57-9ee302eb14a7 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:11.022314 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 914/1827] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 00:58:10 2022] POST /identity/v3/projects => generated 369 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:58:11.022636 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ffa2c7-fda0-4afb-a54f-39545a679655 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:11.040677 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ffa2c7-fda0-4afb-a54f-39545a679655 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:11.110940 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044f30a-bf75-48a8-a44d-fa04e6358f90 None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:11.112057 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044f30a-bf75-48a8-a44d-fa04e6358f90 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:11.112909 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044f30a-bf75-48a8-a44d-fa04e6358f90 None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:11.116817 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 915/1828] 10.222.0.49 () {54 vars in 921 bytes} [Sun Aug 28 00:58:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:58:11.184169 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee145886-5a84-4a7e-b1ea-a142c0bd0b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:11.185532 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee145886-5a84-4a7e-b1ea-a142c0bd0b33 admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:11.186191 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee145886-5a84-4a7e-b1ea-a142c0bd0b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:11.186486 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee145886-5a84-4a7e-b1ea-a142c0bd0b33 admin admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:11.187430 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee145886-5a84-4a7e-b1ea-a142c0bd0b33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:11.190035 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee145886-5a84-4a7e-b1ea-a142c0bd0b33 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:11.204108 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e533f8-1d50-4b3f-85c6-874b37caac22 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:11.204399 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e533f8-1d50-4b3f-85c6-874b37caac22 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:11.205474 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e533f8-1d50-4b3f-85c6-874b37caac22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:11.261106 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-44e533f8-1d50-4b3f-85c6-874b37caac22 None None] MFA Rules not processed for user `8f4fc1d11f5641b0b5f301b234282aa9`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:58:11.262405 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 914/1829] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 00:58:11 2022] POST /identity/v3/users => generated 285 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:58:11.266614 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee145886-5a84-4a7e-b1ea-a142c0bd0b33 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:11.266860 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-44e533f8-1d50-4b3f-85c6-874b37caac22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:11.277006 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:11.290370 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee145886-5a84-4a7e-b1ea-a142c0bd0b33 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:11.303640 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a692280e-5b48-4bba-8e51-5bb16b678a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:11.303978 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a692280e-5b48-4bba-8e51-5bb16b678a66 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:11.304383 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a692280e-5b48-4bba-8e51-5bb16b678a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:11.304538 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a692280e-5b48-4bba-8e51-5bb16b678a66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:11.305222 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a692280e-5b48-4bba-8e51-5bb16b678a66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:11.307073 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a692280e-5b48-4bba-8e51-5bb16b678a66 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:11.322816 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 915/1830] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:58:11 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 00:58:11.327808 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a692280e-5b48-4bba-8e51-5bb16b678a66 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:11.349576 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a692280e-5b48-4bba-8e51-5bb16b678a66 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:11.355010 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d9eff-565b-4444-be93-b7609ffc39b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:11.358057 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d9eff-565b-4444-be93-b7609ffc39b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:11.358563 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d9eff-565b-4444-be93-b7609ffc39b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:11.360004 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d9eff-565b-4444-be93-b7609ffc39b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:11.362307 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00d9eff-565b-4444-be93-b7609ffc39b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:11.364139 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00d9eff-565b-4444-be93-b7609ffc39b3 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:11.380325 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 916/1831] 10.222.0.49 () {58 vars in 1018 bytes} [Sun Aug 28 00:58:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:58:11.389067 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e533f8-1d50-4b3f-85c6-874b37caac22 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:11.390064 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 916/1832] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:58:11 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:58:11.402224 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e533f8-1d50-4b3f-85c6-874b37caac22 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:11.413395 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b451c-623f-4727-9386-c17b60ecf529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:11.414780 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b451c-623f-4727-9386-c17b60ecf529 admin admin] REQUEST_METHOD: `PUT` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:11.415522 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b451c-623f-4727-9386-c17b60ecf529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:11.416145 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b451c-623f-4727-9386-c17b60ecf529 admin admin] PATH_INFO: `/v3/projects/6aa218e1146048e69b37603279f0e905/users/9abd234dc00e465981610912c7be6c5e/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:11.420705 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53cefb-039c-42f0-b5ef-49d103332675 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:11.422231 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53cefb-039c-42f0-b5ef-49d103332675 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:11.423096 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53cefb-039c-42f0-b5ef-49d103332675 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:11.426464 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 917/1833] 10.222.0.49 () {54 vars in 961 bytes} [Sun Aug 28 00:58:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:58:11.433334 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c103d995-26cc-4654-8060-9cfad49e8375 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:11.434509 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c103d995-26cc-4654-8060-9cfad49e8375 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:11.435054 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c103d995-26cc-4654-8060-9cfad49e8375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:11.444692 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72b451c-623f-4727-9386-c17b60ecf529 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6aa218e1146048e69b37603279f0e905, user_id=9abd234dc00e465981610912c7be6c5e, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:11.449457 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72b451c-623f-4727-9386-c17b60ecf529 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:11.465640 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-c103d995-26cc-4654-8060-9cfad49e8375 None None] MFA Rules not processed for user `8f4fc1d11f5641b0b5f301b234282aa9`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:58:11.468044 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-c103d995-26cc-4654-8060-9cfad49e8375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:11.469479 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 917/1834] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 00:58:11 2022] PUT /identity/v3/projects/6aa218e1146048e69b37603279f0e905/users/9abd234dc00e465981610912c7be6c5e/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:58:11.481323 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a6bff-7fd8-40f5-ae03-0b4d39571ac1 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:11.482015 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a6bff-7fd8-40f5-ae03-0b4d39571ac1 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:11.482505 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a6bff-7fd8-40f5-ae03-0b4d39571ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:11.522423 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-079a6bff-7fd8-40f5-ae03-0b4d39571ac1 None None] MFA Rules not processed for user `9abd234dc00e465981610912c7be6c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:58:11.524025 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-079a6bff-7fd8-40f5-ae03-0b4d39571ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:11.573252 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 918/1835] 10.222.0.49 () {58 vars in 1058 bytes} [Sun Aug 28 00:58:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:58:11.582986 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c103d995-26cc-4654-8060-9cfad49e8375 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:11.595015 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c103d995-26cc-4654-8060-9cfad49e8375 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:11.602255 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e2c3a6-9b2c-4afb-8de4-faea747bc263 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4fc1d11f5641b0b5f301b234282aa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:11.604320 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2c3a6-9b2c-4afb-8de4-faea747bc263 service placement] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:11.604651 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2c3a6-9b2c-4afb-8de4-faea747bc263 service placement] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:11.604858 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2c3a6-9b2c-4afb-8de4-faea747bc263 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:11.617354 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e2c3a6-9b2c-4afb-8de4-faea747bc263 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:11.619190 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e2c3a6-9b2c-4afb-8de4-faea747bc263 service placement] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:11.622219 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 918/1836] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:58:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:58:11.647494 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 919/1837] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:58:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 00:58:11.677896 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a6bff-7fd8-40f5-ae03-0b4d39571ac1 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:11.684289 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-079a6bff-7fd8-40f5-ae03-0b4d39571ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:11.710934 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e2c3a6-9b2c-4afb-8de4-faea747bc263 service placement] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:11.714092 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-a3e2c3a6-9b2c-4afb-8de4-faea747bc263 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:11.773118 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:11.829741 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a6bff-7fd8-40f5-ae03-0b4d39571ac1 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:11.835555 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee8db72-a415-423f-a256-dbe1c0cade06 tempest-QuotasNegativeTest-1542266005 tempest-QuotasNegativeTest-1542266005-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dabd2a1a373b40bdb4dee30510a5364a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b715577b6d314593860e1ab80fc5340b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:11.836454 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee8db72-a415-423f-a256-dbe1c0cade06 tempest-QuotasNegativeTest-1542266005 tempest-QuotasNegativeTest-1542266005-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:11.836805 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee8db72-a415-423f-a256-dbe1c0cade06 tempest-QuotasNegativeTest-1542266005 tempest-QuotasNegativeTest-1542266005-project-admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:11.839488 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e2c3a6-9b2c-4afb-8de4-faea747bc263 service placement] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:11.840293 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee8db72-a415-423f-a256-dbe1c0cade06 tempest-QuotasNegativeTest-1542266005 tempest-QuotasNegativeTest-1542266005-project-admin] PATH_INFO: `/v3/projects/a166953ed1fd45ac9d8e7bbc541a1195` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:11.841917 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee8db72-a415-423f-a256-dbe1c0cade06 tempest-QuotasNegativeTest-1542266005 tempest-QuotasNegativeTest-1542266005-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a166953ed1fd45ac9d8e7bbc541a1195)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:11.844186 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee8db72-a415-423f-a256-dbe1c0cade06 tempest-QuotasNegativeTest-1542266005 tempest-QuotasNegativeTest-1542266005-project-admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:11.848055 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915c9865-129b-4c4f-8e66-bb10fab0c546 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:11.849569 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c9865-129b-4c4f-8e66-bb10fab0c546 service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:11.850369 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c9865-129b-4c4f-8e66-bb10fab0c546 service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:11.852299 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c9865-129b-4c4f-8e66-bb10fab0c546 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:11.864151 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:11.870799 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915c9865-129b-4c4f-8e66-bb10fab0c546 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:11.872631 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915c9865-129b-4c4f-8e66-bb10fab0c546 service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:11.886983 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 920/1838] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:58:11 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 00:58:11.966867 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-fee8db72-a415-423f-a256-dbe1c0cade06 tempest-QuotasNegativeTest-1542266005 tempest-QuotasNegativeTest-1542266005-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a166953ed1fd45ac9d8e7bbc541a1195', 'request_id': 'req-fee8db72-a415-423f-a256-dbe1c0cade06'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:11.982430 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-fee8db72-a415-423f-a256-dbe1c0cade06 tempest-QuotasNegativeTest-1542266005 tempest-QuotasNegativeTest-1542266005-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a166953ed1fd45ac9d8e7bbc541a1195', 'request_id': 'req-fee8db72-a415-423f-a256-dbe1c0cade06'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:12.000053 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-fee8db72-a415-423f-a256-dbe1c0cade06 tempest-QuotasNegativeTest-1542266005 tempest-QuotasNegativeTest-1542266005-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a166953ed1fd45ac9d8e7bbc541a1195', 'request_id': 'req-fee8db72-a415-423f-a256-dbe1c0cade06'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:12.023275 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-fee8db72-a415-423f-a256-dbe1c0cade06 tempest-QuotasNegativeTest-1542266005 tempest-QuotasNegativeTest-1542266005-project-admin] The token cache is being invalidate because project a166953ed1fd45ac9d8e7bbc541a1195 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81808) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:58:12.025405 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-fee8db72-a415-423f-a256-dbe1c0cade06 tempest-QuotasNegativeTest-1542266005 tempest-QuotasNegativeTest-1542266005-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:12.026578 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-fee8db72-a415-423f-a256-dbe1c0cade06 tempest-QuotasNegativeTest-1542266005 tempest-QuotasNegativeTest-1542266005-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:12.035819 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 919/1839] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 00:58:11 2022] DELETE /identity/v3/projects/a166953ed1fd45ac9d8e7bbc541a1195 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:58:12.038418 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915c9865-129b-4c4f-8e66-bb10fab0c546 service neutron] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:12.040882 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-915c9865-129b-4c4f-8e66-bb10fab0c546 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:12.091821 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee8db72-a415-423f-a256-dbe1c0cade06 tempest-QuotasNegativeTest-1542266005 tempest-QuotasNegativeTest-1542266005-project-admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:12.094377 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-fee8db72-a415-423f-a256-dbe1c0cade06 tempest-QuotasNegativeTest-1542266005 tempest-QuotasNegativeTest-1542266005-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:12.235876 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee8db72-a415-423f-a256-dbe1c0cade06 tempest-QuotasNegativeTest-1542266005 tempest-QuotasNegativeTest-1542266005-project-admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:12.241146 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01741ffc-e592-4794-923c-2f8a7a90c2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:12.241745 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01741ffc-e592-4794-923c-2f8a7a90c2b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:12.242026 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01741ffc-e592-4794-923c-2f8a7a90c2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:12.242298 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01741ffc-e592-4794-923c-2f8a7a90c2b8 admin admin] PATH_INFO: `/v3/users/253c6ab482d2437cb855d76ce6c8bfee` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:12.243880 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01741ffc-e592-4794-923c-2f8a7a90c2b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=253c6ab482d2437cb855d76ce6c8bfee)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:12.245884 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01741ffc-e592-4794-923c-2f8a7a90c2b8 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:12.260592 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915c9865-129b-4c4f-8e66-bb10fab0c546 service neutron] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:12.282573 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e43a986-dd8f-481e-930f-e2526eeebb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:12.283804 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e43a986-dd8f-481e-930f-e2526eeebb5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:12.284278 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e43a986-dd8f-481e-930f-e2526eeebb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:12.285068 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e43a986-dd8f-481e-930f-e2526eeebb5c admin admin] PATH_INFO: `/v3/users/7f5e127f43a94b83a8795c5e975048b5` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:12.289674 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e43a986-dd8f-481e-930f-e2526eeebb5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f5e127f43a94b83a8795c5e975048b5)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:12.293746 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e43a986-dd8f-481e-930f-e2526eeebb5c admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:12.368605 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-01741ffc-e592-4794-923c-2f8a7a90c2b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '253c6ab482d2437cb855d76ce6c8bfee'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:12.384324 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-01741ffc-e592-4794-923c-2f8a7a90c2b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '253c6ab482d2437cb855d76ce6c8bfee'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:12.413272 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-01741ffc-e592-4794-923c-2f8a7a90c2b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '253c6ab482d2437cb855d76ce6c8bfee'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:12.414126 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-01741ffc-e592-4794-923c-2f8a7a90c2b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '253c6ab482d2437cb855d76ce6c8bfee'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:12.414808 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-01741ffc-e592-4794-923c-2f8a7a90c2b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '253c6ab482d2437cb855d76ce6c8bfee'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:12.457109 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 920/1840] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 00:58:12 2022] DELETE /identity/v3/users/253c6ab482d2437cb855d76ce6c8bfee => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:58:12.458815 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0403199-8a49-4bb5-952e-523213a5eb59 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:12.460143 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0403199-8a49-4bb5-952e-523213a5eb59 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:12.460458 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0403199-8a49-4bb5-952e-523213a5eb59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:12.464570 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-7e43a986-dd8f-481e-930f-e2526eeebb5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f5e127f43a94b83a8795c5e975048b5'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:12.506077 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-7e43a986-dd8f-481e-930f-e2526eeebb5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f5e127f43a94b83a8795c5e975048b5'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:12.514285 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-b0403199-8a49-4bb5-952e-523213a5eb59 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:58:12.515838 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-7e43a986-dd8f-481e-930f-e2526eeebb5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f5e127f43a94b83a8795c5e975048b5'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:12.516588 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-7e43a986-dd8f-481e-930f-e2526eeebb5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f5e127f43a94b83a8795c5e975048b5'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:12.517473 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-7e43a986-dd8f-481e-930f-e2526eeebb5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f5e127f43a94b83a8795c5e975048b5'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:12.518277 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-b0403199-8a49-4bb5-952e-523213a5eb59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:12.536678 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 921/1841] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 00:58:12 2022] DELETE /identity/v3/users/7f5e127f43a94b83a8795c5e975048b5 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:58:12.542106 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e3e8c-252a-4c5e-93a3-4a9250077d51 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:12.542555 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e3e8c-252a-4c5e-93a3-4a9250077d51 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:12.542925 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e3e8c-252a-4c5e-93a3-4a9250077d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:12.559047 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:12.577873 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-ed6e3e8c-252a-4c5e-93a3-4a9250077d51 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:58:12.581529 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-ed6e3e8c-252a-4c5e-93a3-4a9250077d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:12.666537 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:12.677731 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 921/1842] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:58:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:58:12.700410 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0403199-8a49-4bb5-952e-523213a5eb59 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:12.705743 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-b0403199-8a49-4bb5-952e-523213a5eb59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:12.740976 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 922/1843] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:58:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:58:12.841930 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e3e8c-252a-4c5e-93a3-4a9250077d51 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:12.845671 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-ed6e3e8c-252a-4c5e-93a3-4a9250077d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:12.885829 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0403199-8a49-4bb5-952e-523213a5eb59 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:12.983060 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e3e8c-252a-4c5e-93a3-4a9250077d51 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:12.992164 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e09ea61-379c-4e1e-a7fb-208d2cc2e95c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:12.992810 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09ea61-379c-4e1e-a7fb-208d2cc2e95c service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:12.993117 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09ea61-379c-4e1e-a7fb-208d2cc2e95c service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:12.993401 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09ea61-379c-4e1e-a7fb-208d2cc2e95c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:13.020389 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e09ea61-379c-4e1e-a7fb-208d2cc2e95c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:13.024951 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e09ea61-379c-4e1e-a7fb-208d2cc2e95c service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:13.047202 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50cbb5-e068-4a51-ae4d-92b25d2b317a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:13.048019 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50cbb5-e068-4a51-ae4d-92b25d2b317a service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:13.048230 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50cbb5-e068-4a51-ae4d-92b25d2b317a service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:13.048708 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d50cbb5-e068-4a51-ae4d-92b25d2b317a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:13.055226 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 923/1844] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:58:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:58:13.058123 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610ce4e-cd66-43a8-b5ce-4425fc61aa69 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:13.058721 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610ce4e-cd66-43a8-b5ce-4425fc61aa69 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:13.059461 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610ce4e-cd66-43a8-b5ce-4425fc61aa69 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:13.063967 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 924/1845] 10.222.0.49 () {54 vars in 921 bytes} [Sun Aug 28 00:58:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 00:58:13.066032 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d50cbb5-e068-4a51-ae4d-92b25d2b317a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:13.068030 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d50cbb5-e068-4a51-ae4d-92b25d2b317a service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:13.083825 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 922/1846] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:58:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:58:13.117710 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70665b13-6adf-440f-b5ba-e4f3fc2be1b0 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:13.119379 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70665b13-6adf-440f-b5ba-e4f3fc2be1b0 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:13.120086 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70665b13-6adf-440f-b5ba-e4f3fc2be1b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:13.154655 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-70665b13-6adf-440f-b5ba-e4f3fc2be1b0 None None] MFA Rules not processed for user `3dc0655c8156457a8fcb006c9fe85eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:58:13.156390 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-70665b13-6adf-440f-b5ba-e4f3fc2be1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:13.272258 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 925/1847] 10.222.0.49 () {58 vars in 1018 bytes} [Sun Aug 28 00:58:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:58:13.695327 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50cbb5-e068-4a51-ae4d-92b25d2b317a service neutron] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:13.697384 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-9d50cbb5-e068-4a51-ae4d-92b25d2b317a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:13.727413 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d50cbb5-e068-4a51-ae4d-92b25d2b317a service neutron] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:13.740775 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe66fef-f006-4319-a935-0ece78f6d275 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:13.742259 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe66fef-f006-4319-a935-0ece78f6d275 service nova] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:13.745069 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe66fef-f006-4319-a935-0ece78f6d275 service nova] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:13.745671 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe66fef-f006-4319-a935-0ece78f6d275 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:13.763784 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe66fef-f006-4319-a935-0ece78f6d275 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:13.766974 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe66fef-f006-4319-a935-0ece78f6d275 service nova] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:13.787704 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 923/1848] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:58:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:58:14.338750 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70665b13-6adf-440f-b5ba-e4f3fc2be1b0 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:14.342021 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-70665b13-6adf-440f-b5ba-e4f3fc2be1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:14.376980 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70665b13-6adf-440f-b5ba-e4f3fc2be1b0 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:14.389972 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c879d1-c9ec-4ccc-aad4-39798b863537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:14.390999 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c879d1-c9ec-4ccc-aad4-39798b863537 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:14.401012 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c879d1-c9ec-4ccc-aad4-39798b863537 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:14.401357 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c879d1-c9ec-4ccc-aad4-39798b863537 admin admin] PATH_INFO: `/v3/users/036e2cc309c4482ab9d1ea38574e1951` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:14.408613 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c879d1-c9ec-4ccc-aad4-39798b863537 admin admin] RBAC: Authorizing `identity:delete_user(user_id=036e2cc309c4482ab9d1ea38574e1951)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:14.413781 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c879d1-c9ec-4ccc-aad4-39798b863537 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:14.516653 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-79c879d1-c9ec-4ccc-aad4-39798b863537 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '036e2cc309c4482ab9d1ea38574e1951'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:14.565110 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-79c879d1-c9ec-4ccc-aad4-39798b863537 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '036e2cc309c4482ab9d1ea38574e1951'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:14.595156 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-79c879d1-c9ec-4ccc-aad4-39798b863537 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '036e2cc309c4482ab9d1ea38574e1951'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:14.596546 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-79c879d1-c9ec-4ccc-aad4-39798b863537 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '036e2cc309c4482ab9d1ea38574e1951'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:14.599986 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-79c879d1-c9ec-4ccc-aad4-39798b863537 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '036e2cc309c4482ab9d1ea38574e1951'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:14.603947 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:14.640067 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 926/1849] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 00:58:14 2022] DELETE /identity/v3/users/036e2cc309c4482ab9d1ea38574e1951 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:58:14.642057 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516d484-9138-499f-b143-30d23b04efef None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:14.646681 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516d484-9138-499f-b143-30d23b04efef None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:14.646994 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516d484-9138-499f-b143-30d23b04efef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:14.690190 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-7516d484-9138-499f-b143-30d23b04efef None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:58:14.692336 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-7516d484-9138-499f-b143-30d23b04efef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:14.712292 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c879d1-c9ec-4ccc-aad4-39798b863537 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:14.715903 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-79c879d1-c9ec-4ccc-aad4-39798b863537 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:14.793276 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 924/1850] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:58:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:58:14.853550 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c879d1-c9ec-4ccc-aad4-39798b863537 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:14.861766 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee657cb-41f5-48ec-93e1-75b7131c9afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:14.861766 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee657cb-41f5-48ec-93e1-75b7131c9afe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:14.861766 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee657cb-41f5-48ec-93e1-75b7131c9afe admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:14.861766 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee657cb-41f5-48ec-93e1-75b7131c9afe admin admin] PATH_INFO: `/v3/projects/9152ef7c7b934a12b9830274ec4eaa5f` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:14.864982 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee657cb-41f5-48ec-93e1-75b7131c9afe admin admin] RBAC: Authorizing `identity:delete_project(project_id=9152ef7c7b934a12b9830274ec4eaa5f)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:14.867021 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee657cb-41f5-48ec-93e1-75b7131c9afe admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:14.878924 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7516d484-9138-499f-b143-30d23b04efef None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:14.881039 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-7516d484-9138-499f-b143-30d23b04efef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:14.901067 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:14.961828 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-7ee657cb-41f5-48ec-93e1-75b7131c9afe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9152ef7c7b934a12b9830274ec4eaa5f', 'request_id': 'req-7ee657cb-41f5-48ec-93e1-75b7131c9afe'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:14.976251 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-7ee657cb-41f5-48ec-93e1-75b7131c9afe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9152ef7c7b934a12b9830274ec4eaa5f', 'request_id': 'req-7ee657cb-41f5-48ec-93e1-75b7131c9afe'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:14.987542 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-7ee657cb-41f5-48ec-93e1-75b7131c9afe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9152ef7c7b934a12b9830274ec4eaa5f', 'request_id': 'req-7ee657cb-41f5-48ec-93e1-75b7131c9afe'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:15.006500 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-7ee657cb-41f5-48ec-93e1-75b7131c9afe admin admin] The token cache is being invalidate because project 9152ef7c7b934a12b9830274ec4eaa5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81807) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:58:15.006854 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-7ee657cb-41f5-48ec-93e1-75b7131c9afe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:15.007707 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-7ee657cb-41f5-48ec-93e1-75b7131c9afe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:15.009927 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 927/1851] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 00:58:14 2022] DELETE /identity/v3/projects/9152ef7c7b934a12b9830274ec4eaa5f => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:58:15.011308 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee657cb-41f5-48ec-93e1-75b7131c9afe admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:15.017226 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-7ee657cb-41f5-48ec-93e1-75b7131c9afe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:15.101514 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7516d484-9138-499f-b143-30d23b04efef None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:15.145423 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee657cb-41f5-48ec-93e1-75b7131c9afe admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:15.153276 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e181aea-eede-44dc-b8d3-517c390cb774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:15.153959 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e181aea-eede-44dc-b8d3-517c390cb774 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:15.154237 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e181aea-eede-44dc-b8d3-517c390cb774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:15.154523 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e181aea-eede-44dc-b8d3-517c390cb774 admin admin] PATH_INFO: `/v3/projects/8fdeccfb264843fb8e05a6616c583a57` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:15.155863 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e181aea-eede-44dc-b8d3-517c390cb774 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fdeccfb264843fb8e05a6616c583a57)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:15.158167 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e181aea-eede-44dc-b8d3-517c390cb774 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:15.221655 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f699ce2-2674-48b7-ac19-60f00c21b0c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:15.224854 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f699ce2-2674-48b7-ac19-60f00c21b0c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:15.225032 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:15.225382 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f699ce2-2674-48b7-ac19-60f00c21b0c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:15.226423 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f699ce2-2674-48b7-ac19-60f00c21b0c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:15.230454 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-8f699ce2-2674-48b7-ac19-60f00c21b0c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:15.251082 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f699ce2-2674-48b7-ac19-60f00c21b0c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:15.254671 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f699ce2-2674-48b7-ac19-60f00c21b0c9 service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:15.277360 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 925/1852] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:58:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 00:58:15.279013 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd811ad7-b418-4a8c-a6a5-d3c5dc70b506 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:15.279302 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd811ad7-b418-4a8c-a6a5-d3c5dc70b506 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:15.279584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd811ad7-b418-4a8c-a6a5-d3c5dc70b506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:15.310533 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-bd811ad7-b418-4a8c-a6a5-d3c5dc70b506 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:58:15.311383 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-6e181aea-eede-44dc-b8d3-517c390cb774 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fdeccfb264843fb8e05a6616c583a57', 'request_id': 'req-6e181aea-eede-44dc-b8d3-517c390cb774'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:15.312081 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-bd811ad7-b418-4a8c-a6a5-d3c5dc70b506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:15.319928 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-6e181aea-eede-44dc-b8d3-517c390cb774 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fdeccfb264843fb8e05a6616c583a57', 'request_id': 'req-6e181aea-eede-44dc-b8d3-517c390cb774'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:15.333440 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-6e181aea-eede-44dc-b8d3-517c390cb774 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fdeccfb264843fb8e05a6616c583a57', 'request_id': 'req-6e181aea-eede-44dc-b8d3-517c390cb774'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:15.359368 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-6e181aea-eede-44dc-b8d3-517c390cb774 admin admin] The token cache is being invalidate because project 8fdeccfb264843fb8e05a6616c583a57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81807) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:58:15.363908 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-6e181aea-eede-44dc-b8d3-517c390cb774 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:15.365060 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-6e181aea-eede-44dc-b8d3-517c390cb774 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:15.367330 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 928/1853] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 00:58:15 2022] DELETE /identity/v3/projects/8fdeccfb264843fb8e05a6616c583a57 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:58:15.371919 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e181aea-eede-44dc-b8d3-517c390cb774 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:15.374163 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-6e181aea-eede-44dc-b8d3-517c390cb774 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:15.489788 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e181aea-eede-44dc-b8d3-517c390cb774 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:15.490386 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 926/1854] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:58:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:58:15.501231 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38b13f-61a7-496c-bdc0-82f0049b5680 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:15.501640 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38b13f-61a7-496c-bdc0-82f0049b5680 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:15.502235 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38b13f-61a7-496c-bdc0-82f0049b5680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:15.505034 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20acd191-72a0-4bbb-8ced-b99c43074ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:15.506363 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20acd191-72a0-4bbb-8ced-b99c43074ab7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:15.506852 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20acd191-72a0-4bbb-8ced-b99c43074ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:15.507373 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20acd191-72a0-4bbb-8ced-b99c43074ab7 admin admin] PATH_INFO: `/v3/users/dabd2a1a373b40bdb4dee30510a5364a` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:15.509774 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20acd191-72a0-4bbb-8ced-b99c43074ab7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dabd2a1a373b40bdb4dee30510a5364a)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:15.513998 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20acd191-72a0-4bbb-8ced-b99c43074ab7 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:15.557460 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-eb38b13f-61a7-496c-bdc0-82f0049b5680 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:58:15.562348 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-eb38b13f-61a7-496c-bdc0-82f0049b5680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:15.595718 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 927/1855] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:58:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:58:15.597233 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb38b13f-61a7-496c-bdc0-82f0049b5680 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:15.623962 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-20acd191-72a0-4bbb-8ced-b99c43074ab7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dabd2a1a373b40bdb4dee30510a5364a'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:15.626203 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb38b13f-61a7-496c-bdc0-82f0049b5680 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:15.646064 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a44d32-1f7e-4821-b5eb-704d80c4e1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:15.647059 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a44d32-1f7e-4821-b5eb-704d80c4e1c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:15.647382 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a44d32-1f7e-4821-b5eb-704d80c4e1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:15.647738 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a44d32-1f7e-4821-b5eb-704d80c4e1c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:15.647861 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-20acd191-72a0-4bbb-8ced-b99c43074ab7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dabd2a1a373b40bdb4dee30510a5364a'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:15.648608 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a44d32-1f7e-4821-b5eb-704d80c4e1c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:58:15.648985 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a44d32-1f7e-4821-b5eb-704d80c4e1c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:15.651349 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a44d32-1f7e-4821-b5eb-704d80c4e1c3 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:15.660216 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-20acd191-72a0-4bbb-8ced-b99c43074ab7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dabd2a1a373b40bdb4dee30510a5364a'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:15.662239 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-20acd191-72a0-4bbb-8ced-b99c43074ab7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dabd2a1a373b40bdb4dee30510a5364a'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:15.664634 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-20acd191-72a0-4bbb-8ced-b99c43074ab7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dabd2a1a373b40bdb4dee30510a5364a'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:15.691065 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 928/1856] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 00:58:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:58:15.691359 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 929/1857] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 00:58:15 2022] DELETE /identity/v3/users/dabd2a1a373b40bdb4dee30510a5364a => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:58:15.692471 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a44d32-1f7e-4821-b5eb-704d80c4e1c3 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:15.694559 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-e6a44d32-1f7e-4821-b5eb-704d80c4e1c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:15.714519 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a44d32-1f7e-4821-b5eb-704d80c4e1c3 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:15.796961 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:15.825134 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63fba43-cb7d-4f32-8cd5-079aec98cde4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:15.825785 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63fba43-cb7d-4f32-8cd5-079aec98cde4 admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:15.826128 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63fba43-cb7d-4f32-8cd5-079aec98cde4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:15.826563 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63fba43-cb7d-4f32-8cd5-079aec98cde4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:15.827610 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63fba43-cb7d-4f32-8cd5-079aec98cde4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:15.829777 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63fba43-cb7d-4f32-8cd5-079aec98cde4 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:15.884721 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 929/1858] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 00:58:15 2022] POST /identity/v3/projects => generated 367 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:58:15.890351 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20acd191-72a0-4bbb-8ced-b99c43074ab7 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:15.916219 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20acd191-72a0-4bbb-8ced-b99c43074ab7 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:16.020631 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:16.098058 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63fba43-cb7d-4f32-8cd5-079aec98cde4 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:16.101023 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-e63fba43-cb7d-4f32-8cd5-079aec98cde4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:16.123547 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd6f989-8ee2-4550-8eff-930567db2961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:16.124356 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd6f989-8ee2-4550-8eff-930567db2961 admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:16.124640 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd6f989-8ee2-4550-8eff-930567db2961 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:16.126828 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd6f989-8ee2-4550-8eff-930567db2961 admin admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:16.130831 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd6f989-8ee2-4550-8eff-930567db2961 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:16.149990 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63fba43-cb7d-4f32-8cd5-079aec98cde4 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:16.155049 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd6f989-8ee2-4550-8eff-930567db2961 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:16.172945 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0156de-3345-48f2-9663-9de8bce37aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:16.173711 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0156de-3345-48f2-9663-9de8bce37aec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:16.175481 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0156de-3345-48f2-9663-9de8bce37aec admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:16.175809 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0156de-3345-48f2-9663-9de8bce37aec admin admin] PATH_INFO: `/v3/projects/bfdde7f2f0f34d55a1439ecb884a5c4c` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:16.186430 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0156de-3345-48f2-9663-9de8bce37aec admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfdde7f2f0f34d55a1439ecb884a5c4c)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:16.198134 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0156de-3345-48f2-9663-9de8bce37aec admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:16.214452 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 930/1859] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 00:58:15 2022] POST /identity/v3/users => generated 284 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:58:16.219063 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd6f989-8ee2-4550-8eff-930567db2961 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:16.247570 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd6f989-8ee2-4550-8eff-930567db2961 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:16.272285 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30841026-c644-4d46-8d2e-2732a1772681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:16.273370 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30841026-c644-4d46-8d2e-2732a1772681 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:16.274005 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30841026-c644-4d46-8d2e-2732a1772681 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:16.274491 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30841026-c644-4d46-8d2e-2732a1772681 admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:16.275349 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30841026-c644-4d46-8d2e-2732a1772681 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:16.277272 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30841026-c644-4d46-8d2e-2732a1772681 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:16.313282 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 931/1860] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:58:16 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:58:16.314406 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30841026-c644-4d46-8d2e-2732a1772681 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:16.341847 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30841026-c644-4d46-8d2e-2732a1772681 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:16.386439 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-2e0156de-3345-48f2-9663-9de8bce37aec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfdde7f2f0f34d55a1439ecb884a5c4c', 'request_id': 'req-2e0156de-3345-48f2-9663-9de8bce37aec'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:16.428362 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-2e0156de-3345-48f2-9663-9de8bce37aec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfdde7f2f0f34d55a1439ecb884a5c4c', 'request_id': 'req-2e0156de-3345-48f2-9663-9de8bce37aec'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:16.456859 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-2e0156de-3345-48f2-9663-9de8bce37aec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfdde7f2f0f34d55a1439ecb884a5c4c', 'request_id': 'req-2e0156de-3345-48f2-9663-9de8bce37aec'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:16.482528 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db0b24c-7763-491b-b9a0-a52215529a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:16.483499 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db0b24c-7763-491b-b9a0-a52215529a6b admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:16.483990 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db0b24c-7763-491b-b9a0-a52215529a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:16.484369 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db0b24c-7763-491b-b9a0-a52215529a6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:16.485313 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db0b24c-7763-491b-b9a0-a52215529a6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:16.487325 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db0b24c-7763-491b-b9a0-a52215529a6b admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:16.495081 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-2e0156de-3345-48f2-9663-9de8bce37aec admin admin] The token cache is being invalidate because project bfdde7f2f0f34d55a1439ecb884a5c4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81808) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:58:16.495553 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-2e0156de-3345-48f2-9663-9de8bce37aec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:16.501604 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-2e0156de-3345-48f2-9663-9de8bce37aec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:16.504094 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 932/1861] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:58:16 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:58:16.509910 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db0b24c-7763-491b-b9a0-a52215529a6b admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:16.510690 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 930/1862] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 00:58:16 2022] DELETE /identity/v3/projects/bfdde7f2f0f34d55a1439ecb884a5c4c => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:58:16.514440 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-9db0b24c-7763-491b-b9a0-a52215529a6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:16.518511 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e1f41-2811-4179-8e0f-a66f9f1ef922 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:16.519010 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e1f41-2811-4179-8e0f-a66f9f1ef922 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:16.519476 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e1f41-2811-4179-8e0f-a66f9f1ef922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:16.543366 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db0b24c-7763-491b-b9a0-a52215529a6b admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:16.558896 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ea65a-762c-4811-98f6-919515c8b1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:16.560194 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ea65a-762c-4811-98f6-919515c8b1bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:16.560194 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ea65a-762c-4811-98f6-919515c8b1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:16.560194 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ea65a-762c-4811-98f6-919515c8b1bf admin admin] PATH_INFO: `/v3/projects/3fb88bc542e24355ac01b2f8326d0198/users/e59b3267eb4344219ab45b2e9eb38515/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:16.579017 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-ad7e1f41-2811-4179-8e0f-a66f9f1ef922 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:58:16.580367 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-ad7e1f41-2811-4179-8e0f-a66f9f1ef922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:16.583476 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ea65a-762c-4811-98f6-919515c8b1bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fb88bc542e24355ac01b2f8326d0198, user_id=e59b3267eb4344219ab45b2e9eb38515, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:16.588513 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ea65a-762c-4811-98f6-919515c8b1bf admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:16.601004 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 931/1863] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:58:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:58:16.616930 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590bd54-7477-4eff-bd71-5c6591b28fdd None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:16.622144 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590bd54-7477-4eff-bd71-5c6591b28fdd None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:16.623304 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590bd54-7477-4eff-bd71-5c6591b28fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:16.631374 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 933/1864] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 00:58:16 2022] PUT /identity/v3/projects/3fb88bc542e24355ac01b2f8326d0198/users/e59b3267eb4344219ab45b2e9eb38515/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:58:16.654669 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735d4c2-461d-4539-b2bc-4fb164899200 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:16.655011 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735d4c2-461d-4539-b2bc-4fb164899200 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:16.655228 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735d4c2-461d-4539-b2bc-4fb164899200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:16.696494 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-5590bd54-7477-4eff-bd71-5c6591b28fdd None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:58:16.699843 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-5590bd54-7477-4eff-bd71-5c6591b28fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:16.785255 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-4735d4c2-461d-4539-b2bc-4fb164899200 None None] MFA Rules not processed for user `e59b3267eb4344219ab45b2e9eb38515`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:58:16.786736 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-4735d4c2-461d-4539-b2bc-4fb164899200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:16.941785 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 934/1865] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:58:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:58:16.964413 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4735d4c2-461d-4539-b2bc-4fb164899200 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:16.965894 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 932/1866] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:58:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:58:16.970521 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-4735d4c2-461d-4539-b2bc-4fb164899200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:16.971605 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5590bd54-7477-4eff-bd71-5c6591b28fdd None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:16.999722 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5590bd54-7477-4eff-bd71-5c6591b28fdd None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:17.007039 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ef1476-15ff-469c-84b2-496d10b7a787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:17.007996 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef1476-15ff-469c-84b2-496d10b7a787 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:17.008294 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef1476-15ff-469c-84b2-496d10b7a787 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:17.008585 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef1476-15ff-469c-84b2-496d10b7a787 admin admin] PATH_INFO: `/v3/domains` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:17.013261 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ef1476-15ff-469c-84b2-496d10b7a787 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:58:17.013800 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ef1476-15ff-469c-84b2-496d10b7a787 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:17.020754 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:17.021080 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ef1476-15ff-469c-84b2-496d10b7a787 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:17.062647 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 933/1867] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 00:58:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:58:17.068478 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ef1476-15ff-469c-84b2-496d10b7a787 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:17.111231 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ef1476-15ff-469c-84b2-496d10b7a787 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:17.140623 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dfbcde-20d2-438f-bb19-da5aeeb3512e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:17.140623 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dfbcde-20d2-438f-bb19-da5aeeb3512e admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:17.140623 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dfbcde-20d2-438f-bb19-da5aeeb3512e admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:17.140623 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dfbcde-20d2-438f-bb19-da5aeeb3512e admin admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:17.144997 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dfbcde-20d2-438f-bb19-da5aeeb3512e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:17.144997 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dfbcde-20d2-438f-bb19-da5aeeb3512e admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:17.242258 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 934/1868] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 00:58:17 2022] POST /identity/v3/projects => generated 361 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:58:17.245933 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dfbcde-20d2-438f-bb19-da5aeeb3512e admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:17.248264 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4735d4c2-461d-4539-b2bc-4fb164899200 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:17.325730 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:17.401730 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3067a8a2-a2f7-4be1-bf5a-1298433cb719 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:17.402596 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067a8a2-a2f7-4be1-bf5a-1298433cb719 service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:17.402975 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067a8a2-a2f7-4be1-bf5a-1298433cb719 service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:17.403452 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067a8a2-a2f7-4be1-bf5a-1298433cb719 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:17.513342 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dfbcde-20d2-438f-bb19-da5aeeb3512e admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:17.533270 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9036bae-377b-46dc-a24d-ec6a0ed877e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:17.539726 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9036bae-377b-46dc-a24d-ec6a0ed877e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:17.550554 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9036bae-377b-46dc-a24d-ec6a0ed877e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:17.551875 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9036bae-377b-46dc-a24d-ec6a0ed877e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:17.555574 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9036bae-377b-46dc-a24d-ec6a0ed877e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:17.567183 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9036bae-377b-46dc-a24d-ec6a0ed877e9 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:17.618426 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3067a8a2-a2f7-4be1-bf5a-1298433cb719 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:17.620739 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3067a8a2-a2f7-4be1-bf5a-1298433cb719 service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:17.648611 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 935/1869] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:58:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 685 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:58:17.653404 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3067a8a2-a2f7-4be1-bf5a-1298433cb719 service neutron] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:17.654675 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-3067a8a2-a2f7-4be1-bf5a-1298433cb719 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:17.664052 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 935/1870] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 00:58:17 2022] POST /identity/v3/users => generated 281 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:58:17.664714 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9036bae-377b-46dc-a24d-ec6a0ed877e9 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:17.701582 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3067a8a2-a2f7-4be1-bf5a-1298433cb719 service neutron] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:17.703343 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9036bae-377b-46dc-a24d-ec6a0ed877e9 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:17.725527 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257146ac-27fb-4f2a-9524-f9cda242144f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:17.726192 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257146ac-27fb-4f2a-9524-f9cda242144f admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:17.726465 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257146ac-27fb-4f2a-9524-f9cda242144f admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:17.726762 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257146ac-27fb-4f2a-9524-f9cda242144f admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:17.727639 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257146ac-27fb-4f2a-9524-f9cda242144f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:17.729433 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257146ac-27fb-4f2a-9524-f9cda242144f admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:17.731166 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d5af30-482e-4bbc-a4b8-0205310596f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:17.732043 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5af30-482e-4bbc-a4b8-0205310596f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:17.732460 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5af30-482e-4bbc-a4b8-0205310596f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:17.732822 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d5af30-482e-4bbc-a4b8-0205310596f5 admin admin] PATH_INFO: `/v3/projects/b715577b6d314593860e1ab80fc5340b` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:17.734705 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d5af30-482e-4bbc-a4b8-0205310596f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b715577b6d314593860e1ab80fc5340b)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:17.737515 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d5af30-482e-4bbc-a4b8-0205310596f5 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:17.755492 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 936/1871] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:58:17 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:58:17.756597 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257146ac-27fb-4f2a-9524-f9cda242144f admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:17.784784 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257146ac-27fb-4f2a-9524-f9cda242144f admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:17.796890 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94edcfd-8a6f-4a37-adc5-b064d6ab2697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:17.798184 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94edcfd-8a6f-4a37-adc5-b064d6ab2697 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:17.799147 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94edcfd-8a6f-4a37-adc5-b064d6ab2697 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:17.799425 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94edcfd-8a6f-4a37-adc5-b064d6ab2697 admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:17.802259 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94edcfd-8a6f-4a37-adc5-b064d6ab2697 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:17.808819 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94edcfd-8a6f-4a37-adc5-b064d6ab2697 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:17.838286 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 937/1872] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:58:17 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:58:17.845301 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94edcfd-8a6f-4a37-adc5-b064d6ab2697 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:17.871024 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94edcfd-8a6f-4a37-adc5-b064d6ab2697 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:17.940621 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-02d5af30-482e-4bbc-a4b8-0205310596f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b715577b6d314593860e1ab80fc5340b', 'request_id': 'req-02d5af30-482e-4bbc-a4b8-0205310596f5'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:17.958267 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-02d5af30-482e-4bbc-a4b8-0205310596f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b715577b6d314593860e1ab80fc5340b', 'request_id': 'req-02d5af30-482e-4bbc-a4b8-0205310596f5'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:17.976683 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-02d5af30-482e-4bbc-a4b8-0205310596f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b715577b6d314593860e1ab80fc5340b', 'request_id': 'req-02d5af30-482e-4bbc-a4b8-0205310596f5'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:18.008069 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-02d5af30-482e-4bbc-a4b8-0205310596f5 admin admin] The token cache is being invalidate because project b715577b6d314593860e1ab80fc5340b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81807) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:58:18.008378 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-02d5af30-482e-4bbc-a4b8-0205310596f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:18.011223 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-02d5af30-482e-4bbc-a4b8-0205310596f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:18.019606 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 936/1873] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 00:58:17 2022] DELETE /identity/v3/projects/b715577b6d314593860e1ab80fc5340b => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:58:18.021597 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32b357-b249-461f-9c3d-01a91fd8e6cb None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:18.021884 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32b357-b249-461f-9c3d-01a91fd8e6cb None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:18.022156 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32b357-b249-461f-9c3d-01a91fd8e6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:18.049844 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:18.061600 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33c571-7e76-4508-936d-885e0c481e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:18.066866 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33c571-7e76-4508-936d-885e0c481e47 admin admin] REQUEST_METHOD: `PUT` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:18.069450 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33c571-7e76-4508-936d-885e0c481e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:18.070231 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33c571-7e76-4508-936d-885e0c481e47 admin admin] PATH_INFO: `/v3/projects/cb514dd4797f4f898d52148ff65ba41e/users/35da3e3737ca4fee90b22924a9441e23/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:18.088769 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-ac32b357-b249-461f-9c3d-01a91fd8e6cb None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:58:18.093501 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-ac32b357-b249-461f-9c3d-01a91fd8e6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:18.109971 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec33c571-7e76-4508-936d-885e0c481e47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb514dd4797f4f898d52148ff65ba41e, user_id=35da3e3737ca4fee90b22924a9441e23, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:18.113209 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec33c571-7e76-4508-936d-885e0c481e47 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:18.123712 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 937/1874] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:58:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:58:18.142022 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a7fe0-519f-4563-9736-66bf23bf54e9 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:18.143052 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a7fe0-519f-4563-9736-66bf23bf54e9 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:18.143866 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a7fe0-519f-4563-9736-66bf23bf54e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:18.145755 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 938/1875] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 00:58:17 2022] PUT /identity/v3/projects/cb514dd4797f4f898d52148ff65ba41e/users/35da3e3737ca4fee90b22924a9441e23/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:58:18.158597 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84228b64-633f-4230-bb84-7220c342c1a7 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:18.158862 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84228b64-633f-4230-bb84-7220c342c1a7 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:18.159225 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84228b64-633f-4230-bb84-7220c342c1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:18.224820 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-c21a7fe0-519f-4563-9736-66bf23bf54e9 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:58:18.234692 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-c21a7fe0-519f-4563-9736-66bf23bf54e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:18.241680 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-84228b64-633f-4230-bb84-7220c342c1a7 None None] MFA Rules not processed for user `35da3e3737ca4fee90b22924a9441e23`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:58:18.243020 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-84228b64-633f-4230-bb84-7220c342c1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:18.419636 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:18.439548 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 939/1876] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:58:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:58:18.521875 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84228b64-633f-4230-bb84-7220c342c1a7 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:18.524510 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-84228b64-633f-4230-bb84-7220c342c1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:18.553445 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 938/1877] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:58:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:58:18.557861 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a7fe0-519f-4563-9736-66bf23bf54e9 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:18.618303 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a7fe0-519f-4563-9736-66bf23bf54e9 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:18.627113 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84228b64-633f-4230-bb84-7220c342c1a7 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:18.629241 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb76d2d-f81b-431c-8927-f1674f882fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:18.630624 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb76d2d-f81b-431c-8927-f1674f882fe7 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:18.631194 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb76d2d-f81b-431c-8927-f1674f882fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:18.631778 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb76d2d-f81b-431c-8927-f1674f882fe7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:18.632821 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02311dc1-3f08-48a6-8af4-e3d11a7c12a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:18.633510 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb76d2d-f81b-431c-8927-f1674f882fe7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:58:18.634003 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02311dc1-3f08-48a6-8af4-e3d11a7c12a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:18.634405 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb76d2d-f81b-431c-8927-f1674f882fe7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:18.634569 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02311dc1-3f08-48a6-8af4-e3d11a7c12a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:18.634964 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02311dc1-3f08-48a6-8af4-e3d11a7c12a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:18.637766 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb76d2d-f81b-431c-8927-f1674f882fe7 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:18.646606 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02311dc1-3f08-48a6-8af4-e3d11a7c12a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:18.648759 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02311dc1-3f08-48a6-8af4-e3d11a7c12a8 service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:18.661896 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 940/1878] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:58:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 00:58:18.671133 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 939/1879] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 00:58:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 00:58:18.676731 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02311dc1-3f08-48a6-8af4-e3d11a7c12a8 service neutron] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:18.703224 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0877ac-8c66-483f-a1e3-f7fd3634e469 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:18.703517 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0877ac-8c66-483f-a1e3-f7fd3634e469 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:18.703982 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0877ac-8c66-483f-a1e3-f7fd3634e469 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:18.706002 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 940/1880] 10.222.0.49 () {54 vars in 921 bytes} [Sun Aug 28 00:58:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 28 00:58:18.710506 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02311dc1-3f08-48a6-8af4-e3d11a7c12a8 service neutron] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:18.734595 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c40b49-fb86-4de8-9cd7-be0e695dfeaf None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:18.734595 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c40b49-fb86-4de8-9cd7-be0e695dfeaf None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:18.734595 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c40b49-fb86-4de8-9cd7-be0e695dfeaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:18.753912 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad71ce17-a6fa-4e81-a550-64aeff14f075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:18.755825 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71ce17-a6fa-4e81-a550-64aeff14f075 admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:18.756490 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71ce17-a6fa-4e81-a550-64aeff14f075 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:18.757101 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71ce17-a6fa-4e81-a550-64aeff14f075 admin admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:18.759429 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad71ce17-a6fa-4e81-a550-64aeff14f075 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:18.764791 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad71ce17-a6fa-4e81-a550-64aeff14f075 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:18.780697 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-f3c40b49-fb86-4de8-9cd7-be0e695dfeaf None None] MFA Rules not processed for user `3dc0655c8156457a8fcb006c9fe85eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:58:18.782299 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-f3c40b49-fb86-4de8-9cd7-be0e695dfeaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:18.892914 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 941/1881] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 00:58:18 2022] POST /identity/v3/projects => generated 369 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:58:18.899925 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad71ce17-a6fa-4e81-a550-64aeff14f075 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:18.980039 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 941/1882] 10.222.0.49 () {58 vars in 1018 bytes} [Sun Aug 28 00:58:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:58:19.145983 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad71ce17-a6fa-4e81-a550-64aeff14f075 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:19.163202 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87049e44-5815-4d1b-85a8-b5d0bde88a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:19.166553 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87049e44-5815-4d1b-85a8-b5d0bde88a2a admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:19.166772 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87049e44-5815-4d1b-85a8-b5d0bde88a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:19.168266 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87049e44-5815-4d1b-85a8-b5d0bde88a2a admin admin] PATH_INFO: `/v3/users` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:19.169890 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87049e44-5815-4d1b-85a8-b5d0bde88a2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:19.177958 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87049e44-5815-4d1b-85a8-b5d0bde88a2a admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:19.273090 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 942/1883] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 00:58:18 2022] POST /identity/v3/users => generated 285 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:58:19.278283 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c40b49-fb86-4de8-9cd7-be0e695dfeaf None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:19.305386 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87049e44-5815-4d1b-85a8-b5d0bde88a2a admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:19.308703 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-87049e44-5815-4d1b-85a8-b5d0bde88a2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:19.310336 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c40b49-fb86-4de8-9cd7-be0e695dfeaf None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:19.333962 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e891a798-2816-47dd-b575-8992ebba4da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:19.335278 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e891a798-2816-47dd-b575-8992ebba4da4 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:19.335972 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e891a798-2816-47dd-b575-8992ebba4da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:19.336661 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e891a798-2816-47dd-b575-8992ebba4da4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:19.338125 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e891a798-2816-47dd-b575-8992ebba4da4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:19.342723 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e891a798-2816-47dd-b575-8992ebba4da4 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:19.393559 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 942/1884] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:58:19.399808 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e891a798-2816-47dd-b575-8992ebba4da4 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:19.443187 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e891a798-2816-47dd-b575-8992ebba4da4 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:19.459200 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b48cb71-34e9-4d8b-9303-3cee402d6014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:19.461612 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b48cb71-34e9-4d8b-9303-3cee402d6014 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:19.462235 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b48cb71-34e9-4d8b-9303-3cee402d6014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:19.463628 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b48cb71-34e9-4d8b-9303-3cee402d6014 admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:19.465750 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b48cb71-34e9-4d8b-9303-3cee402d6014 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:19.470856 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b48cb71-34e9-4d8b-9303-3cee402d6014 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:19.476606 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:19.506145 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 943/1885] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:58:19.506360 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87049e44-5815-4d1b-85a8-b5d0bde88a2a admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:19.507973 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b48cb71-34e9-4d8b-9303-3cee402d6014 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:19.521736 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b48cb71-34e9-4d8b-9303-3cee402d6014 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:19.538014 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a7a4ba-6cde-4acb-b805-371d5119ca7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:19.538701 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7a4ba-6cde-4acb-b805-371d5119ca7e service nova] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:19.539350 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7a4ba-6cde-4acb-b805-371d5119ca7e service nova] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:19.539646 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7a4ba-6cde-4acb-b805-371d5119ca7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:19.540504 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99448ef-4646-499b-862d-d7b47f13f008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:19.541791 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99448ef-4646-499b-862d-d7b47f13f008 admin admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:19.542262 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99448ef-4646-499b-862d-d7b47f13f008 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:19.542791 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99448ef-4646-499b-862d-d7b47f13f008 admin admin] PATH_INFO: `/v3/projects/3b76abd35de3459b85bc25992edeecfd/users/2ea720a26a2b478aa32d63c5e706a12b/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:19.560611 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a7a4ba-6cde-4acb-b805-371d5119ca7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:19.562326 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a7a4ba-6cde-4acb-b805-371d5119ca7e service nova] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:19.603331 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99448ef-4646-499b-862d-d7b47f13f008 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b76abd35de3459b85bc25992edeecfd, user_id=2ea720a26a2b478aa32d63c5e706a12b, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:19.614820 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99448ef-4646-499b-862d-d7b47f13f008 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:19.617333 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 943/1886] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:58:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:58:19.660910 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 944/1887] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 00:58:19 2022] PUT /identity/v3/projects/3b76abd35de3459b85bc25992edeecfd/users/2ea720a26a2b478aa32d63c5e706a12b/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:58:19.682847 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79023146-a600-464b-88fc-16fcc1714967 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:19.684575 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79023146-a600-464b-88fc-16fcc1714967 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:19.686585 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79023146-a600-464b-88fc-16fcc1714967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:19.789226 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-79023146-a600-464b-88fc-16fcc1714967 None None] MFA Rules not processed for user `2ea720a26a2b478aa32d63c5e706a12b`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:58:19.790547 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-79023146-a600-464b-88fc-16fcc1714967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:20.019620 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99448ef-4646-499b-862d-d7b47f13f008 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:20.021955 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 944/1888] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:58:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:58:20.134383 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:20.191192 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99448ef-4646-499b-862d-d7b47f13f008 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:20.196306 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbb1cc2-00c9-4b89-928b-d035a7df565a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:20.197158 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb1cc2-00c9-4b89-928b-d035a7df565a admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:20.199322 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb1cc2-00c9-4b89-928b-d035a7df565a admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:20.200476 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb1cc2-00c9-4b89-928b-d035a7df565a admin admin] PATH_INFO: `/v3/projects` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:20.201339 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbb1cc2-00c9-4b89-928b-d035a7df565a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:20.208904 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbb1cc2-00c9-4b89-928b-d035a7df565a admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:20.258563 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 945/1889] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 00:58:20 2022] POST /identity/v3/projects => generated 369 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:58:20.263568 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79023146-a600-464b-88fc-16fcc1714967 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:20.298989 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79023146-a600-464b-88fc-16fcc1714967 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:20.402967 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b92eec8-e030-4824-b311-f7e79000ecec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:20.404640 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b92eec8-e030-4824-b311-f7e79000ecec admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:20.405070 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b92eec8-e030-4824-b311-f7e79000ecec admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:20.405499 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b92eec8-e030-4824-b311-f7e79000ecec admin admin] PATH_INFO: `/v3/users` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:20.406312 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b92eec8-e030-4824-b311-f7e79000ecec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:20.408747 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b92eec8-e030-4824-b311-f7e79000ecec admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:20.449704 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 945/1890] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 00:58:20 2022] POST /identity/v3/users => generated 291 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:58:20.450579 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbb1cc2-00c9-4b89-928b-d035a7df565a admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:20.468016 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbb1cc2-00c9-4b89-928b-d035a7df565a admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:20.500323 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8853282-fb70-4a9a-88eb-87afa5a79837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:20.501492 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8853282-fb70-4a9a-88eb-87afa5a79837 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:20.503172 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8853282-fb70-4a9a-88eb-87afa5a79837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:20.503935 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8853282-fb70-4a9a-88eb-87afa5a79837 admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:20.506505 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8853282-fb70-4a9a-88eb-87afa5a79837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:20.508708 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8853282-fb70-4a9a-88eb-87afa5a79837 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:20.541030 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 946/1891] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:58:20.545697 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b92eec8-e030-4824-b311-f7e79000ecec admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:20.560200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b92eec8-e030-4824-b311-f7e79000ecec admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:20.575520 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb2793d-c996-4065-a47b-af1635ee557a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:20.576256 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2793d-c996-4065-a47b-af1635ee557a admin admin] REQUEST_METHOD: `PUT` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:20.577249 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2793d-c996-4065-a47b-af1635ee557a admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:20.577545 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2793d-c996-4065-a47b-af1635ee557a admin admin] PATH_INFO: `/v3/projects/74187486da374bf7a13c40cf040712a7/users/0cbf466bd0514dd5a2bc8b7d9832ee98/roles/2e4889bb71f9434392c0baba59f2534e` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:20.614443 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb2793d-c996-4065-a47b-af1635ee557a admin admin] RBAC: Authorizing `identity:create_grant(project_id=74187486da374bf7a13c40cf040712a7, user_id=0cbf466bd0514dd5a2bc8b7d9832ee98, role_id=2e4889bb71f9434392c0baba59f2534e)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:20.617700 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb2793d-c996-4065-a47b-af1635ee557a admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:20.644609 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 946/1892] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 00:58:20 2022] PUT /identity/v3/projects/74187486da374bf7a13c40cf040712a7/users/0cbf466bd0514dd5a2bc8b7d9832ee98/roles/2e4889bb71f9434392c0baba59f2534e => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:58:20.646087 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8853282-fb70-4a9a-88eb-87afa5a79837 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:20.662053 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8853282-fb70-4a9a-88eb-87afa5a79837 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:20.824551 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e23134-762c-4166-8cd9-71c035743c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:20.825395 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e23134-762c-4166-8cd9-71c035743c4e admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:20.825684 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e23134-762c-4166-8cd9-71c035743c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:20.826179 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e23134-762c-4166-8cd9-71c035743c4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:20.827841 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e23134-762c-4166-8cd9-71c035743c4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:20.829803 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e23134-762c-4166-8cd9-71c035743c4e admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:20.853861 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb2793d-c996-4065-a47b-af1635ee557a admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:20.865125 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 947/1893] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 00:58:20.868494 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb2793d-c996-4065-a47b-af1635ee557a admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:20.874158 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59554fe-02a5-4d75-b47e-de8b961fb3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:20.875027 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59554fe-02a5-4d75-b47e-de8b961fb3a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:20.875320 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59554fe-02a5-4d75-b47e-de8b961fb3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:20.875598 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59554fe-02a5-4d75-b47e-de8b961fb3a1 admin admin] PATH_INFO: `/v3/projects/74187486da374bf7a13c40cf040712a7/users/0cbf466bd0514dd5a2bc8b7d9832ee98/roles/2e4889bb71f9434392c0baba59f2534e` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:20.878491 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59554fe-02a5-4d75-b47e-de8b961fb3a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74187486da374bf7a13c40cf040712a7, user_id=0cbf466bd0514dd5a2bc8b7d9832ee98, role_id=2e4889bb71f9434392c0baba59f2534e)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:20.881372 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59554fe-02a5-4d75-b47e-de8b961fb3a1 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:20.924159 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 947/1894] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 00:58:20 2022] PUT /identity/v3/projects/74187486da374bf7a13c40cf040712a7/users/0cbf466bd0514dd5a2bc8b7d9832ee98/roles/2e4889bb71f9434392c0baba59f2534e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:58:20.926639 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3332cd5d-8e40-4f3f-935f-0c37000d42fd None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:20.927037 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3332cd5d-8e40-4f3f-935f-0c37000d42fd None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:20.927195 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3332cd5d-8e40-4f3f-935f-0c37000d42fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:20.983399 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-3332cd5d-8e40-4f3f-935f-0c37000d42fd None None] MFA Rules not processed for user `0cbf466bd0514dd5a2bc8b7d9832ee98`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:58:20.985033 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-3332cd5d-8e40-4f3f-935f-0c37000d42fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:21.072834 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 948/1895] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:58:20 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:58:21.149274 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59554fe-02a5-4d75-b47e-de8b961fb3a1 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:21.211803 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:21.243412 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59554fe-02a5-4d75-b47e-de8b961fb3a1 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:21.248887 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486a45ab-70b0-4bbd-915b-6e530e2743d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:21.250245 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a45ab-70b0-4bbd-915b-6e530e2743d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:21.250770 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a45ab-70b0-4bbd-915b-6e530e2743d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:21.251257 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a45ab-70b0-4bbd-915b-6e530e2743d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:21.269442 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486a45ab-70b0-4bbd-915b-6e530e2743d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:21.272252 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486a45ab-70b0-4bbd-915b-6e530e2743d8 service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:21.285495 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 948/1896] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:58:21 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:58:23.106656 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3332cd5d-8e40-4f3f-935f-0c37000d42fd None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:23.108674 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-3332cd5d-8e40-4f3f-935f-0c37000d42fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:23.157313 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:23.242979 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3332cd5d-8e40-4f3f-935f-0c37000d42fd None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:23.248128 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21cda87-faee-464a-afd9-d40529b28c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:23.248862 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21cda87-faee-464a-afd9-d40529b28c6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:23.249238 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21cda87-faee-464a-afd9-d40529b28c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:23.249715 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21cda87-faee-464a-afd9-d40529b28c6f admin admin] PATH_INFO: `/v3/users/e216451721954177b5a7709343038ab6` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:23.252181 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21cda87-faee-464a-afd9-d40529b28c6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e216451721954177b5a7709343038ab6)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:23.255567 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21cda87-faee-464a-afd9-d40529b28c6f admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:23.322192 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-f21cda87-faee-464a-afd9-d40529b28c6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e216451721954177b5a7709343038ab6'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:23.340076 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-f21cda87-faee-464a-afd9-d40529b28c6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e216451721954177b5a7709343038ab6'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:23.352269 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-f21cda87-faee-464a-afd9-d40529b28c6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e216451721954177b5a7709343038ab6'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:23.353087 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-f21cda87-faee-464a-afd9-d40529b28c6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e216451721954177b5a7709343038ab6'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:23.353786 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-f21cda87-faee-464a-afd9-d40529b28c6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e216451721954177b5a7709343038ab6'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:23.376359 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 949/1897] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 00:58:23 2022] DELETE /identity/v3/users/e216451721954177b5a7709343038ab6 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:58:23.377357 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee17c1f-e283-44b3-a511-8f9c464296ca None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:23.377856 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee17c1f-e283-44b3-a511-8f9c464296ca None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:23.378138 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee17c1f-e283-44b3-a511-8f9c464296ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:23.406428 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-fee17c1f-e283-44b3-a511-8f9c464296ca None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:58:23.408962 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-fee17c1f-e283-44b3-a511-8f9c464296ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:23.591722 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 949/1898] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:58:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:58:23.740662 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21cda87-faee-464a-afd9-d40529b28c6f admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:23.742443 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-f21cda87-faee-464a-afd9-d40529b28c6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:23.833874 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21cda87-faee-464a-afd9-d40529b28c6f admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:23.839208 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6508d8f1-230c-4c60-9913-90c67703d5b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:23.840890 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508d8f1-230c-4c60-9913-90c67703d5b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:23.840890 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508d8f1-230c-4c60-9913-90c67703d5b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:23.840890 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508d8f1-230c-4c60-9913-90c67703d5b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:23.895797 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6508d8f1-230c-4c60-9913-90c67703d5b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:23.900496 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6508d8f1-230c-4c60-9913-90c67703d5b6 service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:23.920463 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 950/1899] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:58:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:58:24.843993 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee17c1f-e283-44b3-a511-8f9c464296ca None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:24.850868 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-fee17c1f-e283-44b3-a511-8f9c464296ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:24.921225 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee17c1f-e283-44b3-a511-8f9c464296ca None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:24.936124 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d70df9c-3805-4188-88ae-52167f6cdbca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:24.940286 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70df9c-3805-4188-88ae-52167f6cdbca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:24.957628 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70df9c-3805-4188-88ae-52167f6cdbca admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:24.963057 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d70df9c-3805-4188-88ae-52167f6cdbca admin admin] PATH_INFO: `/v3/projects/29cfb19ef5fd40878fb458e9f16508ad` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:24.968508 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d70df9c-3805-4188-88ae-52167f6cdbca admin admin] RBAC: Authorizing `identity:delete_project(project_id=29cfb19ef5fd40878fb458e9f16508ad)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:24.981005 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d70df9c-3805-4188-88ae-52167f6cdbca admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:25.121128 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-8d70df9c-3805-4188-88ae-52167f6cdbca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29cfb19ef5fd40878fb458e9f16508ad', 'request_id': 'req-8d70df9c-3805-4188-88ae-52167f6cdbca'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:25.131383 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-8d70df9c-3805-4188-88ae-52167f6cdbca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29cfb19ef5fd40878fb458e9f16508ad', 'request_id': 'req-8d70df9c-3805-4188-88ae-52167f6cdbca'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:25.144074 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-8d70df9c-3805-4188-88ae-52167f6cdbca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29cfb19ef5fd40878fb458e9f16508ad', 'request_id': 'req-8d70df9c-3805-4188-88ae-52167f6cdbca'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:25.164982 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-8d70df9c-3805-4188-88ae-52167f6cdbca admin admin] The token cache is being invalidate because project 29cfb19ef5fd40878fb458e9f16508ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81808) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:58:25.165493 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-8d70df9c-3805-4188-88ae-52167f6cdbca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:25.166645 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-8d70df9c-3805-4188-88ae-52167f6cdbca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:25.172554 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 950/1900] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 00:58:24 2022] DELETE /identity/v3/projects/29cfb19ef5fd40878fb458e9f16508ad => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:58:25.179012 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6508d8f1-230c-4c60-9913-90c67703d5b6 service neutron] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:25.198938 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6508d8f1-230c-4c60-9913-90c67703d5b6 service neutron] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:25.293743 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:25.340973 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4026b40b-e802-4d98-8f28-4d1ed98e5d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:25.342497 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026b40b-e802-4d98-8f28-4d1ed98e5d31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:25.343146 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026b40b-e802-4d98-8f28-4d1ed98e5d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:25.343731 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026b40b-e802-4d98-8f28-4d1ed98e5d31 admin admin] PATH_INFO: `/v3/users/2a4a67eb18b143fb8b36c18282ba19b8` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:25.346656 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4026b40b-e802-4d98-8f28-4d1ed98e5d31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a4a67eb18b143fb8b36c18282ba19b8)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:25.351010 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4026b40b-e802-4d98-8f28-4d1ed98e5d31 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:25.455645 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-4026b40b-e802-4d98-8f28-4d1ed98e5d31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a4a67eb18b143fb8b36c18282ba19b8'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:25.500271 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-4026b40b-e802-4d98-8f28-4d1ed98e5d31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a4a67eb18b143fb8b36c18282ba19b8'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:25.529183 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-4026b40b-e802-4d98-8f28-4d1ed98e5d31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a4a67eb18b143fb8b36c18282ba19b8'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:25.539340 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-4026b40b-e802-4d98-8f28-4d1ed98e5d31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a4a67eb18b143fb8b36c18282ba19b8'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:25.548707 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-4026b40b-e802-4d98-8f28-4d1ed98e5d31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a4a67eb18b143fb8b36c18282ba19b8'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:25.635213 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 951/1901] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 00:58:25 2022] DELETE /identity/v3/users/2a4a67eb18b143fb8b36c18282ba19b8 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:58:27.157780 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d70df9c-3805-4188-88ae-52167f6cdbca admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:27.160235 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-8d70df9c-3805-4188-88ae-52167f6cdbca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:27.207897 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d70df9c-3805-4188-88ae-52167f6cdbca admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:27.396567 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded2dd7b-9e62-4bdb-a7c5-74131b45dfed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:27.397541 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded2dd7b-9e62-4bdb-a7c5-74131b45dfed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:27.398364 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded2dd7b-9e62-4bdb-a7c5-74131b45dfed admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:27.398364 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded2dd7b-9e62-4bdb-a7c5-74131b45dfed admin admin] PATH_INFO: `/v3/projects/fca1e147c1dd40118cc92661bcfe1027` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:27.399701 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded2dd7b-9e62-4bdb-a7c5-74131b45dfed admin admin] RBAC: Authorizing `identity:delete_project(project_id=fca1e147c1dd40118cc92661bcfe1027)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:27.401760 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded2dd7b-9e62-4bdb-a7c5-74131b45dfed admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:27.403848 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:27.492633 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-ded2dd7b-9e62-4bdb-a7c5-74131b45dfed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fca1e147c1dd40118cc92661bcfe1027', 'request_id': 'req-ded2dd7b-9e62-4bdb-a7c5-74131b45dfed'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:27.498660 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-ded2dd7b-9e62-4bdb-a7c5-74131b45dfed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fca1e147c1dd40118cc92661bcfe1027', 'request_id': 'req-ded2dd7b-9e62-4bdb-a7c5-74131b45dfed'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:27.510080 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-ded2dd7b-9e62-4bdb-a7c5-74131b45dfed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fca1e147c1dd40118cc92661bcfe1027', 'request_id': 'req-ded2dd7b-9e62-4bdb-a7c5-74131b45dfed'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:27.541637 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-ded2dd7b-9e62-4bdb-a7c5-74131b45dfed admin admin] The token cache is being invalidate because project fca1e147c1dd40118cc92661bcfe1027 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81808) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:58:27.542414 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-ded2dd7b-9e62-4bdb-a7c5-74131b45dfed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:27.544336 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-ded2dd7b-9e62-4bdb-a7c5-74131b45dfed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:27.548536 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 951/1902] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 00:58:27 2022] DELETE /identity/v3/projects/fca1e147c1dd40118cc92661bcfe1027 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:58:27.555024 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6cb45-bc9f-4279-9bf0-4b8a9e7e2835 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:27.556174 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6cb45-bc9f-4279-9bf0-4b8a9e7e2835 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:27.556626 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6cb45-bc9f-4279-9bf0-4b8a9e7e2835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:27.611147 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-47d6cb45-bc9f-4279-9bf0-4b8a9e7e2835 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:58:27.613395 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-47d6cb45-bc9f-4279-9bf0-4b8a9e7e2835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:27.721344 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 952/1903] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:58:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:58:27.727504 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb66df-1b38-4b9c-a91b-d38c685882b7 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:27.727722 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb66df-1b38-4b9c-a91b-d38c685882b7 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:27.727982 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb66df-1b38-4b9c-a91b-d38c685882b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:27.774827 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-7bcb66df-1b38-4b9c-a91b-d38c685882b7 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:58:27.776687 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-7bcb66df-1b38-4b9c-a91b-d38c685882b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:27.800840 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 952/1904] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:58:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:58:27.802118 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d6cb45-bc9f-4279-9bf0-4b8a9e7e2835 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:27.823197 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d6cb45-bc9f-4279-9bf0-4b8a9e7e2835 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:27.840088 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537f08d3-863f-4996-bee9-186257600df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:27.842378 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f08d3-863f-4996-bee9-186257600df0 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:27.843384 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f08d3-863f-4996-bee9-186257600df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:27.844068 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f08d3-863f-4996-bee9-186257600df0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:27.845050 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537f08d3-863f-4996-bee9-186257600df0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:58:27.845621 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537f08d3-863f-4996-bee9-186257600df0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:27.848783 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537f08d3-863f-4996-bee9-186257600df0 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:27.886190 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 953/1905] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 00:58:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:58:27.888907 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcb66df-1b38-4b9c-a91b-d38c685882b7 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:27.910462 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcb66df-1b38-4b9c-a91b-d38c685882b7 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:27.925656 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad51cb68-ecfe-431b-9709-70cf66029dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:27.926954 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad51cb68-ecfe-431b-9709-70cf66029dd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:27.927799 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad51cb68-ecfe-431b-9709-70cf66029dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:27.928397 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad51cb68-ecfe-431b-9709-70cf66029dd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:27.931826 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad51cb68-ecfe-431b-9709-70cf66029dd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:27.940992 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad51cb68-ecfe-431b-9709-70cf66029dd4 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:28.049819 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 953/1906] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 00:58:27 2022] POST /identity/v3/projects => generated 397 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:58:28.053819 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537f08d3-863f-4996-bee9-186257600df0 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:28.081843 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537f08d3-863f-4996-bee9-186257600df0 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:28.249951 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:28.271209 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d50b2-a3b4-4f53-a78c-da3a8dd626f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:28.272196 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d50b2-a3b4-4f53-a78c-da3a8dd626f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:28.272649 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d50b2-a3b4-4f53-a78c-da3a8dd626f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:28.273226 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d50b2-a3b4-4f53-a78c-da3a8dd626f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:28.274239 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37d50b2-a3b4-4f53-a78c-da3a8dd626f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:28.276948 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37d50b2-a3b4-4f53-a78c-da3a8dd626f6 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:28.312768 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 954/1907] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 00:58:28 2022] POST /identity/v3/users => generated 299 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:58:28.313494 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad51cb68-ecfe-431b-9709-70cf66029dd4 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:28.330342 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad51cb68-ecfe-431b-9709-70cf66029dd4 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:28.336928 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f3fa5-b5b0-49bd-884d-9851f223a0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:28.338075 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f3fa5-b5b0-49bd-884d-9851f223a0ac admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:28.338528 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f3fa5-b5b0-49bd-884d-9851f223a0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:28.339179 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f3fa5-b5b0-49bd-884d-9851f223a0ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:28.340116 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033f3fa5-b5b0-49bd-884d-9851f223a0ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:28.342014 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033f3fa5-b5b0-49bd-884d-9851f223a0ac admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:28.369897 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 954/1908] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 00:58:28.373224 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d50b2-a3b4-4f53-a78c-da3a8dd626f6 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:28.399069 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d50b2-a3b4-4f53-a78c-da3a8dd626f6 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:28.412955 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2bf044-7bb8-4577-a354-f60b45cd935b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:28.413604 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2bf044-7bb8-4577-a354-f60b45cd935b admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:28.413883 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2bf044-7bb8-4577-a354-f60b45cd935b admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:28.414151 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2bf044-7bb8-4577-a354-f60b45cd935b admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:28.414814 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2bf044-7bb8-4577-a354-f60b45cd935b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:28.416508 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2bf044-7bb8-4577-a354-f60b45cd935b admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:28.430431 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 955/1909] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:58:28.435008 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f3fa5-b5b0-49bd-884d-9851f223a0ac admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:28.449284 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f3fa5-b5b0-49bd-884d-9851f223a0ac admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:28.457208 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b6b93f-6e18-4ce4-9dea-4d30a09600e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:28.457996 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b6b93f-6e18-4ce4-9dea-4d30a09600e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:28.458375 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b6b93f-6e18-4ce4-9dea-4d30a09600e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:28.458993 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b6b93f-6e18-4ce4-9dea-4d30a09600e1 admin admin] PATH_INFO: `/v3/projects/29668b160d984a1fae9d1d518f78f6e7/users/28323cb211be4e37a57a583881743bd5/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:28.483821 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b6b93f-6e18-4ce4-9dea-4d30a09600e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29668b160d984a1fae9d1d518f78f6e7, user_id=28323cb211be4e37a57a583881743bd5, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:28.487603 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b6b93f-6e18-4ce4-9dea-4d30a09600e1 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:28.515233 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 955/1910] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 00:58:28 2022] PUT /identity/v3/projects/29668b160d984a1fae9d1d518f78f6e7/users/28323cb211be4e37a57a583881743bd5/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:58:28.527221 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec12f543-f562-4bb3-afd4-5e40653e1568 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:28.528134 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec12f543-f562-4bb3-afd4-5e40653e1568 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:28.528422 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec12f543-f562-4bb3-afd4-5e40653e1568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:28.580137 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-ec12f543-f562-4bb3-afd4-5e40653e1568 None None] MFA Rules not processed for user `28323cb211be4e37a57a583881743bd5`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:58:28.582838 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-ec12f543-f562-4bb3-afd4-5e40653e1568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:28.718303 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 956/1911] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:58:28 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:58:28.766754 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b6b93f-6e18-4ce4-9dea-4d30a09600e1 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:28.768664 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-a3b6b93f-6e18-4ce4-9dea-4d30a09600e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:28.991391 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b6b93f-6e18-4ce4-9dea-4d30a09600e1 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:28.995591 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c7cd47-e2b0-4f4a-be11-875113a7e8ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:28.996268 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7cd47-e2b0-4f4a-be11-875113a7e8ae service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:28.996545 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7cd47-e2b0-4f4a-be11-875113a7e8ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:28.996873 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7cd47-e2b0-4f4a-be11-875113a7e8ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:29.008402 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c7cd47-e2b0-4f4a-be11-875113a7e8ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:29.010178 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c7cd47-e2b0-4f4a-be11-875113a7e8ae service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:29.023816 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 956/1912] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:58:28 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:58:38.714220 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=41,keystone:INSERT=3 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:39.019350 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=77,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:40.902681 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec12f543-f562-4bb3-afd4-5e40653e1568 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:40.917603 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-ec12f543-f562-4bb3-afd4-5e40653e1568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:41.106838 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec12f543-f562-4bb3-afd4-5e40653e1568 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:41.125802 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e125b6-bbf0-472c-b36a-786730007b04 tempest-RoutersAdminTest-1966155191 tempest-RoutersAdminTest-1966155191-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cbf466bd0514dd5a2bc8b7d9832ee98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74187486da374bf7a13c40cf040712a7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:41.126472 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e125b6-bbf0-472c-b36a-786730007b04 tempest-RoutersAdminTest-1966155191 tempest-RoutersAdminTest-1966155191-project-admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:41.126778 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e125b6-bbf0-472c-b36a-786730007b04 tempest-RoutersAdminTest-1966155191 tempest-RoutersAdminTest-1966155191-project-admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:41.127056 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e125b6-bbf0-472c-b36a-786730007b04 tempest-RoutersAdminTest-1966155191 tempest-RoutersAdminTest-1966155191-project-admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:41.127789 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e125b6-bbf0-472c-b36a-786730007b04 tempest-RoutersAdminTest-1966155191 tempest-RoutersAdminTest-1966155191-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:58:41.128101 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e125b6-bbf0-472c-b36a-786730007b04 tempest-RoutersAdminTest-1966155191 tempest-RoutersAdminTest-1966155191-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:41.129836 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e125b6-bbf0-472c-b36a-786730007b04 tempest-RoutersAdminTest-1966155191 tempest-RoutersAdminTest-1966155191-project-admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:41.158695 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 957/1913] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 00:58:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:58:41.163970 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c7cd47-e2b0-4f4a-be11-875113a7e8ae service neutron] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:41.187156 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c7cd47-e2b0-4f4a-be11-875113a7e8ae service neutron] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:41.198299 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47adeae-1c07-4612-8a5a-28b3356e1bd6 tempest-RoutersAdminTest-1966155191 tempest-RoutersAdminTest-1966155191-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cbf466bd0514dd5a2bc8b7d9832ee98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74187486da374bf7a13c40cf040712a7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:41.198953 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47adeae-1c07-4612-8a5a-28b3356e1bd6 tempest-RoutersAdminTest-1966155191 tempest-RoutersAdminTest-1966155191-project-admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:41.199241 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47adeae-1c07-4612-8a5a-28b3356e1bd6 tempest-RoutersAdminTest-1966155191 tempest-RoutersAdminTest-1966155191-project-admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:41.199515 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47adeae-1c07-4612-8a5a-28b3356e1bd6 tempest-RoutersAdminTest-1966155191 tempest-RoutersAdminTest-1966155191-project-admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:41.200234 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47adeae-1c07-4612-8a5a-28b3356e1bd6 tempest-RoutersAdminTest-1966155191 tempest-RoutersAdminTest-1966155191-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:41.202704 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47adeae-1c07-4612-8a5a-28b3356e1bd6 tempest-RoutersAdminTest-1966155191 tempest-RoutersAdminTest-1966155191-project-admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:41.266841 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 957/1914] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 00:58:41 2022] POST /identity/v3/projects => generated 348 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 00:58:41.272133 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e125b6-bbf0-472c-b36a-786730007b04 tempest-RoutersAdminTest-1966155191 tempest-RoutersAdminTest-1966155191-project-admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:41.287212 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e125b6-bbf0-472c-b36a-786730007b04 tempest-RoutersAdminTest-1966155191 tempest-RoutersAdminTest-1966155191-project-admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:41.441870 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3375ef7e-786c-442c-9c50-9fd2dd2fc78b tempest-RoutersAdminTest-1966155191 tempest-RoutersAdminTest-1966155191-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cbf466bd0514dd5a2bc8b7d9832ee98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74187486da374bf7a13c40cf040712a7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:41.442975 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375ef7e-786c-442c-9c50-9fd2dd2fc78b tempest-RoutersAdminTest-1966155191 tempest-RoutersAdminTest-1966155191-project-admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:41.443433 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375ef7e-786c-442c-9c50-9fd2dd2fc78b tempest-RoutersAdminTest-1966155191 tempest-RoutersAdminTest-1966155191-project-admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:41.443987 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375ef7e-786c-442c-9c50-9fd2dd2fc78b tempest-RoutersAdminTest-1966155191 tempest-RoutersAdminTest-1966155191-project-admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:41.444901 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3375ef7e-786c-442c-9c50-9fd2dd2fc78b tempest-RoutersAdminTest-1966155191 tempest-RoutersAdminTest-1966155191-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:58:41.446253 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3375ef7e-786c-442c-9c50-9fd2dd2fc78b tempest-RoutersAdminTest-1966155191 tempest-RoutersAdminTest-1966155191-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:41.448909 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3375ef7e-786c-442c-9c50-9fd2dd2fc78b tempest-RoutersAdminTest-1966155191 tempest-RoutersAdminTest-1966155191-project-admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:41.465296 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 958/1915] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 00:58:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:58:42.894811 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47adeae-1c07-4612-8a5a-28b3356e1bd6 tempest-RoutersAdminTest-1966155191 tempest-RoutersAdminTest-1966155191-project-admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:42.936770 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47adeae-1c07-4612-8a5a-28b3356e1bd6 tempest-RoutersAdminTest-1966155191 tempest-RoutersAdminTest-1966155191-project-admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:42.952619 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea8592b-0c2c-489d-a6ba-040432a71b9a tempest-RoutersAdminTest-1966155191 tempest-RoutersAdminTest-1966155191-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cbf466bd0514dd5a2bc8b7d9832ee98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '74187486da374bf7a13c40cf040712a7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:42.953410 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea8592b-0c2c-489d-a6ba-040432a71b9a tempest-RoutersAdminTest-1966155191 tempest-RoutersAdminTest-1966155191-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:42.953695 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea8592b-0c2c-489d-a6ba-040432a71b9a tempest-RoutersAdminTest-1966155191 tempest-RoutersAdminTest-1966155191-project-admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:42.954091 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea8592b-0c2c-489d-a6ba-040432a71b9a tempest-RoutersAdminTest-1966155191 tempest-RoutersAdminTest-1966155191-project-admin] PATH_INFO: `/v3/projects/0ad625c2dd2b4ad3aee1cf24893fdda0` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:42.957482 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea8592b-0c2c-489d-a6ba-040432a71b9a tempest-RoutersAdminTest-1966155191 tempest-RoutersAdminTest-1966155191-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0ad625c2dd2b4ad3aee1cf24893fdda0)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:42.964863 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea8592b-0c2c-489d-a6ba-040432a71b9a tempest-RoutersAdminTest-1966155191 tempest-RoutersAdminTest-1966155191-project-admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:43.154309 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-0ea8592b-0c2c-489d-a6ba-040432a71b9a tempest-RoutersAdminTest-1966155191 tempest-RoutersAdminTest-1966155191-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ad625c2dd2b4ad3aee1cf24893fdda0', 'request_id': 'req-0ea8592b-0c2c-489d-a6ba-040432a71b9a'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:43.176346 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-0ea8592b-0c2c-489d-a6ba-040432a71b9a tempest-RoutersAdminTest-1966155191 tempest-RoutersAdminTest-1966155191-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ad625c2dd2b4ad3aee1cf24893fdda0', 'request_id': 'req-0ea8592b-0c2c-489d-a6ba-040432a71b9a'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:43.200324 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-0ea8592b-0c2c-489d-a6ba-040432a71b9a tempest-RoutersAdminTest-1966155191 tempest-RoutersAdminTest-1966155191-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ad625c2dd2b4ad3aee1cf24893fdda0', 'request_id': 'req-0ea8592b-0c2c-489d-a6ba-040432a71b9a'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:43.274442 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-0ea8592b-0c2c-489d-a6ba-040432a71b9a tempest-RoutersAdminTest-1966155191 tempest-RoutersAdminTest-1966155191-project-admin] The token cache is being invalidate because project 0ad625c2dd2b4ad3aee1cf24893fdda0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81808) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:58:43.275381 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-0ea8592b-0c2c-489d-a6ba-040432a71b9a tempest-RoutersAdminTest-1966155191 tempest-RoutersAdminTest-1966155191-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:43.280791 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-0ea8592b-0c2c-489d-a6ba-040432a71b9a tempest-RoutersAdminTest-1966155191 tempest-RoutersAdminTest-1966155191-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:58:43.288894 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 958/1916] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 00:58:42 2022] DELETE /identity/v3/projects/0ad625c2dd2b4ad3aee1cf24893fdda0 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:58:43.369208 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3375ef7e-786c-442c-9c50-9fd2dd2fc78b tempest-RoutersAdminTest-1966155191 tempest-RoutersAdminTest-1966155191-project-admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:58:43.376459 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-3375ef7e-786c-442c-9c50-9fd2dd2fc78b tempest-RoutersAdminTest-1966155191 tempest-RoutersAdminTest-1966155191-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:43.615626 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3375ef7e-786c-442c-9c50-9fd2dd2fc78b tempest-RoutersAdminTest-1966155191 tempest-RoutersAdminTest-1966155191-project-admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:58:43.753103 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:43.789102 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5f6732-7c9f-4ce0-b159-b26189213021 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:58:43.789837 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f6732-7c9f-4ce0-b159-b26189213021 service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:58:43.790219 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f6732-7c9f-4ce0-b159-b26189213021 service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:58:43.792088 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f6732-7c9f-4ce0-b159-b26189213021 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:58:43.795882 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-be5f6732-7c9f-4ce0-b159-b26189213021 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:58:43.920230 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5f6732-7c9f-4ce0-b159-b26189213021 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:58:43.929303 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5f6732-7c9f-4ce0-b159-b26189213021 service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:58:43.946741 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 959/1917] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:58:43 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:58:53.246673 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=36,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:58:53.941203 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=28 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:12.817404 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea8592b-0c2c-489d-a6ba-040432a71b9a tempest-RoutersAdminTest-1966155191 tempest-RoutersAdminTest-1966155191-project-admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:12.819041 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-0ea8592b-0c2c-489d-a6ba-040432a71b9a tempest-RoutersAdminTest-1966155191 tempest-RoutersAdminTest-1966155191-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:13.018343 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea8592b-0c2c-489d-a6ba-040432a71b9a tempest-RoutersAdminTest-1966155191 tempest-RoutersAdminTest-1966155191-project-admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:13.039059 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b052d-aec0-4ab6-aa5a-a3f45dc89808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:13.045943 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b052d-aec0-4ab6-aa5a-a3f45dc89808 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:13.050771 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b052d-aec0-4ab6-aa5a-a3f45dc89808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:13.051266 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b052d-aec0-4ab6-aa5a-a3f45dc89808 admin admin] PATH_INFO: `/v3/users/28323cb211be4e37a57a583881743bd5` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:13.055163 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9b052d-aec0-4ab6-aa5a-a3f45dc89808 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28323cb211be4e37a57a583881743bd5)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:13.068702 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9b052d-aec0-4ab6-aa5a-a3f45dc89808 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:13.230841 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-cc9b052d-aec0-4ab6-aa5a-a3f45dc89808 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28323cb211be4e37a57a583881743bd5'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:13.243330 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-cc9b052d-aec0-4ab6-aa5a-a3f45dc89808 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28323cb211be4e37a57a583881743bd5'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:13.282624 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-cc9b052d-aec0-4ab6-aa5a-a3f45dc89808 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28323cb211be4e37a57a583881743bd5'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:13.285339 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-cc9b052d-aec0-4ab6-aa5a-a3f45dc89808 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28323cb211be4e37a57a583881743bd5'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:13.287553 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-cc9b052d-aec0-4ab6-aa5a-a3f45dc89808 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28323cb211be4e37a57a583881743bd5'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:13.322347 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb1cdb-5953-4183-a427-c576d499eb46 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:13.322857 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb1cdb-5953-4183-a427-c576d499eb46 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:13.322964 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 959/1918] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 00:59:12 2022] DELETE /identity/v3/users/28323cb211be4e37a57a583881743bd5 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:59:13.323057 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb1cdb-5953-4183-a427-c576d499eb46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:13.368315 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-cddb1cdb-5953-4183-a427-c576d499eb46 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:59:13.369583 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-cddb1cdb-5953-4183-a427-c576d499eb46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:13.557740 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 960/1919] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:59:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:59:13.570904 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b052d-aec0-4ab6-aa5a-a3f45dc89808 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:13.573320 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-cc9b052d-aec0-4ab6-aa5a-a3f45dc89808 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:13.724418 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b052d-aec0-4ab6-aa5a-a3f45dc89808 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:13.729204 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03839168-572a-4506-85d4-d3671dc64673 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:13.730317 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03839168-572a-4506-85d4-d3671dc64673 service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:13.731128 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03839168-572a-4506-85d4-d3671dc64673 service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:13.731867 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03839168-572a-4506-85d4-d3671dc64673 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:13.775907 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03839168-572a-4506-85d4-d3671dc64673 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:13.783548 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03839168-572a-4506-85d4-d3671dc64673 service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:13.809719 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 960/1920] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:59:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:59:15.607638 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb1cdb-5953-4183-a427-c576d499eb46 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:15.611199 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-cddb1cdb-5953-4183-a427-c576d499eb46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:15.638056 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb1cdb-5953-4183-a427-c576d499eb46 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:15.667296 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9afa857-33c0-4238-888d-9578044676da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:15.669513 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9afa857-33c0-4238-888d-9578044676da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:15.669964 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9afa857-33c0-4238-888d-9578044676da admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:15.670384 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9afa857-33c0-4238-888d-9578044676da admin admin] PATH_INFO: `/v3/projects/29668b160d984a1fae9d1d518f78f6e7` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:15.673930 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9afa857-33c0-4238-888d-9578044676da admin admin] RBAC: Authorizing `identity:delete_project(project_id=29668b160d984a1fae9d1d518f78f6e7)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:15.680568 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9afa857-33c0-4238-888d-9578044676da admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:15.805385 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-c9afa857-33c0-4238-888d-9578044676da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29668b160d984a1fae9d1d518f78f6e7', 'request_id': 'req-c9afa857-33c0-4238-888d-9578044676da'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:15.816945 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-c9afa857-33c0-4238-888d-9578044676da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29668b160d984a1fae9d1d518f78f6e7', 'request_id': 'req-c9afa857-33c0-4238-888d-9578044676da'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:15.828070 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-c9afa857-33c0-4238-888d-9578044676da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29668b160d984a1fae9d1d518f78f6e7', 'request_id': 'req-c9afa857-33c0-4238-888d-9578044676da'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:15.844096 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-c9afa857-33c0-4238-888d-9578044676da admin admin] The token cache is being invalidate because project 29668b160d984a1fae9d1d518f78f6e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81807) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:59:15.844891 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-c9afa857-33c0-4238-888d-9578044676da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:15.845831 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-c9afa857-33c0-4238-888d-9578044676da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:15.852733 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 961/1921] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 00:59:15 2022] DELETE /identity/v3/projects/29668b160d984a1fae9d1d518f78f6e7 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:59:15.853492 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f054dd7-52b5-4f97-bb9f-4a73e8254c6a None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:15.853996 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f054dd7-52b5-4f97-bb9f-4a73e8254c6a None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:15.854083 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f054dd7-52b5-4f97-bb9f-4a73e8254c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:15.876751 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-8f054dd7-52b5-4f97-bb9f-4a73e8254c6a None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:59:15.877973 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-8f054dd7-52b5-4f97-bb9f-4a73e8254c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:15.897893 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:15.962896 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 961/1922] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:59:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:59:15.971416 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4dc7b-73c4-4c24-b9c3-f538a1137309 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:15.971725 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4dc7b-73c4-4c24-b9c3-f538a1137309 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:15.972012 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4dc7b-73c4-4c24-b9c3-f538a1137309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:15.994949 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-a2e4dc7b-73c4-4c24-b9c3-f538a1137309 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:59:15.996244 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-a2e4dc7b-73c4-4c24-b9c3-f538a1137309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:16.010804 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f054dd7-52b5-4f97-bb9f-4a73e8254c6a None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:16.011769 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 962/1923] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:59:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:59:16.023227 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f054dd7-52b5-4f97-bb9f-4a73e8254c6a None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:16.039571 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb937c4-f88b-44df-8028-73bf29b8a285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:16.040545 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb937c4-f88b-44df-8028-73bf29b8a285 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:16.040834 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb937c4-f88b-44df-8028-73bf29b8a285 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:16.041155 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb937c4-f88b-44df-8028-73bf29b8a285 admin admin] PATH_INFO: `/v3/domains` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:16.041930 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb937c4-f88b-44df-8028-73bf29b8a285 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:59:16.043036 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb937c4-f88b-44df-8028-73bf29b8a285 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:16.046143 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb937c4-f88b-44df-8028-73bf29b8a285 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:16.073544 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 962/1924] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 00:59:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:59:16.078383 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e4dc7b-73c4-4c24-b9c3-f538a1137309 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:16.089709 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e4dc7b-73c4-4c24-b9c3-f538a1137309 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:16.099154 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394723aa-d5b5-4f40-8b20-c5a6e95fca7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:16.099963 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394723aa-d5b5-4f40-8b20-c5a6e95fca7f admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:16.100353 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394723aa-d5b5-4f40-8b20-c5a6e95fca7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:16.100737 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394723aa-d5b5-4f40-8b20-c5a6e95fca7f admin admin] PATH_INFO: `/v3/projects` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:16.102493 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394723aa-d5b5-4f40-8b20-c5a6e95fca7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:16.104157 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394723aa-d5b5-4f40-8b20-c5a6e95fca7f admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:16.140587 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 963/1925] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 00:59:16 2022] POST /identity/v3/projects => generated 391 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:59:16.141850 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb937c4-f88b-44df-8028-73bf29b8a285 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:16.154531 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb937c4-f88b-44df-8028-73bf29b8a285 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:16.240183 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb8b483-1470-433a-b7ec-7e45c6a30069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:16.242282 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8b483-1470-433a-b7ec-7e45c6a30069 admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:16.243334 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8b483-1470-433a-b7ec-7e45c6a30069 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:16.243687 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8b483-1470-433a-b7ec-7e45c6a30069 admin admin] PATH_INFO: `/v3/users` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:16.244421 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb8b483-1470-433a-b7ec-7e45c6a30069 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:16.249273 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb8b483-1470-433a-b7ec-7e45c6a30069 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:16.299404 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394723aa-d5b5-4f40-8b20-c5a6e95fca7f admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:16.315051 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 963/1926] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 00:59:16 2022] POST /identity/v3/users => generated 296 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:59:16.336770 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394723aa-d5b5-4f40-8b20-c5a6e95fca7f admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:16.345412 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df98b6-d46a-42ff-a83b-0cb94ae18c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:16.346055 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df98b6-d46a-42ff-a83b-0cb94ae18c84 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:16.347089 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df98b6-d46a-42ff-a83b-0cb94ae18c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:16.347374 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df98b6-d46a-42ff-a83b-0cb94ae18c84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:16.348112 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8df98b6-d46a-42ff-a83b-0cb94ae18c84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:16.349839 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8df98b6-d46a-42ff-a83b-0cb94ae18c84 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:16.373039 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 964/1927] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:59:16 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:59:16.377695 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb8b483-1470-433a-b7ec-7e45c6a30069 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:16.394203 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb8b483-1470-433a-b7ec-7e45c6a30069 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:16.400917 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcfcfe2-baaf-474e-a5ed-685fce6079cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:16.401800 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcfcfe2-baaf-474e-a5ed-685fce6079cf admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:16.402080 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcfcfe2-baaf-474e-a5ed-685fce6079cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:16.402356 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcfcfe2-baaf-474e-a5ed-685fce6079cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:16.403015 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcfcfe2-baaf-474e-a5ed-685fce6079cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:16.404673 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcfcfe2-baaf-474e-a5ed-685fce6079cf admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:16.429658 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df98b6-d46a-42ff-a83b-0cb94ae18c84 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:16.432778 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 964/1928] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:59:16 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:59:16.446630 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df98b6-d46a-42ff-a83b-0cb94ae18c84 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:16.456569 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714acb2d-98de-4ccf-8b03-32d68b24ca9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:16.457456 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714acb2d-98de-4ccf-8b03-32d68b24ca9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:16.457909 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714acb2d-98de-4ccf-8b03-32d68b24ca9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:16.458269 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714acb2d-98de-4ccf-8b03-32d68b24ca9f admin admin] PATH_INFO: `/v3/projects/46bb5c265b494feb9662466fa2004572/users/0397a0c776384096950d94a7664ac481/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:16.505474 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714acb2d-98de-4ccf-8b03-32d68b24ca9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=46bb5c265b494feb9662466fa2004572, user_id=0397a0c776384096950d94a7664ac481, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:16.509268 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714acb2d-98de-4ccf-8b03-32d68b24ca9f admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:16.531535 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 965/1929] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 00:59:16 2022] PUT /identity/v3/projects/46bb5c265b494feb9662466fa2004572/users/0397a0c776384096950d94a7664ac481/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:59:16.545759 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2062440d-fe14-44c5-895d-c93c8b19477e None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:16.546095 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2062440d-fe14-44c5-895d-c93c8b19477e None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:16.546442 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2062440d-fe14-44c5-895d-c93c8b19477e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:16.603705 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-2062440d-fe14-44c5-895d-c93c8b19477e None None] MFA Rules not processed for user `0397a0c776384096950d94a7664ac481`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:59:16.604897 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-2062440d-fe14-44c5-895d-c93c8b19477e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:16.691996 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 965/1930] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:59:16 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:59:16.762848 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714acb2d-98de-4ccf-8b03-32d68b24ca9f admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:16.765180 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-714acb2d-98de-4ccf-8b03-32d68b24ca9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:16.800550 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:16.847763 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714acb2d-98de-4ccf-8b03-32d68b24ca9f admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:16.852214 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a191f0be-7254-47e6-bb11-86df311bd89c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:16.856077 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191f0be-7254-47e6-bb11-86df311bd89c service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:16.856764 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191f0be-7254-47e6-bb11-86df311bd89c service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:16.857230 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191f0be-7254-47e6-bb11-86df311bd89c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:16.867881 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a191f0be-7254-47e6-bb11-86df311bd89c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:16.869863 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a191f0be-7254-47e6-bb11-86df311bd89c service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:16.883611 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 966/1931] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:59:16 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:59:26.688320 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:26.877325 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=17 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:35.730494 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2062440d-fe14-44c5-895d-c93c8b19477e None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:35.732021 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-2062440d-fe14-44c5-895d-c93c8b19477e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:35.827615 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2062440d-fe14-44c5-895d-c93c8b19477e None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:35.834986 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d9ddce-e713-4741-b1e3-2c1020864b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:35.835177 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d9ddce-e713-4741-b1e3-2c1020864b26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:35.835373 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d9ddce-e713-4741-b1e3-2c1020864b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:35.835644 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d9ddce-e713-4741-b1e3-2c1020864b26 admin admin] PATH_INFO: `/v3/users/e85ff72921aa4af8a0dbc102e9cacf8f` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:35.837343 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d9ddce-e713-4741-b1e3-2c1020864b26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e85ff72921aa4af8a0dbc102e9cacf8f)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:35.839280 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d9ddce-e713-4741-b1e3-2c1020864b26 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:35.918074 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-74d9ddce-e713-4741-b1e3-2c1020864b26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e85ff72921aa4af8a0dbc102e9cacf8f'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:35.937426 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-74d9ddce-e713-4741-b1e3-2c1020864b26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e85ff72921aa4af8a0dbc102e9cacf8f'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:35.983773 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-74d9ddce-e713-4741-b1e3-2c1020864b26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e85ff72921aa4af8a0dbc102e9cacf8f'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:35.986810 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-74d9ddce-e713-4741-b1e3-2c1020864b26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e85ff72921aa4af8a0dbc102e9cacf8f'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:35.987944 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-74d9ddce-e713-4741-b1e3-2c1020864b26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e85ff72921aa4af8a0dbc102e9cacf8f'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:36.014429 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 966/1932] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 00:59:35 2022] DELETE /identity/v3/users/e85ff72921aa4af8a0dbc102e9cacf8f => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:59:36.167380 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a191f0be-7254-47e6-bb11-86df311bd89c service neutron] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:36.183138 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a191f0be-7254-47e6-bb11-86df311bd89c service neutron] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:36.297013 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1fe64b-3370-4ffa-82d3-fad998628c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:36.297666 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1fe64b-3370-4ffa-82d3-fad998628c09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:36.297936 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1fe64b-3370-4ffa-82d3-fad998628c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:36.298385 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1fe64b-3370-4ffa-82d3-fad998628c09 admin admin] PATH_INFO: `/v3/users/0397a0c776384096950d94a7664ac481` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:36.299883 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1fe64b-3370-4ffa-82d3-fad998628c09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0397a0c776384096950d94a7664ac481)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:36.301906 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1fe64b-3370-4ffa-82d3-fad998628c09 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:36.387955 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-5e1fe64b-3370-4ffa-82d3-fad998628c09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0397a0c776384096950d94a7664ac481'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:36.422686 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-5e1fe64b-3370-4ffa-82d3-fad998628c09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0397a0c776384096950d94a7664ac481'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:36.437053 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-5e1fe64b-3370-4ffa-82d3-fad998628c09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0397a0c776384096950d94a7664ac481'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:36.440094 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-5e1fe64b-3370-4ffa-82d3-fad998628c09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0397a0c776384096950d94a7664ac481'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:36.441532 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-5e1fe64b-3370-4ffa-82d3-fad998628c09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0397a0c776384096950d94a7664ac481'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:36.469541 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 967/1933] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 00:59:36 2022] DELETE /identity/v3/users/0397a0c776384096950d94a7664ac481 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:59:36.472059 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d699d-d5e7-4ef6-aaf3-c8806acc61a3 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:36.472515 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d699d-d5e7-4ef6-aaf3-c8806acc61a3 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:36.472862 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d699d-d5e7-4ef6-aaf3-c8806acc61a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:36.514627 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-0a3d699d-d5e7-4ef6-aaf3-c8806acc61a3 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:59:36.517232 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-0a3d699d-d5e7-4ef6-aaf3-c8806acc61a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:36.689647 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 967/1934] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:59:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:59:36.736164 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1fe64b-3370-4ffa-82d3-fad998628c09 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:36.737870 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-5e1fe64b-3370-4ffa-82d3-fad998628c09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:36.865184 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1fe64b-3370-4ffa-82d3-fad998628c09 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:36.875511 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9b0791-8599-4506-b8a4-63c69950193d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:36.876210 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b0791-8599-4506-b8a4-63c69950193d service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:36.876490 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b0791-8599-4506-b8a4-63c69950193d service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:36.876783 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9b0791-8599-4506-b8a4-63c69950193d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:36.900523 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9b0791-8599-4506-b8a4-63c69950193d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:36.913065 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9b0791-8599-4506-b8a4-63c69950193d service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:36.926654 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 968/1935] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:59:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:59:37.312351 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d699d-d5e7-4ef6-aaf3-c8806acc61a3 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:37.315130 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-0a3d699d-d5e7-4ef6-aaf3-c8806acc61a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:37.334769 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d699d-d5e7-4ef6-aaf3-c8806acc61a3 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:37.353897 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f72baa-e295-484c-b1c2-ab2af00f8cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:37.354849 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f72baa-e295-484c-b1c2-ab2af00f8cbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:37.355345 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f72baa-e295-484c-b1c2-ab2af00f8cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:37.355885 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f72baa-e295-484c-b1c2-ab2af00f8cbe admin admin] PATH_INFO: `/v3/projects/aa3eff9641334c6681e73cb6a5f715fa` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:37.358049 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f72baa-e295-484c-b1c2-ab2af00f8cbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa3eff9641334c6681e73cb6a5f715fa)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:37.363361 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f72baa-e295-484c-b1c2-ab2af00f8cbe admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:37.403562 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:37.513768 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-68f72baa-e295-484c-b1c2-ab2af00f8cbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa3eff9641334c6681e73cb6a5f715fa', 'request_id': 'req-68f72baa-e295-484c-b1c2-ab2af00f8cbe'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:37.528853 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-68f72baa-e295-484c-b1c2-ab2af00f8cbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa3eff9641334c6681e73cb6a5f715fa', 'request_id': 'req-68f72baa-e295-484c-b1c2-ab2af00f8cbe'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:37.550797 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-68f72baa-e295-484c-b1c2-ab2af00f8cbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa3eff9641334c6681e73cb6a5f715fa', 'request_id': 'req-68f72baa-e295-484c-b1c2-ab2af00f8cbe'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:37.564870 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-68f72baa-e295-484c-b1c2-ab2af00f8cbe admin admin] The token cache is being invalidate because project aa3eff9641334c6681e73cb6a5f715fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81808) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:59:37.565173 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-68f72baa-e295-484c-b1c2-ab2af00f8cbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:37.565876 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-68f72baa-e295-484c-b1c2-ab2af00f8cbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:37.568759 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 968/1936] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 00:59:37 2022] DELETE /identity/v3/projects/aa3eff9641334c6681e73cb6a5f715fa => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:59:37.574482 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78bf3b-cfcc-4b12-92eb-e486b5541769 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:37.575088 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78bf3b-cfcc-4b12-92eb-e486b5541769 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:37.575187 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e78bf3b-cfcc-4b12-92eb-e486b5541769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:37.611454 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-4e78bf3b-cfcc-4b12-92eb-e486b5541769 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:59:37.613340 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-4e78bf3b-cfcc-4b12-92eb-e486b5541769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:37.637279 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:37.763251 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 969/1937] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:59:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:59:37.773649 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95540c-1d39-4b8d-918e-af99b32aec4c None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:37.773845 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95540c-1d39-4b8d-918e-af99b32aec4c None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:37.774116 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95540c-1d39-4b8d-918e-af99b32aec4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:37.797458 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-fa95540c-1d39-4b8d-918e-af99b32aec4c None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:59:37.798705 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-fa95540c-1d39-4b8d-918e-af99b32aec4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:37.808901 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 969/1938] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:59:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:59:37.814084 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e78bf3b-cfcc-4b12-92eb-e486b5541769 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:37.825500 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e78bf3b-cfcc-4b12-92eb-e486b5541769 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:37.831999 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f043f-7087-43db-925b-156a42436597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:37.832639 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f043f-7087-43db-925b-156a42436597 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:37.832920 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f043f-7087-43db-925b-156a42436597 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:37.833485 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f043f-7087-43db-925b-156a42436597 admin admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:37.834165 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6f043f-7087-43db-925b-156a42436597 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:59:37.834473 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6f043f-7087-43db-925b-156a42436597 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:37.836540 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6f043f-7087-43db-925b-156a42436597 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:37.855478 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa95540c-1d39-4b8d-918e-af99b32aec4c None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:37.862335 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 970/1939] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 00:59:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:59:37.866217 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa95540c-1d39-4b8d-918e-af99b32aec4c None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:37.871554 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bdb455-cb6a-45f5-a6a3-d87745d1c8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:37.872322 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bdb455-cb6a-45f5-a6a3-d87745d1c8b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:37.872612 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bdb455-cb6a-45f5-a6a3-d87745d1c8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:37.872885 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bdb455-cb6a-45f5-a6a3-d87745d1c8b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:37.873546 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bdb455-cb6a-45f5-a6a3-d87745d1c8b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:37.875922 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bdb455-cb6a-45f5-a6a3-d87745d1c8b5 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:37.928580 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 970/1940] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 00:59:37 2022] POST /identity/v3/projects => generated 385 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:59:37.933920 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f043f-7087-43db-925b-156a42436597 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:37.960042 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f043f-7087-43db-925b-156a42436597 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:37.990665 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bdb455-cb6a-45f5-a6a3-d87745d1c8b5 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:37.993795 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-15bdb455-cb6a-45f5-a6a3-d87745d1c8b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:38.091046 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbb90fe-ae1f-4f54-a5bc-ecb733b1f369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:38.093038 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb90fe-ae1f-4f54-a5bc-ecb733b1f369 admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:38.093992 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb90fe-ae1f-4f54-a5bc-ecb733b1f369 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:38.093992 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb90fe-ae1f-4f54-a5bc-ecb733b1f369 admin admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:38.094654 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbb90fe-ae1f-4f54-a5bc-ecb733b1f369 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:38.096779 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbb90fe-ae1f-4f54-a5bc-ecb733b1f369 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:38.162978 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 971/1941] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 00:59:37 2022] POST /identity/v3/users => generated 293 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:59:38.165966 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bdb455-cb6a-45f5-a6a3-d87745d1c8b5 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:38.167644 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbb90fe-ae1f-4f54-a5bc-ecb733b1f369 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:38.183253 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff6690a-0ed5-4913-af6a-be888d8d708c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:38.185713 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbb90fe-ae1f-4f54-a5bc-ecb733b1f369 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:38.191848 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad277440-ed5d-401a-8ca0-d8ad6917d6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:38.192473 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad277440-ed5d-401a-8ca0-d8ad6917d6a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:38.192747 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad277440-ed5d-401a-8ca0-d8ad6917d6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:38.193023 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad277440-ed5d-401a-8ca0-d8ad6917d6a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:38.193903 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad277440-ed5d-401a-8ca0-d8ad6917d6a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:38.198463 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad277440-ed5d-401a-8ca0-d8ad6917d6a9 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:38.200537 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6690a-0ed5-4913-af6a-be888d8d708c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:38.200839 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6690a-0ed5-4913-af6a-be888d8d708c admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:38.201441 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6690a-0ed5-4913-af6a-be888d8d708c admin admin] PATH_INFO: `/v3/projects/46bb5c265b494feb9662466fa2004572` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:38.204329 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff6690a-0ed5-4913-af6a-be888d8d708c admin admin] RBAC: Authorizing `identity:delete_project(project_id=46bb5c265b494feb9662466fa2004572)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:38.206284 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff6690a-0ed5-4913-af6a-be888d8d708c admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:38.217005 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 972/1942] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:59:38 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:59:38.218115 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad277440-ed5d-401a-8ca0-d8ad6917d6a9 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:38.246105 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad277440-ed5d-401a-8ca0-d8ad6917d6a9 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:38.254037 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d8b8a-9cf6-4334-af4d-6b82186b1c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:38.257728 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d8b8a-9cf6-4334-af4d-6b82186b1c66 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:38.258025 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d8b8a-9cf6-4334-af4d-6b82186b1c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:38.258715 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d8b8a-9cf6-4334-af4d-6b82186b1c66 admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:38.259907 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0d8b8a-9cf6-4334-af4d-6b82186b1c66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:38.262492 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0d8b8a-9cf6-4334-af4d-6b82186b1c66 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:38.283856 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 973/1943] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:59:38 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:59:38.294399 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d8b8a-9cf6-4334-af4d-6b82186b1c66 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:38.308621 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d8b8a-9cf6-4334-af4d-6b82186b1c66 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:38.325330 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-1ff6690a-0ed5-4913-af6a-be888d8d708c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46bb5c265b494feb9662466fa2004572', 'request_id': 'req-1ff6690a-0ed5-4913-af6a-be888d8d708c'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:38.342737 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-1ff6690a-0ed5-4913-af6a-be888d8d708c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46bb5c265b494feb9662466fa2004572', 'request_id': 'req-1ff6690a-0ed5-4913-af6a-be888d8d708c'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:38.369905 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-1ff6690a-0ed5-4913-af6a-be888d8d708c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46bb5c265b494feb9662466fa2004572', 'request_id': 'req-1ff6690a-0ed5-4913-af6a-be888d8d708c'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:38.399300 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-1ff6690a-0ed5-4913-af6a-be888d8d708c admin admin] The token cache is being invalidate because project 46bb5c265b494feb9662466fa2004572 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81808) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:59:38.401631 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-1ff6690a-0ed5-4913-af6a-be888d8d708c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:38.402729 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-1ff6690a-0ed5-4913-af6a-be888d8d708c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:38.404561 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 971/1944] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 00:59:37 2022] DELETE /identity/v3/projects/46bb5c265b494feb9662466fa2004572 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:59:38.412543 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c4eb7-f376-4247-b7d1-3fc350cce03d None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:38.412993 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c4eb7-f376-4247-b7d1-3fc350cce03d None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:38.413224 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0c4eb7-f376-4247-b7d1-3fc350cce03d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:38.441164 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:38.461181 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc4107-8b83-4849-8ea6-6e90ec522fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:38.462144 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc4107-8b83-4849-8ea6-6e90ec522fc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:38.462599 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc4107-8b83-4849-8ea6-6e90ec522fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:38.463039 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc4107-8b83-4849-8ea6-6e90ec522fc4 admin admin] PATH_INFO: `/v3/projects/2fe456cc7b384df3bdcc8ee479c3c9b7/users/cbe2b4c7906b4168becbad27b8699eb1/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:38.478930 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-3e0c4eb7-f376-4247-b7d1-3fc350cce03d None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:59:38.480862 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-3e0c4eb7-f376-4247-b7d1-3fc350cce03d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:38.497443 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcc4107-8b83-4849-8ea6-6e90ec522fc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fe456cc7b384df3bdcc8ee479c3c9b7, user_id=cbe2b4c7906b4168becbad27b8699eb1, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:38.505870 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 972/1945] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:59:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:59:38.507042 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcc4107-8b83-4849-8ea6-6e90ec522fc4 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:38.510217 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f6264-c7a1-40d9-8927-86b1d49d907f None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:38.510507 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f6264-c7a1-40d9-8927-86b1d49d907f None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:38.510782 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f6264-c7a1-40d9-8927-86b1d49d907f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:38.526484 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:38.548824 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 974/1946] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 00:59:38 2022] PUT /identity/v3/projects/2fe456cc7b384df3bdcc8ee479c3c9b7/users/cbe2b4c7906b4168becbad27b8699eb1/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:59:38.549419 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-7b6f6264-c7a1-40d9-8927-86b1d49d907f None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:59:38.550372 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96447a-688b-459e-a727-34deb1a71189 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:38.550662 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96447a-688b-459e-a727-34deb1a71189 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:38.550872 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-7b6f6264-c7a1-40d9-8927-86b1d49d907f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:38.550972 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d96447a-688b-459e-a727-34deb1a71189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:38.611463 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-0d96447a-688b-459e-a727-34deb1a71189 None None] MFA Rules not processed for user `cbe2b4c7906b4168becbad27b8699eb1`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:59:38.616065 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-0d96447a-688b-459e-a727-34deb1a71189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:38.744088 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 973/1947] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:59:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:59:38.752299 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f6264-c7a1-40d9-8927-86b1d49d907f None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:38.764690 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 975/1948] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:59:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:59:38.771886 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d96447a-688b-459e-a727-34deb1a71189 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:38.773619 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-0d96447a-688b-459e-a727-34deb1a71189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:38.775683 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f6264-c7a1-40d9-8927-86b1d49d907f None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:38.794823 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ec10e-55b5-420d-becf-31cad98b05f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:38.795486 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ec10e-55b5-420d-becf-31cad98b05f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:38.796228 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ec10e-55b5-420d-becf-31cad98b05f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:38.796699 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ec10e-55b5-420d-becf-31cad98b05f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:38.797685 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23ec10e-55b5-420d-becf-31cad98b05f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:59:38.798192 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23ec10e-55b5-420d-becf-31cad98b05f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:38.806872 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23ec10e-55b5-420d-becf-31cad98b05f3 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:38.809970 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d96447a-688b-459e-a727-34deb1a71189 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:38.828338 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a8b37-123e-4098-b0ef-d80a51aaf905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:38.834757 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a8b37-123e-4098-b0ef-d80a51aaf905 admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:38.835056 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a8b37-123e-4098-b0ef-d80a51aaf905 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:38.835443 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a8b37-123e-4098-b0ef-d80a51aaf905 admin admin] PATH_INFO: `/v3/projects` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:38.836407 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03a8b37-123e-4098-b0ef-d80a51aaf905 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:38.840959 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03a8b37-123e-4098-b0ef-d80a51aaf905 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:38.867595 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 974/1949] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 00:59:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:59:38.874842 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ec10e-55b5-420d-becf-31cad98b05f3 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:38.895467 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 976/1950] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 00:59:38 2022] POST /identity/v3/projects => generated 383 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:59:38.896507 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a8b37-123e-4098-b0ef-d80a51aaf905 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:38.914408 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ec10e-55b5-420d-becf-31cad98b05f3 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:39.008693 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a8b37-123e-4098-b0ef-d80a51aaf905 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:39.017735 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2f6853-62dc-40d3-8273-7eb9978f518b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:39.018388 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f6853-62dc-40d3-8273-7eb9978f518b admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:39.018722 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f6853-62dc-40d3-8273-7eb9978f518b admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:39.019000 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f6853-62dc-40d3-8273-7eb9978f518b admin admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:39.019761 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2f6853-62dc-40d3-8273-7eb9978f518b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:39.022842 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2f6853-62dc-40d3-8273-7eb9978f518b admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:39.067741 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 977/1951] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 00:59:38 2022] POST /identity/v3/users => generated 298 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:59:39.084545 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2f6853-62dc-40d3-8273-7eb9978f518b admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:39.087320 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e34ce2-617f-40f3-ab4d-37c13bcb7460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:39.088013 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e34ce2-617f-40f3-ab4d-37c13bcb7460 admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:39.088295 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e34ce2-617f-40f3-ab4d-37c13bcb7460 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:39.088570 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e34ce2-617f-40f3-ab4d-37c13bcb7460 admin admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:39.089234 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e34ce2-617f-40f3-ab4d-37c13bcb7460 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:39.103002 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e34ce2-617f-40f3-ab4d-37c13bcb7460 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:39.119738 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2f6853-62dc-40d3-8273-7eb9978f518b admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:39.133833 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f088ebf1-58b0-4fa9-8e2d-76de7b8279f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:39.134651 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088ebf1-58b0-4fa9-8e2d-76de7b8279f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:39.134941 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088ebf1-58b0-4fa9-8e2d-76de7b8279f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:39.135220 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088ebf1-58b0-4fa9-8e2d-76de7b8279f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:39.136154 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f088ebf1-58b0-4fa9-8e2d-76de7b8279f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:39.138055 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f088ebf1-58b0-4fa9-8e2d-76de7b8279f7 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:39.159199 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 978/1952] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:59:39 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:59:39.181132 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f088ebf1-58b0-4fa9-8e2d-76de7b8279f7 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:39.205684 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f088ebf1-58b0-4fa9-8e2d-76de7b8279f7 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:39.211346 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 975/1953] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 00:59:38 2022] POST /identity/v3/projects => generated 373 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:59:39.212826 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e34ce2-617f-40f3-ab4d-37c13bcb7460 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:39.294994 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:39.319718 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e34ce2-617f-40f3-ab4d-37c13bcb7460 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:39.329509 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a7cb5-f4af-4e52-ad4c-9cdf21599818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:39.330368 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a7cb5-f4af-4e52-ad4c-9cdf21599818 admin admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:39.330649 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a7cb5-f4af-4e52-ad4c-9cdf21599818 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:39.330923 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2a7cb5-f4af-4e52-ad4c-9cdf21599818 admin admin] PATH_INFO: `/v3/projects/2367110534aa466381ad59d8c15cd8c5/users/c26263fd8c55496d855cf25a24cea631/roles/2e4889bb71f9434392c0baba59f2534e` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:39.335365 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce020e6-c00b-4cb1-88e9-d6f16c58b22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:39.337827 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce020e6-c00b-4cb1-88e9-d6f16c58b22a admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:39.338313 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce020e6-c00b-4cb1-88e9-d6f16c58b22a admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:39.338802 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce020e6-c00b-4cb1-88e9-d6f16c58b22a admin admin] PATH_INFO: `/v3/users` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:39.340602 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce020e6-c00b-4cb1-88e9-d6f16c58b22a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:39.344884 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce020e6-c00b-4cb1-88e9-d6f16c58b22a admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:39.366221 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2a7cb5-f4af-4e52-ad4c-9cdf21599818 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2367110534aa466381ad59d8c15cd8c5, user_id=c26263fd8c55496d855cf25a24cea631, role_id=2e4889bb71f9434392c0baba59f2534e)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:39.368939 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:39.375975 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2a7cb5-f4af-4e52-ad4c-9cdf21599818 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:39.383876 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 976/1954] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 00:59:39 2022] POST /identity/v3/users => generated 287 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:59:39.387867 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce020e6-c00b-4cb1-88e9-d6f16c58b22a admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:39.405401 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 979/1955] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 00:59:39 2022] PUT /identity/v3/projects/2367110534aa466381ad59d8c15cd8c5/users/c26263fd8c55496d855cf25a24cea631/roles/2e4889bb71f9434392c0baba59f2534e => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:59:39.405600 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce020e6-c00b-4cb1-88e9-d6f16c58b22a admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:39.406892 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a7cb5-f4af-4e52-ad4c-9cdf21599818 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:39.536190 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d01e4-beb2-4809-9c7d-4f3f59b5e937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:39.538523 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d01e4-beb2-4809-9c7d-4f3f59b5e937 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:39.539637 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d01e4-beb2-4809-9c7d-4f3f59b5e937 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:39.540781 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3d01e4-beb2-4809-9c7d-4f3f59b5e937 admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:39.543536 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3d01e4-beb2-4809-9c7d-4f3f59b5e937 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:39.547030 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3d01e4-beb2-4809-9c7d-4f3f59b5e937 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:39.597313 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 977/1956] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:59:39 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:59:39.599584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d01e4-beb2-4809-9c7d-4f3f59b5e937 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:39.623127 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2a7cb5-f4af-4e52-ad4c-9cdf21599818 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:39.640130 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4219b729-f65c-4208-967b-f59973e89f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:39.640991 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219b729-f65c-4208-967b-f59973e89f5a admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:39.641645 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219b729-f65c-4208-967b-f59973e89f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:39.643219 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4219b729-f65c-4208-967b-f59973e89f5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:39.645198 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3d01e4-beb2-4809-9c7d-4f3f59b5e937 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:39.646222 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4219b729-f65c-4208-967b-f59973e89f5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:39.648007 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4219b729-f65c-4208-967b-f59973e89f5a admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:39.657838 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10facdee-a8b9-424d-9677-b971ae431be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:39.658852 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10facdee-a8b9-424d-9677-b971ae431be1 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:39.659347 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10facdee-a8b9-424d-9677-b971ae431be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:39.659827 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10facdee-a8b9-424d-9677-b971ae431be1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:39.661446 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10facdee-a8b9-424d-9677-b971ae431be1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:39.663945 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10facdee-a8b9-424d-9677-b971ae431be1 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:39.675389 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 980/1957] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:59:39 2022] GET /identity/v3/roles => generated 1420 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 00:59:39.679962 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4219b729-f65c-4208-967b-f59973e89f5a admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:39.681707 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 978/1958] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:59:39 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:59:39.685779 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10facdee-a8b9-424d-9677-b971ae431be1 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:39.699605 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4219b729-f65c-4208-967b-f59973e89f5a admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:39.706322 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10facdee-a8b9-424d-9677-b971ae431be1 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:39.712801 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e0e69b-6914-45b5-a9ce-13c51e9c09fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:39.713958 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0e69b-6914-45b5-a9ce-13c51e9c09fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:39.713958 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0e69b-6914-45b5-a9ce-13c51e9c09fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:39.714916 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0e69b-6914-45b5-a9ce-13c51e9c09fd admin admin] PATH_INFO: `/v3/projects/8960f53cd115440fa4545d54ad9eb26f/users/b039629a6d084b17a44fe6934e1aaa33/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:39.719251 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf613ed-ddbd-418c-9650-7f19c1391f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:39.720017 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf613ed-ddbd-418c-9650-7f19c1391f18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:39.720300 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf613ed-ddbd-418c-9650-7f19c1391f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:39.720577 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf613ed-ddbd-418c-9650-7f19c1391f18 admin admin] PATH_INFO: `/v3/projects/2367110534aa466381ad59d8c15cd8c5/users/c26263fd8c55496d855cf25a24cea631/roles/2e4889bb71f9434392c0baba59f2534e` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:39.723642 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf613ed-ddbd-418c-9650-7f19c1391f18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2367110534aa466381ad59d8c15cd8c5, user_id=c26263fd8c55496d855cf25a24cea631, role_id=2e4889bb71f9434392c0baba59f2534e)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:39.729032 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf613ed-ddbd-418c-9650-7f19c1391f18 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:39.755360 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 981/1959] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 00:59:39 2022] PUT /identity/v3/projects/2367110534aa466381ad59d8c15cd8c5/users/c26263fd8c55496d855cf25a24cea631/roles/2e4889bb71f9434392c0baba59f2534e => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:59:39.767329 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03989ed9-ffcc-4523-bc58-1628c7bacbbc None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:39.767906 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03989ed9-ffcc-4523-bc58-1628c7bacbbc None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:39.768381 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03989ed9-ffcc-4523-bc58-1628c7bacbbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:39.797358 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e0e69b-6914-45b5-a9ce-13c51e9c09fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8960f53cd115440fa4545d54ad9eb26f, user_id=b039629a6d084b17a44fe6934e1aaa33, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:39.803592 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e0e69b-6914-45b5-a9ce-13c51e9c09fd admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:39.837706 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 979/1960] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 00:59:39 2022] PUT /identity/v3/projects/8960f53cd115440fa4545d54ad9eb26f/users/b039629a6d084b17a44fe6934e1aaa33/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 00:59:39.841411 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155acd0-232e-48e0-a7ac-7f3d89289c5f None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:39.841842 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155acd0-232e-48e0-a7ac-7f3d89289c5f None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:39.842716 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3155acd0-232e-48e0-a7ac-7f3d89289c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:39.849857 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-03989ed9-ffcc-4523-bc58-1628c7bacbbc None None] MFA Rules not processed for user `c26263fd8c55496d855cf25a24cea631`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:59:39.851121 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-03989ed9-ffcc-4523-bc58-1628c7bacbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:39.922955 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-3155acd0-232e-48e0-a7ac-7f3d89289c5f None None] MFA Rules not processed for user `b039629a6d084b17a44fe6934e1aaa33`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:59:39.927975 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-3155acd0-232e-48e0-a7ac-7f3d89289c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:40.037498 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 982/1961] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:59:39 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:59:40.084390 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 980/1962] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:59:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:59:40.158854 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03989ed9-ffcc-4523-bc58-1628c7bacbbc None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:40.160451 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3155acd0-232e-48e0-a7ac-7f3d89289c5f None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:40.160642 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-03989ed9-ffcc-4523-bc58-1628c7bacbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:40.165630 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-3155acd0-232e-48e0-a7ac-7f3d89289c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:40.319842 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:40.360757 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3155acd0-232e-48e0-a7ac-7f3d89289c5f None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:40.364116 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03989ed9-ffcc-4523-bc58-1628c7bacbbc None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:40.374583 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c461c9eb-b07e-4de6-9a04-ebfc775ad99d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:40.375518 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461c9eb-b07e-4de6-9a04-ebfc775ad99d service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:40.375972 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461c9eb-b07e-4de6-9a04-ebfc775ad99d service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:40.376161 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad2b41d-bf6b-4f34-9340-825b9f150bd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:40.376643 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461c9eb-b07e-4de6-9a04-ebfc775ad99d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:40.376843 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2b41d-bf6b-4f34-9340-825b9f150bd3 service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:40.377941 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2b41d-bf6b-4f34-9340-825b9f150bd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:40.378288 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2b41d-bf6b-4f34-9340-825b9f150bd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:40.403084 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:40.404580 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c461c9eb-b07e-4de6-9a04-ebfc775ad99d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:40.406525 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c461c9eb-b07e-4de6-9a04-ebfc775ad99d service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:40.434178 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 983/1963] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:59:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:59:40.436006 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c461c9eb-b07e-4de6-9a04-ebfc775ad99d service neutron] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:40.442305 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-c461c9eb-b07e-4de6-9a04-ebfc775ad99d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:40.611224 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c461c9eb-b07e-4de6-9a04-ebfc775ad99d service neutron] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:40.619361 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b75e1-1ae0-4b56-9397-b1c7b4f14cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:40.620743 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b75e1-1ae0-4b56-9397-b1c7b4f14cb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:40.621294 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b75e1-1ae0-4b56-9397-b1c7b4f14cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:40.622062 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b75e1-1ae0-4b56-9397-b1c7b4f14cb8 admin admin] PATH_INFO: `/v3/users/cfec34d4145f4e188acdb2c1df19243a` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:40.624464 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86b75e1-1ae0-4b56-9397-b1c7b4f14cb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfec34d4145f4e188acdb2c1df19243a)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:40.626846 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86b75e1-1ae0-4b56-9397-b1c7b4f14cb8 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:40.637160 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad2b41d-bf6b-4f34-9340-825b9f150bd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:40.639253 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad2b41d-bf6b-4f34-9340-825b9f150bd3 service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:40.654130 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 981/1964] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:59:40 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:59:40.710165 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-b86b75e1-1ae0-4b56-9397-b1c7b4f14cb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfec34d4145f4e188acdb2c1df19243a'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:40.731468 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-b86b75e1-1ae0-4b56-9397-b1c7b4f14cb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfec34d4145f4e188acdb2c1df19243a'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:40.746789 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-b86b75e1-1ae0-4b56-9397-b1c7b4f14cb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfec34d4145f4e188acdb2c1df19243a'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:40.747747 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-b86b75e1-1ae0-4b56-9397-b1c7b4f14cb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfec34d4145f4e188acdb2c1df19243a'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:40.749637 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-b86b75e1-1ae0-4b56-9397-b1c7b4f14cb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfec34d4145f4e188acdb2c1df19243a'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:40.782165 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 984/1965] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 00:59:40 2022] DELETE /identity/v3/users/cfec34d4145f4e188acdb2c1df19243a => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:59:42.510325 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad2b41d-bf6b-4f34-9340-825b9f150bd3 service neutron] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:42.525638 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad2b41d-bf6b-4f34-9340-825b9f150bd3 service neutron] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:42.543008 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b75e1-1ae0-4b56-9397-b1c7b4f14cb8 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:42.544508 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-b86b75e1-1ae0-4b56-9397-b1c7b4f14cb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:42.696528 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ea8239-7e97-4472-a54a-1480cd9297db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:42.697263 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea8239-7e97-4472-a54a-1480cd9297db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:42.697549 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea8239-7e97-4472-a54a-1480cd9297db admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:42.698951 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea8239-7e97-4472-a54a-1480cd9297db admin admin] PATH_INFO: `/v3/projects/c60e4af3c43647e29654026b64e88e36` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:42.703437 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ea8239-7e97-4472-a54a-1480cd9297db admin admin] RBAC: Authorizing `identity:delete_project(project_id=c60e4af3c43647e29654026b64e88e36)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:42.707009 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ea8239-7e97-4472-a54a-1480cd9297db admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:42.719453 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b75e1-1ae0-4b56-9397-b1c7b4f14cb8 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:42.735643 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f42e59-ae5b-4598-8c0a-246a376937cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:42.736622 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f42e59-ae5b-4598-8c0a-246a376937cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:42.737095 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f42e59-ae5b-4598-8c0a-246a376937cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:42.737563 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f42e59-ae5b-4598-8c0a-246a376937cc admin admin] PATH_INFO: `/v3/users/e59b3267eb4344219ab45b2e9eb38515` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:42.740312 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f42e59-ae5b-4598-8c0a-246a376937cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e59b3267eb4344219ab45b2e9eb38515)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:42.744418 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f42e59-ae5b-4598-8c0a-246a376937cc admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:42.747552 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:42.919296 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-99ea8239-7e97-4472-a54a-1480cd9297db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c60e4af3c43647e29654026b64e88e36', 'request_id': 'req-99ea8239-7e97-4472-a54a-1480cd9297db'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:42.927205 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-99ea8239-7e97-4472-a54a-1480cd9297db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c60e4af3c43647e29654026b64e88e36', 'request_id': 'req-99ea8239-7e97-4472-a54a-1480cd9297db'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:42.957570 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-99ea8239-7e97-4472-a54a-1480cd9297db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c60e4af3c43647e29654026b64e88e36', 'request_id': 'req-99ea8239-7e97-4472-a54a-1480cd9297db'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:42.976285 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-99ea8239-7e97-4472-a54a-1480cd9297db admin admin] The token cache is being invalidate because project c60e4af3c43647e29654026b64e88e36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81808) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:59:42.976710 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-99ea8239-7e97-4472-a54a-1480cd9297db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:42.978199 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-99ea8239-7e97-4472-a54a-1480cd9297db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:42.981078 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 982/1966] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 00:59:42 2022] DELETE /identity/v3/projects/c60e4af3c43647e29654026b64e88e36 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:59:42.983048 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ea8239-7e97-4472-a54a-1480cd9297db admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:42.985293 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-99ea8239-7e97-4472-a54a-1480cd9297db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:43.004250 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-51f42e59-ae5b-4598-8c0a-246a376937cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e59b3267eb4344219ab45b2e9eb38515'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:43.051353 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-51f42e59-ae5b-4598-8c0a-246a376937cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e59b3267eb4344219ab45b2e9eb38515'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:43.078348 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-51f42e59-ae5b-4598-8c0a-246a376937cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e59b3267eb4344219ab45b2e9eb38515'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:43.080093 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-51f42e59-ae5b-4598-8c0a-246a376937cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e59b3267eb4344219ab45b2e9eb38515'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:43.081112 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-51f42e59-ae5b-4598-8c0a-246a376937cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e59b3267eb4344219ab45b2e9eb38515'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:43.089672 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:43.127804 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ea8239-7e97-4472-a54a-1480cd9297db admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:43.130411 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 985/1967] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 00:59:42 2022] DELETE /identity/v3/users/e59b3267eb4344219ab45b2e9eb38515 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:59:43.134642 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba0b748-ec17-4703-82ba-58af533d8b5c None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:43.135418 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba0b748-ec17-4703-82ba-58af533d8b5c None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:43.136264 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba0b748-ec17-4703-82ba-58af533d8b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:43.177092 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-9ba0b748-ec17-4703-82ba-58af533d8b5c None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:59:43.179755 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-9ba0b748-ec17-4703-82ba-58af533d8b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:43.244358 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2bb23d-ae26-4426-823d-169e2d5c3585 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:43.245096 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2bb23d-ae26-4426-823d-169e2d5c3585 service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:43.245479 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2bb23d-ae26-4426-823d-169e2d5c3585 service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:43.246045 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2bb23d-ae26-4426-823d-169e2d5c3585 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:43.251778 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-ed2bb23d-ae26-4426-823d-169e2d5c3585 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:43.279563 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 986/1968] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:59:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:59:43.279563 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ad44e-2110-4002-a006-fb01ad7f7634 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:43.279563 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ad44e-2110-4002-a006-fb01ad7f7634 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:43.279563 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ad44e-2110-4002-a006-fb01ad7f7634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:43.314985 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-834ad44e-2110-4002-a006-fb01ad7f7634 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:59:43.316672 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-834ad44e-2110-4002-a006-fb01ad7f7634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:43.339652 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 987/1969] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:59:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:59:43.343791 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d6998e-c4ab-4e2a-b538-9a021c7089f3 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:43.344096 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d6998e-c4ab-4e2a-b538-9a021c7089f3 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:43.344942 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d6998e-c4ab-4e2a-b538-9a021c7089f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:43.383597 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-53d6998e-c4ab-4e2a-b538-9a021c7089f3 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:59:43.385367 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-53d6998e-c4ab-4e2a-b538-9a021c7089f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:43.398863 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2bb23d-ae26-4426-823d-169e2d5c3585 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:43.400837 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2bb23d-ae26-4426-823d-169e2d5c3585 service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:43.405581 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 988/1970] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:59:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:59:43.408017 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d6998e-c4ab-4e2a-b538-9a021c7089f3 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:43.412922 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-53d6998e-c4ab-4e2a-b538-9a021c7089f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:43.419909 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 983/1971] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:59:42 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:59:43.421291 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2bb23d-ae26-4426-823d-169e2d5c3585 service neutron] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:43.432329 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d6998e-c4ab-4e2a-b538-9a021c7089f3 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:43.436000 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2bb23d-ae26-4426-823d-169e2d5c3585 service neutron] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:43.436693 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc2831d-7009-465b-862c-c4cefff523e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:43.437566 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2831d-7009-465b-862c-c4cefff523e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:43.437941 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2831d-7009-465b-862c-c4cefff523e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:43.438554 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2831d-7009-465b-862c-c4cefff523e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:43.445390 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e8a5b8-d2a5-4022-9785-1f6438ff33c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:43.446227 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8a5b8-d2a5-4022-9785-1f6438ff33c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:43.446647 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8a5b8-d2a5-4022-9785-1f6438ff33c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:43.448376 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8a5b8-d2a5-4022-9785-1f6438ff33c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:43.449432 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e8a5b8-d2a5-4022-9785-1f6438ff33c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:59:43.449900 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e8a5b8-d2a5-4022-9785-1f6438ff33c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:43.452174 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e8a5b8-d2a5-4022-9785-1f6438ff33c0 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:43.455256 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc2831d-7009-465b-862c-c4cefff523e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:43.457181 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc2831d-7009-465b-862c-c4cefff523e2 service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:43.496032 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 984/1972] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 00:59:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:59:43.497213 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 989/1973] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:59:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:59:43.501148 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e8a5b8-d2a5-4022-9785-1f6438ff33c0 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:43.513042 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e8a5b8-d2a5-4022-9785-1f6438ff33c0 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:43.523620 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b40604-09e0-467c-a5f6-380313026b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:43.530260 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b40604-09e0-467c-a5f6-380313026b37 admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:43.530707 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b40604-09e0-467c-a5f6-380313026b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:43.530986 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b40604-09e0-467c-a5f6-380313026b37 admin admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:43.531734 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b40604-09e0-467c-a5f6-380313026b37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:43.554473 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b40604-09e0-467c-a5f6-380313026b37 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:43.619365 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 985/1974] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 00:59:43 2022] POST /identity/v3/projects => generated 383 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:59:43.623970 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc2831d-7009-465b-862c-c4cefff523e2 service neutron] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:43.640148 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc2831d-7009-465b-862c-c4cefff523e2 service neutron] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:43.815884 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:43.842635 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d1396f-4e3d-4509-a468-5ae1f4ccaacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:43.843278 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1396f-4e3d-4509-a468-5ae1f4ccaacc admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:43.843560 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1396f-4e3d-4509-a468-5ae1f4ccaacc admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:43.843873 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d1396f-4e3d-4509-a468-5ae1f4ccaacc admin admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:43.844538 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d1396f-4e3d-4509-a468-5ae1f4ccaacc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:43.846929 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d1396f-4e3d-4509-a468-5ae1f4ccaacc admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:43.881703 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 990/1975] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 00:59:43 2022] POST /identity/v3/users => generated 292 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:59:43.883076 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b40604-09e0-467c-a5f6-380313026b37 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:43.898905 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b40604-09e0-467c-a5f6-380313026b37 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:43.904674 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5cfde6-8496-47e0-9fc2-5e3f2ffa31e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:43.906142 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5cfde6-8496-47e0-9fc2-5e3f2ffa31e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:43.906632 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5cfde6-8496-47e0-9fc2-5e3f2ffa31e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:43.907068 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5cfde6-8496-47e0-9fc2-5e3f2ffa31e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:43.908289 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5cfde6-8496-47e0-9fc2-5e3f2ffa31e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:43.910194 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5cfde6-8496-47e0-9fc2-5e3f2ffa31e4 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:43.929004 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 986/1976] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:59:43 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:59:43.931355 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d1396f-4e3d-4509-a468-5ae1f4ccaacc admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:43.943708 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d1396f-4e3d-4509-a468-5ae1f4ccaacc admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:43.954268 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e1bfb3-99c7-479a-9f4d-c1a7b5770836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:43.955131 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1bfb3-99c7-479a-9f4d-c1a7b5770836 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:43.955525 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1bfb3-99c7-479a-9f4d-c1a7b5770836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:43.958644 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1bfb3-99c7-479a-9f4d-c1a7b5770836 admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:43.964010 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e1bfb3-99c7-479a-9f4d-c1a7b5770836 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:43.977268 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e1bfb3-99c7-479a-9f4d-c1a7b5770836 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:44.022733 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 991/1977] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:59:43 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:59:44.029003 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5cfde6-8496-47e0-9fc2-5e3f2ffa31e4 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:44.059811 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5cfde6-8496-47e0-9fc2-5e3f2ffa31e4 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:44.071154 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7cf83c-fbb4-49fa-b077-4ac9845a268c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:44.072311 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7cf83c-fbb4-49fa-b077-4ac9845a268c admin admin] REQUEST_METHOD: `PUT` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:44.072827 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7cf83c-fbb4-49fa-b077-4ac9845a268c admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:44.073345 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7cf83c-fbb4-49fa-b077-4ac9845a268c admin admin] PATH_INFO: `/v3/projects/cd0a6f433e674f72a41d4efa397d5869/users/d067737911814ccf9661b23739243d26/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:44.107371 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7cf83c-fbb4-49fa-b077-4ac9845a268c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd0a6f433e674f72a41d4efa397d5869, user_id=d067737911814ccf9661b23739243d26, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:44.112302 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7cf83c-fbb4-49fa-b077-4ac9845a268c admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:44.134902 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 987/1978] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 00:59:44 2022] PUT /identity/v3/projects/cd0a6f433e674f72a41d4efa397d5869/users/d067737911814ccf9661b23739243d26/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:59:44.146651 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0756a-db56-45c5-8141-0896d40a1092 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:44.147207 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0756a-db56-45c5-8141-0896d40a1092 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:44.147530 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0756a-db56-45c5-8141-0896d40a1092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:44.195069 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-2fa0756a-db56-45c5-8141-0896d40a1092 None None] MFA Rules not processed for user `d067737911814ccf9661b23739243d26`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:59:44.197664 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-2fa0756a-db56-45c5-8141-0896d40a1092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:44.300796 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 992/1979] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:59:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:59:44.308277 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7cf83c-fbb4-49fa-b077-4ac9845a268c admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:44.411084 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:44.488533 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa0756a-db56-45c5-8141-0896d40a1092 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:44.490521 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-2fa0756a-db56-45c5-8141-0896d40a1092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:44.492251 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7cf83c-fbb4-49fa-b077-4ac9845a268c admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:44.509318 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b910aee3-7edd-4a96-87cb-3ec71f91479c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:44.510136 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910aee3-7edd-4a96-87cb-3ec71f91479c admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:44.510396 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910aee3-7edd-4a96-87cb-3ec71f91479c admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:44.510665 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910aee3-7edd-4a96-87cb-3ec71f91479c admin admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:44.511537 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b910aee3-7edd-4a96-87cb-3ec71f91479c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:44.513550 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b910aee3-7edd-4a96-87cb-3ec71f91479c admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:44.541731 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa0756a-db56-45c5-8141-0896d40a1092 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:44.560514 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b882e9-13cd-42ef-9f4e-c2b8654cd1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:44.564513 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b882e9-13cd-42ef-9f4e-c2b8654cd1ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:44.564861 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b882e9-13cd-42ef-9f4e-c2b8654cd1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:44.566131 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b882e9-13cd-42ef-9f4e-c2b8654cd1ed admin admin] PATH_INFO: `/v3/projects/3fb88bc542e24355ac01b2f8326d0198` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:44.568939 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b882e9-13cd-42ef-9f4e-c2b8654cd1ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fb88bc542e24355ac01b2f8326d0198)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:44.578565 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b882e9-13cd-42ef-9f4e-c2b8654cd1ed admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:44.596524 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 988/1980] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 00:59:44 2022] POST /identity/v3/projects => generated 381 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:59:44.597535 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b910aee3-7edd-4a96-87cb-3ec71f91479c admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:44.735082 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-10b882e9-13cd-42ef-9f4e-c2b8654cd1ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fb88bc542e24355ac01b2f8326d0198', 'request_id': 'req-10b882e9-13cd-42ef-9f4e-c2b8654cd1ed'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:44.759757 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-10b882e9-13cd-42ef-9f4e-c2b8654cd1ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fb88bc542e24355ac01b2f8326d0198', 'request_id': 'req-10b882e9-13cd-42ef-9f4e-c2b8654cd1ed'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:44.766082 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b910aee3-7edd-4a96-87cb-3ec71f91479c admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:44.774713 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-10b882e9-13cd-42ef-9f4e-c2b8654cd1ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fb88bc542e24355ac01b2f8326d0198', 'request_id': 'req-10b882e9-13cd-42ef-9f4e-c2b8654cd1ed'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:44.803496 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-10b882e9-13cd-42ef-9f4e-c2b8654cd1ed admin admin] The token cache is being invalidate because project 3fb88bc542e24355ac01b2f8326d0198 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81807) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 00:59:44.803831 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-10b882e9-13cd-42ef-9f4e-c2b8654cd1ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:44.805808 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-10b882e9-13cd-42ef-9f4e-c2b8654cd1ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 00:59:44.807641 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 993/1981] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 00:59:44 2022] DELETE /identity/v3/projects/3fb88bc542e24355ac01b2f8326d0198 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:59:44.812622 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95db20a-15b4-489c-9f06-3d87eee8eaa6 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:44.812917 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95db20a-15b4-489c-9f06-3d87eee8eaa6 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:44.813196 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95db20a-15b4-489c-9f06-3d87eee8eaa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:44.861161 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-a95db20a-15b4-489c-9f06-3d87eee8eaa6 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:59:44.863108 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-a95db20a-15b4-489c-9f06-3d87eee8eaa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:44.869112 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e06a8-2968-4edf-8146-a76417cf1e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:44.870075 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e06a8-2968-4edf-8146-a76417cf1e4c admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:44.871364 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e06a8-2968-4edf-8146-a76417cf1e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:44.871995 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e06a8-2968-4edf-8146-a76417cf1e4c admin admin] PATH_INFO: `/v3/users` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:44.872942 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1e06a8-2968-4edf-8146-a76417cf1e4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:44.876218 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1e06a8-2968-4edf-8146-a76417cf1e4c admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:44.886192 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 994/1982] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:59:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:59:44.895240 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69d2fa-c9ca-471c-b1a8-ff827c9adb0f None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:44.895536 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69d2fa-c9ca-471c-b1a8-ff827c9adb0f None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:44.895975 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e69d2fa-c9ca-471c-b1a8-ff827c9adb0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:44.924871 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 989/1983] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 00:59:44 2022] POST /identity/v3/users => generated 291 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:59:44.927806 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e06a8-2968-4edf-8146-a76417cf1e4c admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:44.929802 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-fd1e06a8-2968-4edf-8146-a76417cf1e4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:44.930049 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-4e69d2fa-c9ca-471c-b1a8-ff827c9adb0f None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:59:44.931383 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-4e69d2fa-c9ca-471c-b1a8-ff827c9adb0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:44.944268 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e06a8-2968-4edf-8146-a76417cf1e4c admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:44.944495 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 995/1984] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:59:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 00:59:44.948737 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e69d2fa-c9ca-471c-b1a8-ff827c9adb0f None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:44.950792 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d24ccd8-11c3-4425-996b-106e2ca80662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:44.952488 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d24ccd8-11c3-4425-996b-106e2ca80662 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:44.952918 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d24ccd8-11c3-4425-996b-106e2ca80662 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:44.953335 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d24ccd8-11c3-4425-996b-106e2ca80662 admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:44.954299 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d24ccd8-11c3-4425-996b-106e2ca80662 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:44.956716 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d24ccd8-11c3-4425-996b-106e2ca80662 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:44.973489 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e69d2fa-c9ca-471c-b1a8-ff827c9adb0f None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:44.977162 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 990/1985] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:59:44 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:59:44.979106 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d24ccd8-11c3-4425-996b-106e2ca80662 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:44.983242 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0cf2a2-c6d6-4b23-8c54-e4194674cf7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:44.984017 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0cf2a2-c6d6-4b23-8c54-e4194674cf7c admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:44.984403 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0cf2a2-c6d6-4b23-8c54-e4194674cf7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:44.985526 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0cf2a2-c6d6-4b23-8c54-e4194674cf7c admin admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:44.987249 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0cf2a2-c6d6-4b23-8c54-e4194674cf7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 00:59:44.988089 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0cf2a2-c6d6-4b23-8c54-e4194674cf7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:44.991384 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0cf2a2-c6d6-4b23-8c54-e4194674cf7c admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:45.000195 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d24ccd8-11c3-4425-996b-106e2ca80662 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:45.007847 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f996623f-4a6f-4ddb-a031-cd7f2a93d081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:45.009751 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996623f-4a6f-4ddb-a031-cd7f2a93d081 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:45.010396 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996623f-4a6f-4ddb-a031-cd7f2a93d081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:45.010877 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f996623f-4a6f-4ddb-a031-cd7f2a93d081 admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:45.012358 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f996623f-4a6f-4ddb-a031-cd7f2a93d081 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:45.015428 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f996623f-4a6f-4ddb-a031-cd7f2a93d081 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:45.019780 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 996/1986] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 00:59:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 00:59:45.020725 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0cf2a2-c6d6-4b23-8c54-e4194674cf7c admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:45.037992 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0cf2a2-c6d6-4b23-8c54-e4194674cf7c admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:45.040191 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 991/1987] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:59:44 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:59:45.041689 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f996623f-4a6f-4ddb-a031-cd7f2a93d081 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:45.043764 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92648857-ce85-4b1a-8f6e-f78cc33bf89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:45.044650 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92648857-ce85-4b1a-8f6e-f78cc33bf89f admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:45.044936 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92648857-ce85-4b1a-8f6e-f78cc33bf89f admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:45.045253 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92648857-ce85-4b1a-8f6e-f78cc33bf89f admin admin] PATH_INFO: `/v3/projects` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:45.046253 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92648857-ce85-4b1a-8f6e-f78cc33bf89f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:45.048422 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92648857-ce85-4b1a-8f6e-f78cc33bf89f admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:45.058694 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f996623f-4a6f-4ddb-a031-cd7f2a93d081 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:45.067593 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18a1341-3205-47f6-95a0-656cb7db95b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:45.069277 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:45.071207 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a1341-3205-47f6-95a0-656cb7db95b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:45.071791 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a1341-3205-47f6-95a0-656cb7db95b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:45.072278 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18a1341-3205-47f6-95a0-656cb7db95b5 admin admin] PATH_INFO: `/v3/projects/07cccfa37b9648de95f7df5cadb98ce4/users/5acf0814c16b47688bd3a2ac9986105e/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:45.093670 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 997/1988] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 00:59:45 2022] POST /identity/v3/projects => generated 361 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:59:45.094873 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92648857-ce85-4b1a-8f6e-f78cc33bf89f admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:45.109855 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18a1341-3205-47f6-95a0-656cb7db95b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07cccfa37b9648de95f7df5cadb98ce4, user_id=5acf0814c16b47688bd3a2ac9986105e, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:45.113773 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18a1341-3205-47f6-95a0-656cb7db95b5 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:45.137716 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 992/1989] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 00:59:45 2022] PUT /identity/v3/projects/07cccfa37b9648de95f7df5cadb98ce4/users/5acf0814c16b47688bd3a2ac9986105e/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:59:45.149020 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe375f-29bc-4a55-b374-9caff1c0793d None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:45.149947 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe375f-29bc-4a55-b374-9caff1c0793d None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:45.150430 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe375f-29bc-4a55-b374-9caff1c0793d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:45.176110 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:45.196046 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92648857-ce85-4b1a-8f6e-f78cc33bf89f admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:45.211881 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-3cfe375f-29bc-4a55-b374-9caff1c0793d None None] MFA Rules not processed for user `5acf0814c16b47688bd3a2ac9986105e`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:59:45.213835 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-3cfe375f-29bc-4a55-b374-9caff1c0793d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:45.260625 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac3c4b-59d8-44a1-8287-3f021c66a8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:45.261233 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac3c4b-59d8-44a1-8287-3f021c66a8e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:45.261721 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac3c4b-59d8-44a1-8287-3f021c66a8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:45.262160 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac3c4b-59d8-44a1-8287-3f021c66a8e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:45.262859 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ac3c4b-59d8-44a1-8287-3f021c66a8e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:45.265080 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ac3c4b-59d8-44a1-8287-3f021c66a8e0 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:45.293708 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 998/1990] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 00:59:45 2022] POST /identity/v3/users => generated 281 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:59:45.298626 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac3c4b-59d8-44a1-8287-3f021c66a8e0 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:45.311299 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac3c4b-59d8-44a1-8287-3f021c66a8e0 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:45.318570 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbd50c7-b08c-475b-95a4-845d08c91982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:45.319710 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd50c7-b08c-475b-95a4-845d08c91982 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:45.319710 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd50c7-b08c-475b-95a4-845d08c91982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:45.319884 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd50c7-b08c-475b-95a4-845d08c91982 admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:45.320460 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbd50c7-b08c-475b-95a4-845d08c91982 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:45.322989 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbd50c7-b08c-475b-95a4-845d08c91982 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:45.328334 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 993/1991] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:59:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:59:45.333826 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe375f-29bc-4a55-b374-9caff1c0793d None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:45.343215 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 999/1992] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:59:45 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:59:45.344250 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbd50c7-b08c-475b-95a4-845d08c91982 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:45.349509 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe375f-29bc-4a55-b374-9caff1c0793d None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:45.355163 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbd50c7-b08c-475b-95a4-845d08c91982 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:45.359354 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3613ad1a-cc95-431d-ae04-e68c45784b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:45.360280 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3613ad1a-cc95-431d-ae04-e68c45784b2b admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:45.360388 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c7acee-0201-426f-ab6f-1c73890bd285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:45.360940 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7acee-0201-426f-ab6f-1c73890bd285 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:45.361143 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3613ad1a-cc95-431d-ae04-e68c45784b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:45.361240 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7acee-0201-426f-ab6f-1c73890bd285 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:45.361628 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7acee-0201-426f-ab6f-1c73890bd285 admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:45.362164 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3613ad1a-cc95-431d-ae04-e68c45784b2b admin admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:45.362278 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c7acee-0201-426f-ab6f-1c73890bd285 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:45.363708 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3613ad1a-cc95-431d-ae04-e68c45784b2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:45.364077 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c7acee-0201-426f-ab6f-1c73890bd285 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:45.366645 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3613ad1a-cc95-431d-ae04-e68c45784b2b admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:45.380843 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1000/1993] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:59:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:59:45.381800 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c7acee-0201-426f-ab6f-1c73890bd285 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:45.395811 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c7acee-0201-426f-ab6f-1c73890bd285 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:45.402977 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55bf8aa-0738-48e6-89ee-fa81bd742a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:45.403746 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55bf8aa-0738-48e6-89ee-fa81bd742a81 admin admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:45.404461 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55bf8aa-0738-48e6-89ee-fa81bd742a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:45.404461 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55bf8aa-0738-48e6-89ee-fa81bd742a81 admin admin] PATH_INFO: `/v3/projects/6c112bfaa4c741c4be2eb46fe624f818/users/44b042cf34a7426cbcce8fa13c0c946e/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:45.424840 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 994/1994] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 00:59:45 2022] POST /identity/v3/projects => generated 383 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:59:45.430152 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3613ad1a-cc95-431d-ae04-e68c45784b2b admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:45.445348 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55bf8aa-0738-48e6-89ee-fa81bd742a81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c112bfaa4c741c4be2eb46fe624f818, user_id=44b042cf34a7426cbcce8fa13c0c946e, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:45.448194 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55bf8aa-0738-48e6-89ee-fa81bd742a81 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:45.478303 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1001/1995] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 00:59:45 2022] PUT /identity/v3/projects/6c112bfaa4c741c4be2eb46fe624f818/users/44b042cf34a7426cbcce8fa13c0c946e/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:59:45.489432 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8efbc9-0ed6-45a7-be6b-94bf98bedb74 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:45.489432 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8efbc9-0ed6-45a7-be6b-94bf98bedb74 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:45.489432 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8efbc9-0ed6-45a7-be6b-94bf98bedb74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:45.574115 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-3d8efbc9-0ed6-45a7-be6b-94bf98bedb74 None None] MFA Rules not processed for user `44b042cf34a7426cbcce8fa13c0c946e`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:59:45.577847 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-3d8efbc9-0ed6-45a7-be6b-94bf98bedb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:45.621631 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3613ad1a-cc95-431d-ae04-e68c45784b2b admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:45.733368 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:45.764320 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f3ea23-b831-4a6c-9f47-cb74aab456bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:45.765099 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f3ea23-b831-4a6c-9f47-cb74aab456bb admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:45.765390 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f3ea23-b831-4a6c-9f47-cb74aab456bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:45.765656 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f3ea23-b831-4a6c-9f47-cb74aab456bb admin admin] PATH_INFO: `/v3/users` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:45.766306 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f3ea23-b831-4a6c-9f47-cb74aab456bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:45.769919 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f3ea23-b831-4a6c-9f47-cb74aab456bb admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:45.807161 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1002/1996] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:59:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:59:45.826945 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 995/1997] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 00:59:45 2022] POST /identity/v3/users => generated 298 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 00:59:45.831338 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8efbc9-0ed6-45a7-be6b-94bf98bedb74 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:45.853736 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8efbc9-0ed6-45a7-be6b-94bf98bedb74 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:45.869765 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce2e3a4-f0bc-457e-8615-6264c3ecd14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:45.870922 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2e3a4-f0bc-457e-8615-6264c3ecd14a admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:45.871415 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2e3a4-f0bc-457e-8615-6264c3ecd14a admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:45.872565 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2e3a4-f0bc-457e-8615-6264c3ecd14a admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:45.874583 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce2e3a4-f0bc-457e-8615-6264c3ecd14a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:45.891697 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce2e3a4-f0bc-457e-8615-6264c3ecd14a admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:45.910060 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1003/1998] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:59:45 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:59:45.910961 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f3ea23-b831-4a6c-9f47-cb74aab456bb admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:45.961449 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f3ea23-b831-4a6c-9f47-cb74aab456bb admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:45.982138 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf26462d-e41e-4b6e-95a6-9a2c4f6d0f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:45.983015 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26462d-e41e-4b6e-95a6-9a2c4f6d0f67 admin admin] REQUEST_METHOD: `PUT` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:45.983494 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26462d-e41e-4b6e-95a6-9a2c4f6d0f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:45.983870 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26462d-e41e-4b6e-95a6-9a2c4f6d0f67 admin admin] PATH_INFO: `/v3/projects/715a9d1a4a8f43479d6090610b104709/users/aca1578a36f94ad6989f2208f8b67ae0/roles/2e4889bb71f9434392c0baba59f2534e` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:46.001671 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:46.013048 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf26462d-e41e-4b6e-95a6-9a2c4f6d0f67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=715a9d1a4a8f43479d6090610b104709, user_id=aca1578a36f94ad6989f2208f8b67ae0, role_id=2e4889bb71f9434392c0baba59f2534e)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:46.024841 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf26462d-e41e-4b6e-95a6-9a2c4f6d0f67 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:46.058666 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 996/1999] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 00:59:45 2022] PUT /identity/v3/projects/715a9d1a4a8f43479d6090610b104709/users/aca1578a36f94ad6989f2208f8b67ae0/roles/2e4889bb71f9434392c0baba59f2534e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:59:46.062783 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce2e3a4-f0bc-457e-8615-6264c3ecd14a admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:46.085375 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce2e3a4-f0bc-457e-8615-6264c3ecd14a admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:46.278649 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0952b1c7-7f41-42e6-9d2d-330ffe27dd22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:46.279376 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952b1c7-7f41-42e6-9d2d-330ffe27dd22 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:46.279763 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952b1c7-7f41-42e6-9d2d-330ffe27dd22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:46.280154 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952b1c7-7f41-42e6-9d2d-330ffe27dd22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:46.280878 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0952b1c7-7f41-42e6-9d2d-330ffe27dd22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:46.282572 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0952b1c7-7f41-42e6-9d2d-330ffe27dd22 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:46.339288 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf26462d-e41e-4b6e-95a6-9a2c4f6d0f67 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:46.347773 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1004/2000] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 00:59:46 2022] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 00:59:46.353612 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf26462d-e41e-4b6e-95a6-9a2c4f6d0f67 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:46.365424 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae9da5-9923-4967-8419-6d9b4d901c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:46.366522 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae9da5-9923-4967-8419-6d9b4d901c94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:46.366938 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae9da5-9923-4967-8419-6d9b4d901c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:46.367301 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae9da5-9923-4967-8419-6d9b4d901c94 admin admin] PATH_INFO: `/v3/projects/715a9d1a4a8f43479d6090610b104709/users/aca1578a36f94ad6989f2208f8b67ae0/roles/2e4889bb71f9434392c0baba59f2534e` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:46.369838 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ae9da5-9923-4967-8419-6d9b4d901c94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=715a9d1a4a8f43479d6090610b104709, user_id=aca1578a36f94ad6989f2208f8b67ae0, role_id=2e4889bb71f9434392c0baba59f2534e)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:46.373971 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ae9da5-9923-4967-8419-6d9b4d901c94 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:46.429256 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 997/2001] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 00:59:46 2022] PUT /identity/v3/projects/715a9d1a4a8f43479d6090610b104709/users/aca1578a36f94ad6989f2208f8b67ae0/roles/2e4889bb71f9434392c0baba59f2534e => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 00:59:46.436637 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343b40a-278c-4787-8ed8-eefef5b67dbb None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:46.437036 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343b40a-278c-4787-8ed8-eefef5b67dbb None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:46.437400 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343b40a-278c-4787-8ed8-eefef5b67dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:46.446190 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae9da5-9923-4967-8419-6d9b4d901c94 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:46.450021 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-86ae9da5-9923-4967-8419-6d9b4d901c94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:46.520155 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-9343b40a-278c-4787-8ed8-eefef5b67dbb None None] MFA Rules not processed for user `aca1578a36f94ad6989f2208f8b67ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 00:59:46.526865 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-9343b40a-278c-4787-8ed8-eefef5b67dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:46.638668 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae9da5-9923-4967-8419-6d9b4d901c94 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:46.648736 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8968b0-1e8d-4ba5-9234-bdde92be0350 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:46.650531 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8968b0-1e8d-4ba5-9234-bdde92be0350 service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:46.651019 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8968b0-1e8d-4ba5-9234-bdde92be0350 service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:46.651491 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8968b0-1e8d-4ba5-9234-bdde92be0350 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:46.746163 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8968b0-1e8d-4ba5-9234-bdde92be0350 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:46.747962 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8968b0-1e8d-4ba5-9234-bdde92be0350 service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:46.759535 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 998/2002] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:59:46 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 00:59:46.778285 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1005/2003] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 00:59:46 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 00:59:46.885139 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8968b0-1e8d-4ba5-9234-bdde92be0350 service neutron] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 00:59:46.886815 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-de8968b0-1e8d-4ba5-9234-bdde92be0350 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:46.909138 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8968b0-1e8d-4ba5-9234-bdde92be0350 service neutron] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 00:59:46.919007 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e05aa72-b56c-4956-bc49-81ea2ec8c13e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 00:59:46.920520 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e05aa72-b56c-4956-bc49-81ea2ec8c13e service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 00:59:46.921292 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e05aa72-b56c-4956-bc49-81ea2ec8c13e service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 00:59:46.921803 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e05aa72-b56c-4956-bc49-81ea2ec8c13e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 00:59:46.925594 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-9e05aa72-b56c-4956-bc49-81ea2ec8c13e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 00:59:47.059824 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e05aa72-b56c-4956-bc49-81ea2ec8c13e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 00:59:47.065408 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e05aa72-b56c-4956-bc49-81ea2ec8c13e service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 00:59:47.103767 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 999/2004] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 00:59:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 00:59:56.768365 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=79 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 00:59:57.086911 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=86,keystone:INSERT=2 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:06.223868 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9343b40a-278c-4787-8ed8-eefef5b67dbb None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:06.226003 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-9343b40a-278c-4787-8ed8-eefef5b67dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:06.306950 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9343b40a-278c-4787-8ed8-eefef5b67dbb None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:06.311882 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d2707c-9b2d-4810-89c5-3758fbb74bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:06.312665 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2707c-9b2d-4810-89c5-3758fbb74bff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:06.313035 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2707c-9b2d-4810-89c5-3758fbb74bff admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:06.313398 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2707c-9b2d-4810-89c5-3758fbb74bff admin admin] PATH_INFO: `/v3/users/cbe2b4c7906b4168becbad27b8699eb1` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:06.314809 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d2707c-9b2d-4810-89c5-3758fbb74bff admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbe2b4c7906b4168becbad27b8699eb1)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:06.317553 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d2707c-9b2d-4810-89c5-3758fbb74bff admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:06.427636 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-88d2707c-9b2d-4810-89c5-3758fbb74bff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbe2b4c7906b4168becbad27b8699eb1'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:06.445079 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-88d2707c-9b2d-4810-89c5-3758fbb74bff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbe2b4c7906b4168becbad27b8699eb1'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:06.458599 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-88d2707c-9b2d-4810-89c5-3758fbb74bff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbe2b4c7906b4168becbad27b8699eb1'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:06.459406 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-88d2707c-9b2d-4810-89c5-3758fbb74bff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbe2b4c7906b4168becbad27b8699eb1'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:06.460092 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-88d2707c-9b2d-4810-89c5-3758fbb74bff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbe2b4c7906b4168becbad27b8699eb1'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:06.487297 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1006/2005] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 01:00:06 2022] DELETE /identity/v3/users/cbe2b4c7906b4168becbad27b8699eb1 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:00:06.491799 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae96ff-7663-4e3e-b7d2-19ca5155eeda None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:06.492489 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae96ff-7663-4e3e-b7d2-19ca5155eeda None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:06.492771 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae96ff-7663-4e3e-b7d2-19ca5155eeda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:06.519857 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-26ae96ff-7663-4e3e-b7d2-19ca5155eeda None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:06.521149 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-26ae96ff-7663-4e3e-b7d2-19ca5155eeda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:06.648840 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1000/2006] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:00:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:00:06.668863 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d2707c-9b2d-4810-89c5-3758fbb74bff admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:06.670660 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-88d2707c-9b2d-4810-89c5-3758fbb74bff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:06.775478 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d2707c-9b2d-4810-89c5-3758fbb74bff admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:06.779746 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53ba21-568b-4290-a9d9-ce475b9cf1e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:06.780651 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53ba21-568b-4290-a9d9-ce475b9cf1e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:06.781030 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53ba21-568b-4290-a9d9-ce475b9cf1e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:06.781546 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53ba21-568b-4290-a9d9-ce475b9cf1e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:06.797310 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe53ba21-568b-4290-a9d9-ce475b9cf1e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:06.799003 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe53ba21-568b-4290-a9d9-ce475b9cf1e8 service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:06.810258 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1007/2007] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:00:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:00:07.200726 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ae96ff-7663-4e3e-b7d2-19ca5155eeda None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:07.203216 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-26ae96ff-7663-4e3e-b7d2-19ca5155eeda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:07.226633 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ae96ff-7663-4e3e-b7d2-19ca5155eeda None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:07.238367 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e6749-9201-480c-985c-cbc33c90140d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:07.239056 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e6749-9201-480c-985c-cbc33c90140d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:07.239339 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e6749-9201-480c-985c-cbc33c90140d admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:07.239613 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e6749-9201-480c-985c-cbc33c90140d admin admin] PATH_INFO: `/v3/projects/2fe456cc7b384df3bdcc8ee479c3c9b7` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:07.243097 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128e6749-9201-480c-985c-cbc33c90140d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fe456cc7b384df3bdcc8ee479c3c9b7)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:07.250417 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128e6749-9201-480c-985c-cbc33c90140d admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:07.351292 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-128e6749-9201-480c-985c-cbc33c90140d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fe456cc7b384df3bdcc8ee479c3c9b7', 'request_id': 'req-128e6749-9201-480c-985c-cbc33c90140d'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:07.359461 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-128e6749-9201-480c-985c-cbc33c90140d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fe456cc7b384df3bdcc8ee479c3c9b7', 'request_id': 'req-128e6749-9201-480c-985c-cbc33c90140d'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:07.374267 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-128e6749-9201-480c-985c-cbc33c90140d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fe456cc7b384df3bdcc8ee479c3c9b7', 'request_id': 'req-128e6749-9201-480c-985c-cbc33c90140d'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:07.400667 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-128e6749-9201-480c-985c-cbc33c90140d admin admin] The token cache is being invalidate because project 2fe456cc7b384df3bdcc8ee479c3c9b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81808) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:00:07.400961 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-128e6749-9201-480c-985c-cbc33c90140d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:07.401683 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-128e6749-9201-480c-985c-cbc33c90140d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:07.403642 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1001/2008] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 01:00:07 2022] DELETE /identity/v3/projects/2fe456cc7b384df3bdcc8ee479c3c9b7 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:00:07.407746 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53ba21-568b-4290-a9d9-ce475b9cf1e8 service neutron] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:07.423981 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53ba21-568b-4290-a9d9-ce475b9cf1e8 service neutron] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:07.481713 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:07.564277 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70745be4-4131-4e3d-90b0-5786ba31674f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:07.565351 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70745be4-4131-4e3d-90b0-5786ba31674f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:07.566039 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70745be4-4131-4e3d-90b0-5786ba31674f admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:07.566550 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70745be4-4131-4e3d-90b0-5786ba31674f admin admin] PATH_INFO: `/v3/users/c26263fd8c55496d855cf25a24cea631` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:07.570146 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70745be4-4131-4e3d-90b0-5786ba31674f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c26263fd8c55496d855cf25a24cea631)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:07.572689 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70745be4-4131-4e3d-90b0-5786ba31674f admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:07.662489 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-70745be4-4131-4e3d-90b0-5786ba31674f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c26263fd8c55496d855cf25a24cea631'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:07.686046 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-70745be4-4131-4e3d-90b0-5786ba31674f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c26263fd8c55496d855cf25a24cea631'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:07.699123 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-70745be4-4131-4e3d-90b0-5786ba31674f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c26263fd8c55496d855cf25a24cea631'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:07.700112 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-70745be4-4131-4e3d-90b0-5786ba31674f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c26263fd8c55496d855cf25a24cea631'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:07.702116 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-70745be4-4131-4e3d-90b0-5786ba31674f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c26263fd8c55496d855cf25a24cea631'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:07.720235 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1008/2009] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 01:00:07 2022] DELETE /identity/v3/users/c26263fd8c55496d855cf25a24cea631 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:00:09.279012 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e6749-9201-480c-985c-cbc33c90140d admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:09.284763 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-128e6749-9201-480c-985c-cbc33c90140d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:09.303060 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e6749-9201-480c-985c-cbc33c90140d admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:09.445830 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb693422-d1d5-4814-9dfd-cf35af46002e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:09.446929 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb693422-d1d5-4814-9dfd-cf35af46002e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:09.447425 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb693422-d1d5-4814-9dfd-cf35af46002e admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:09.447984 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb693422-d1d5-4814-9dfd-cf35af46002e admin admin] PATH_INFO: `/v3/projects/2367110534aa466381ad59d8c15cd8c5` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:09.449430 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb693422-d1d5-4814-9dfd-cf35af46002e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2367110534aa466381ad59d8c15cd8c5)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:09.453415 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb693422-d1d5-4814-9dfd-cf35af46002e admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:09.499927 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:09.533425 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-cb693422-d1d5-4814-9dfd-cf35af46002e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2367110534aa466381ad59d8c15cd8c5', 'request_id': 'req-cb693422-d1d5-4814-9dfd-cf35af46002e'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:09.542880 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-cb693422-d1d5-4814-9dfd-cf35af46002e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2367110534aa466381ad59d8c15cd8c5', 'request_id': 'req-cb693422-d1d5-4814-9dfd-cf35af46002e'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:09.555522 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-cb693422-d1d5-4814-9dfd-cf35af46002e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2367110534aa466381ad59d8c15cd8c5', 'request_id': 'req-cb693422-d1d5-4814-9dfd-cf35af46002e'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:09.570262 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-cb693422-d1d5-4814-9dfd-cf35af46002e admin admin] The token cache is being invalidate because project 2367110534aa466381ad59d8c15cd8c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81808) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:00:09.570708 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-cb693422-d1d5-4814-9dfd-cf35af46002e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:09.572279 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-cb693422-d1d5-4814-9dfd-cf35af46002e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:09.579030 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1002/2010] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 01:00:09 2022] DELETE /identity/v3/projects/2367110534aa466381ad59d8c15cd8c5 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:00:09.580329 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c067a4d-5dfd-43f8-b3dc-4e2b3aec9691 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:09.580816 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c067a4d-5dfd-43f8-b3dc-4e2b3aec9691 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:09.580911 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c067a4d-5dfd-43f8-b3dc-4e2b3aec9691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:09.624259 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-9c067a4d-5dfd-43f8-b3dc-4e2b3aec9691 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:09.625783 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-9c067a4d-5dfd-43f8-b3dc-4e2b3aec9691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:09.761820 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1009/2011] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:00:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:00:09.771056 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b87bfa-083e-4437-8a4a-335b870b1149 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:09.771718 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b87bfa-083e-4437-8a4a-335b870b1149 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:09.771861 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b87bfa-083e-4437-8a4a-335b870b1149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:09.795835 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-69b87bfa-083e-4437-8a4a-335b870b1149 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:09.797351 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-69b87bfa-083e-4437-8a4a-335b870b1149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:09.811365 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1003/2012] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:00:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:00:09.813001 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c067a4d-5dfd-43f8-b3dc-4e2b3aec9691 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:09.824633 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c067a4d-5dfd-43f8-b3dc-4e2b3aec9691 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:09.839402 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91d9eea-b7c1-4e7c-8941-0a8ab29d7c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:09.840749 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d9eea-b7c1-4e7c-8941-0a8ab29d7c77 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:09.841179 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d9eea-b7c1-4e7c-8941-0a8ab29d7c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:09.841816 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d9eea-b7c1-4e7c-8941-0a8ab29d7c77 admin admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:09.844755 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91d9eea-b7c1-4e7c-8941-0a8ab29d7c77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:00:09.845312 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91d9eea-b7c1-4e7c-8941-0a8ab29d7c77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:09.847950 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91d9eea-b7c1-4e7c-8941-0a8ab29d7c77 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:09.863169 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1010/2013] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 01:00:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:00:09.867216 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b87bfa-083e-4437-8a4a-335b870b1149 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:09.877648 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b87bfa-083e-4437-8a4a-335b870b1149 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:09.882521 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24576222-f52d-4037-8388-39e371f2b77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:09.883577 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24576222-f52d-4037-8388-39e371f2b77a admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:09.883577 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24576222-f52d-4037-8388-39e371f2b77a admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:09.883924 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24576222-f52d-4037-8388-39e371f2b77a admin admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:09.884735 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24576222-f52d-4037-8388-39e371f2b77a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:09.886727 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24576222-f52d-4037-8388-39e371f2b77a admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:09.927985 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1004/2014] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 01:00:09 2022] POST /identity/v3/projects => generated 407 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:00:09.928825 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91d9eea-b7c1-4e7c-8941-0a8ab29d7c77 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:09.941050 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91d9eea-b7c1-4e7c-8941-0a8ab29d7c77 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:09.999980 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:10.050039 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f22a922-94db-4971-911d-9ff76728033d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:10.051625 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22a922-94db-4971-911d-9ff76728033d admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:10.053032 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22a922-94db-4971-911d-9ff76728033d admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:10.053501 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22a922-94db-4971-911d-9ff76728033d admin admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:10.054310 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f22a922-94db-4971-911d-9ff76728033d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:10.057088 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f22a922-94db-4971-911d-9ff76728033d admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:10.091002 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24576222-f52d-4037-8388-39e371f2b77a admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:10.100307 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1011/2015] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 01:00:09 2022] POST /identity/v3/users => generated 304 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:00:10.107546 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24576222-f52d-4037-8388-39e371f2b77a admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:10.114053 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979afe6-e710-4154-9195-8a094088d2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:10.114757 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979afe6-e710-4154-9195-8a094088d2ad admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:10.115036 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979afe6-e710-4154-9195-8a094088d2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:10.115477 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979afe6-e710-4154-9195-8a094088d2ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:10.116289 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6979afe6-e710-4154-9195-8a094088d2ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:10.118812 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6979afe6-e710-4154-9195-8a094088d2ad admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:10.139790 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f22a922-94db-4971-911d-9ff76728033d admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:10.144106 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1005/2016] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:00:10.154504 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f22a922-94db-4971-911d-9ff76728033d admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:10.160853 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0a3c88-62c9-47ef-8195-582a1ef8a059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:10.161652 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a3c88-62c9-47ef-8195-582a1ef8a059 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:10.161935 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a3c88-62c9-47ef-8195-582a1ef8a059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:10.162206 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a3c88-62c9-47ef-8195-582a1ef8a059 admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:10.163102 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0a3c88-62c9-47ef-8195-582a1ef8a059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:10.165633 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0a3c88-62c9-47ef-8195-582a1ef8a059 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:10.184148 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1012/2017] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:00:10.184967 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979afe6-e710-4154-9195-8a094088d2ad admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:10.197665 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979afe6-e710-4154-9195-8a094088d2ad admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:10.203350 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b709d-1916-450c-850e-364500079d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:10.204466 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b709d-1916-450c-850e-364500079d0a admin admin] REQUEST_METHOD: `PUT` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:10.204466 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b709d-1916-450c-850e-364500079d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:10.204664 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b709d-1916-450c-850e-364500079d0a admin admin] PATH_INFO: `/v3/projects/911beccb7d074513b09f87afd273de23/users/b518a34d36f045268136d597ec021e02/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:10.222028 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025b709d-1916-450c-850e-364500079d0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=911beccb7d074513b09f87afd273de23, user_id=b518a34d36f045268136d597ec021e02, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:10.225096 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025b709d-1916-450c-850e-364500079d0a admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:10.249100 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1006/2018] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 01:00:10 2022] PUT /identity/v3/projects/911beccb7d074513b09f87afd273de23/users/b518a34d36f045268136d597ec021e02/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:00:10.260158 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95c8d1-1f97-4c65-ab7e-ff86d8e2b7f4 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:10.260631 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95c8d1-1f97-4c65-ab7e-ff86d8e2b7f4 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:10.261054 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb95c8d1-1f97-4c65-ab7e-ff86d8e2b7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:10.294557 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-eb95c8d1-1f97-4c65-ab7e-ff86d8e2b7f4 None None] MFA Rules not processed for user `b518a34d36f045268136d597ec021e02`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:10.296037 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-eb95c8d1-1f97-4c65-ab7e-ff86d8e2b7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:10.392524 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1013/2019] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:00:10 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:00:10.392807 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b709d-1916-450c-850e-364500079d0a admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:10.532679 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b709d-1916-450c-850e-364500079d0a admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:10.539383 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d2529-d84c-440b-8ca6-b1924c5642b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:10.541033 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d2529-d84c-440b-8ca6-b1924c5642b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:10.541579 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d2529-d84c-440b-8ca6-b1924c5642b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:10.542404 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d2529-d84c-440b-8ca6-b1924c5642b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:10.543600 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459d2529-d84c-440b-8ca6-b1924c5642b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:10.548477 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459d2529-d84c-440b-8ca6-b1924c5642b7 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:10.633068 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1007/2020] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 01:00:10 2022] POST /identity/v3/projects => generated 407 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:00:10.635924 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb95c8d1-1f97-4c65-ab7e-ff86d8e2b7f4 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:10.678612 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb95c8d1-1f97-4c65-ab7e-ff86d8e2b7f4 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:10.830945 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a28c4c-f9a7-4fb3-b62c-4accbdf5d517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:10.832177 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a28c4c-f9a7-4fb3-b62c-4accbdf5d517 admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:10.832470 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a28c4c-f9a7-4fb3-b62c-4accbdf5d517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:10.832724 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a28c4c-f9a7-4fb3-b62c-4accbdf5d517 admin admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:10.833535 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a28c4c-f9a7-4fb3-b62c-4accbdf5d517 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:10.835750 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a28c4c-f9a7-4fb3-b62c-4accbdf5d517 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:10.887874 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d2529-d84c-440b-8ca6-b1924c5642b7 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:10.892242 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1014/2021] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 01:00:10 2022] POST /identity/v3/users => generated 310 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:00:10.901525 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d2529-d84c-440b-8ca6-b1924c5642b7 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:10.916080 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc264ba4-ddaa-41f1-aeb1-e3fa59a879c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:10.916780 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc264ba4-ddaa-41f1-aeb1-e3fa59a879c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:10.917248 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc264ba4-ddaa-41f1-aeb1-e3fa59a879c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:10.917514 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc264ba4-ddaa-41f1-aeb1-e3fa59a879c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:10.918269 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc264ba4-ddaa-41f1-aeb1-e3fa59a879c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:10.920935 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc264ba4-ddaa-41f1-aeb1-e3fa59a879c1 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:10.955705 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1008/2022] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:00:10 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:00:10.960791 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a28c4c-f9a7-4fb3-b62c-4accbdf5d517 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:11.005178 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a28c4c-f9a7-4fb3-b62c-4accbdf5d517 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:11.013129 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05baf2ee-3d41-42db-b1b3-f9f9245c34b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:11.014139 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05baf2ee-3d41-42db-b1b3-f9f9245c34b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:11.015173 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05baf2ee-3d41-42db-b1b3-f9f9245c34b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:11.015607 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05baf2ee-3d41-42db-b1b3-f9f9245c34b2 admin admin] PATH_INFO: `/v3/projects/cd10809df7674cd7b8416e7310dde2ec/users/147369e9456043d294948fec0487049e/roles/2e4889bb71f9434392c0baba59f2534e` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:11.047344 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05baf2ee-3d41-42db-b1b3-f9f9245c34b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd10809df7674cd7b8416e7310dde2ec, user_id=147369e9456043d294948fec0487049e, role_id=2e4889bb71f9434392c0baba59f2534e)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:11.052527 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05baf2ee-3d41-42db-b1b3-f9f9245c34b2 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:11.098869 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1015/2023] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 01:00:10 2022] PUT /identity/v3/projects/cd10809df7674cd7b8416e7310dde2ec/users/147369e9456043d294948fec0487049e/roles/2e4889bb71f9434392c0baba59f2534e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:00:11.099399 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc264ba4-ddaa-41f1-aeb1-e3fa59a879c1 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:11.115129 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc264ba4-ddaa-41f1-aeb1-e3fa59a879c1 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:11.200388 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:11.288618 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c45f630-eadc-4cc2-bfe8-ad8e13079893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:11.290973 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45f630-eadc-4cc2-bfe8-ad8e13079893 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:11.291255 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45f630-eadc-4cc2-bfe8-ad8e13079893 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:11.291531 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45f630-eadc-4cc2-bfe8-ad8e13079893 admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:11.292228 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c45f630-eadc-4cc2-bfe8-ad8e13079893 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:11.293882 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c45f630-eadc-4cc2-bfe8-ad8e13079893 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:11.323069 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1009/2024] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:00:11 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:00:11.329576 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05baf2ee-3d41-42db-b1b3-f9f9245c34b2 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:11.336863 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:11.350947 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05baf2ee-3d41-42db-b1b3-f9f9245c34b2 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:11.362302 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51468410-20ac-4d38-a7fa-218fe2aaf4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:11.366548 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51468410-20ac-4d38-a7fa-218fe2aaf4b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:11.367230 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51468410-20ac-4d38-a7fa-218fe2aaf4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:11.367518 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51468410-20ac-4d38-a7fa-218fe2aaf4b0 admin admin] PATH_INFO: `/v3/projects/cd10809df7674cd7b8416e7310dde2ec/users/147369e9456043d294948fec0487049e/roles/2e4889bb71f9434392c0baba59f2534e` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:11.376603 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51468410-20ac-4d38-a7fa-218fe2aaf4b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd10809df7674cd7b8416e7310dde2ec, user_id=147369e9456043d294948fec0487049e, role_id=2e4889bb71f9434392c0baba59f2534e)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:11.380050 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51468410-20ac-4d38-a7fa-218fe2aaf4b0 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:11.394802 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1016/2025] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 01:00:11 2022] PUT /identity/v3/projects/cd10809df7674cd7b8416e7310dde2ec/users/147369e9456043d294948fec0487049e/roles/2e4889bb71f9434392c0baba59f2534e => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:00:11.406641 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da29dfe-6066-4540-b69b-c45d11fd2ed7 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:11.407206 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da29dfe-6066-4540-b69b-c45d11fd2ed7 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:11.407206 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da29dfe-6066-4540-b69b-c45d11fd2ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:11.443255 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-8da29dfe-6066-4540-b69b-c45d11fd2ed7 None None] MFA Rules not processed for user `147369e9456043d294948fec0487049e`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:11.445261 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-8da29dfe-6066-4540-b69b-c45d11fd2ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:11.563762 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1010/2026] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:00:11 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:00:11.625620 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51468410-20ac-4d38-a7fa-218fe2aaf4b0 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:11.628004 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-51468410-20ac-4d38-a7fa-218fe2aaf4b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:11.756601 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51468410-20ac-4d38-a7fa-218fe2aaf4b0 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:11.767024 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c809d-1bd5-493b-87d9-98c651805a1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:11.768681 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c809d-1bd5-493b-87d9-98c651805a1f service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:11.768987 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c809d-1bd5-493b-87d9-98c651805a1f service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:11.769259 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c809d-1bd5-493b-87d9-98c651805a1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:11.881544 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8c809d-1bd5-493b-87d9-98c651805a1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:11.887648 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8c809d-1bd5-493b-87d9-98c651805a1f service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:11.909647 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1017/2027] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:00:11 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:00:14.128132 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da29dfe-6066-4540-b69b-c45d11fd2ed7 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:14.130619 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-8da29dfe-6066-4540-b69b-c45d11fd2ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:14.289885 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da29dfe-6066-4540-b69b-c45d11fd2ed7 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:14.310707 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a353fe-f769-4894-a8cb-1188c6fa920b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:14.311927 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a353fe-f769-4894-a8cb-1188c6fa920b service nova] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:14.312591 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a353fe-f769-4894-a8cb-1188c6fa920b service nova] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:14.312872 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a353fe-f769-4894-a8cb-1188c6fa920b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:14.331569 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a353fe-f769-4894-a8cb-1188c6fa920b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:14.334756 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a353fe-f769-4894-a8cb-1188c6fa920b service nova] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:14.366941 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1011/2028] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:00:14 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:00:20.108961 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c809d-1bd5-493b-87d9-98c651805a1f service neutron] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:20.110556 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-ca8c809d-1bd5-493b-87d9-98c651805a1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:20.147949 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c809d-1bd5-493b-87d9-98c651805a1f service neutron] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:20.158039 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa840486-be92-477e-9460-355fb25cc8e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:20.160324 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa840486-be92-477e-9460-355fb25cc8e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:20.162280 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa840486-be92-477e-9460-355fb25cc8e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:20.163049 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa840486-be92-477e-9460-355fb25cc8e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:20.171047 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-fa840486-be92-477e-9460-355fb25cc8e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:20.319957 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa840486-be92-477e-9460-355fb25cc8e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:20.322123 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa840486-be92-477e-9460-355fb25cc8e9 service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:20.338819 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1018/2029] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:00:20 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:00:24.350210 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=86 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:26.895442 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a353fe-f769-4894-a8cb-1188c6fa920b service nova] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:26.897038 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-a2a353fe-f769-4894-a8cb-1188c6fa920b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:27.037647 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a353fe-f769-4894-a8cb-1188c6fa920b service nova] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:27.043793 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb66d7e-bb8c-450a-9617-91f1636de4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:27.044706 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb66d7e-bb8c-450a-9617-91f1636de4e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:27.045219 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb66d7e-bb8c-450a-9617-91f1636de4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:27.048459 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb66d7e-bb8c-450a-9617-91f1636de4e4 admin admin] PATH_INFO: `/v3/users/2ea720a26a2b478aa32d63c5e706a12b` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:27.048459 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb66d7e-bb8c-450a-9617-91f1636de4e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ea720a26a2b478aa32d63c5e706a12b)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:27.050079 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb66d7e-bb8c-450a-9617-91f1636de4e4 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:27.123182 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-1eb66d7e-bb8c-450a-9617-91f1636de4e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ea720a26a2b478aa32d63c5e706a12b'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:27.134280 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-1eb66d7e-bb8c-450a-9617-91f1636de4e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ea720a26a2b478aa32d63c5e706a12b'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:27.154972 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-1eb66d7e-bb8c-450a-9617-91f1636de4e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ea720a26a2b478aa32d63c5e706a12b'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:27.155854 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-1eb66d7e-bb8c-450a-9617-91f1636de4e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ea720a26a2b478aa32d63c5e706a12b'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:27.156850 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-1eb66d7e-bb8c-450a-9617-91f1636de4e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ea720a26a2b478aa32d63c5e706a12b'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:27.178825 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1012/2030] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 01:00:26 2022] DELETE /identity/v3/users/2ea720a26a2b478aa32d63c5e706a12b => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:00:27.180289 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd697e2-8b51-4e57-8627-56de72658ec6 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:27.181158 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd697e2-8b51-4e57-8627-56de72658ec6 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:27.181749 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd697e2-8b51-4e57-8627-56de72658ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:27.215962 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-0cd697e2-8b51-4e57-8627-56de72658ec6 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:27.218192 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-0cd697e2-8b51-4e57-8627-56de72658ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:27.295586 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:27.339824 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1019/2031] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:00:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:00:27.360871 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb66d7e-bb8c-450a-9617-91f1636de4e4 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:27.363122 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-1eb66d7e-bb8c-450a-9617-91f1636de4e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:27.474959 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb66d7e-bb8c-450a-9617-91f1636de4e4 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:27.480813 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e047f7-8e87-4390-852e-5fda5beaa8ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:27.481825 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e047f7-8e87-4390-852e-5fda5beaa8ed service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:27.482940 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e047f7-8e87-4390-852e-5fda5beaa8ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:27.483272 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e047f7-8e87-4390-852e-5fda5beaa8ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:27.499386 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e047f7-8e87-4390-852e-5fda5beaa8ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:27.501200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e047f7-8e87-4390-852e-5fda5beaa8ed service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:27.512970 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1013/2032] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:00:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:00:28.871869 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd697e2-8b51-4e57-8627-56de72658ec6 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:28.873481 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-0cd697e2-8b51-4e57-8627-56de72658ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:28.900910 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd697e2-8b51-4e57-8627-56de72658ec6 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:28.908482 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6891d-9d55-4bdc-9d19-01930cac69d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:28.909155 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6891d-9d55-4bdc-9d19-01930cac69d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:28.909582 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6891d-9d55-4bdc-9d19-01930cac69d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:28.910920 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6891d-9d55-4bdc-9d19-01930cac69d9 admin admin] PATH_INFO: `/v3/projects/3b76abd35de3459b85bc25992edeecfd` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:28.913043 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd6891d-9d55-4bdc-9d19-01930cac69d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b76abd35de3459b85bc25992edeecfd)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:28.917841 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd6891d-9d55-4bdc-9d19-01930cac69d9 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:29.042820 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-0dd6891d-9d55-4bdc-9d19-01930cac69d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b76abd35de3459b85bc25992edeecfd', 'request_id': 'req-0dd6891d-9d55-4bdc-9d19-01930cac69d9'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:29.054710 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-0dd6891d-9d55-4bdc-9d19-01930cac69d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b76abd35de3459b85bc25992edeecfd', 'request_id': 'req-0dd6891d-9d55-4bdc-9d19-01930cac69d9'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:29.067919 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-0dd6891d-9d55-4bdc-9d19-01930cac69d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b76abd35de3459b85bc25992edeecfd', 'request_id': 'req-0dd6891d-9d55-4bdc-9d19-01930cac69d9'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:29.082811 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-0dd6891d-9d55-4bdc-9d19-01930cac69d9 admin admin] The token cache is being invalidate because project 3b76abd35de3459b85bc25992edeecfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81807) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:00:29.083139 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-0dd6891d-9d55-4bdc-9d19-01930cac69d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:29.083882 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-0dd6891d-9d55-4bdc-9d19-01930cac69d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:29.085487 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1020/2033] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 01:00:28 2022] DELETE /identity/v3/projects/3b76abd35de3459b85bc25992edeecfd => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:00:29.089888 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e047f7-8e87-4390-852e-5fda5beaa8ed service neutron] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:29.108902 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e047f7-8e87-4390-852e-5fda5beaa8ed service neutron] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:29.131725 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:29.255306 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75e928c-e811-4d87-9505-606d5acd9e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:29.256081 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75e928c-e811-4d87-9505-606d5acd9e17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:29.256366 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75e928c-e811-4d87-9505-606d5acd9e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:29.257161 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75e928c-e811-4d87-9505-606d5acd9e17 admin admin] PATH_INFO: `/v3/users/0cbf466bd0514dd5a2bc8b7d9832ee98` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:29.258735 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75e928c-e811-4d87-9505-606d5acd9e17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cbf466bd0514dd5a2bc8b7d9832ee98)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:29.262721 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75e928c-e811-4d87-9505-606d5acd9e17 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:29.362338 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-c75e928c-e811-4d87-9505-606d5acd9e17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cbf466bd0514dd5a2bc8b7d9832ee98'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:29.376406 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-c75e928c-e811-4d87-9505-606d5acd9e17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cbf466bd0514dd5a2bc8b7d9832ee98'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:29.401269 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-c75e928c-e811-4d87-9505-606d5acd9e17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cbf466bd0514dd5a2bc8b7d9832ee98'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:29.402077 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-c75e928c-e811-4d87-9505-606d5acd9e17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cbf466bd0514dd5a2bc8b7d9832ee98'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:29.404458 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-c75e928c-e811-4d87-9505-606d5acd9e17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cbf466bd0514dd5a2bc8b7d9832ee98'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:29.433436 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1014/2034] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 01:00:29 2022] DELETE /identity/v3/users/0cbf466bd0514dd5a2bc8b7d9832ee98 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:00:30.448166 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6891d-9d55-4bdc-9d19-01930cac69d9 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:30.451549 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-0dd6891d-9d55-4bdc-9d19-01930cac69d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:30.473573 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6891d-9d55-4bdc-9d19-01930cac69d9 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:30.619442 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bb4864-4e18-40b7-89e7-2f89b2f4be7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:30.620156 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb4864-4e18-40b7-89e7-2f89b2f4be7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:30.620432 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb4864-4e18-40b7-89e7-2f89b2f4be7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:30.620707 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb4864-4e18-40b7-89e7-2f89b2f4be7f admin admin] PATH_INFO: `/v3/projects/74187486da374bf7a13c40cf040712a7` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:30.622141 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bb4864-4e18-40b7-89e7-2f89b2f4be7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=74187486da374bf7a13c40cf040712a7)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:30.625179 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bb4864-4e18-40b7-89e7-2f89b2f4be7f admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:30.708222 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-e8bb4864-4e18-40b7-89e7-2f89b2f4be7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74187486da374bf7a13c40cf040712a7', 'request_id': 'req-e8bb4864-4e18-40b7-89e7-2f89b2f4be7f'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:30.722698 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-e8bb4864-4e18-40b7-89e7-2f89b2f4be7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74187486da374bf7a13c40cf040712a7', 'request_id': 'req-e8bb4864-4e18-40b7-89e7-2f89b2f4be7f'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:30.742530 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-e8bb4864-4e18-40b7-89e7-2f89b2f4be7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74187486da374bf7a13c40cf040712a7', 'request_id': 'req-e8bb4864-4e18-40b7-89e7-2f89b2f4be7f'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:30.749135 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:30.775246 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-e8bb4864-4e18-40b7-89e7-2f89b2f4be7f admin admin] The token cache is being invalidate because project 74187486da374bf7a13c40cf040712a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81807) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:00:30.777164 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-e8bb4864-4e18-40b7-89e7-2f89b2f4be7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:30.778036 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-e8bb4864-4e18-40b7-89e7-2f89b2f4be7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:30.788123 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1021/2035] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 01:00:30 2022] DELETE /identity/v3/projects/74187486da374bf7a13c40cf040712a7 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:00:30.789101 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da29ba0-7edd-4e01-b7f1-a069b79fefa1 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:30.790087 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da29ba0-7edd-4e01-b7f1-a069b79fefa1 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:30.790532 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da29ba0-7edd-4e01-b7f1-a069b79fefa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:30.812899 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-2da29ba0-7edd-4e01-b7f1-a069b79fefa1 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:30.814431 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-2da29ba0-7edd-4e01-b7f1-a069b79fefa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:30.899992 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1015/2036] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:00:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:00:30.910304 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b7cc4-ea66-4b44-8b26-bb50c1ddaf2a None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:30.911141 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b7cc4-ea66-4b44-8b26-bb50c1ddaf2a None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:30.913117 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b7cc4-ea66-4b44-8b26-bb50c1ddaf2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:30.938522 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-329b7cc4-ea66-4b44-8b26-bb50c1ddaf2a None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:30.940555 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-329b7cc4-ea66-4b44-8b26-bb50c1ddaf2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:30.953194 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1022/2037] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:00:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:00:30.954512 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da29ba0-7edd-4e01-b7f1-a069b79fefa1 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:30.970674 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da29ba0-7edd-4e01-b7f1-a069b79fefa1 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:30.975135 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb1f08f-fe33-4a17-a263-2bd70154bfb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:30.975994 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1f08f-fe33-4a17-a263-2bd70154bfb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:30.976329 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1f08f-fe33-4a17-a263-2bd70154bfb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:30.976602 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1f08f-fe33-4a17-a263-2bd70154bfb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:30.977278 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb1f08f-fe33-4a17-a263-2bd70154bfb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:00:30.977751 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb1f08f-fe33-4a17-a263-2bd70154bfb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:30.979451 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb1f08f-fe33-4a17-a263-2bd70154bfb2 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:30.997576 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1016/2038] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 01:00:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:00:30.998818 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329b7cc4-ea66-4b44-8b26-bb50c1ddaf2a None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:31.011917 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329b7cc4-ea66-4b44-8b26-bb50c1ddaf2a None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:31.020710 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b384f5b-846d-47ac-a6ad-c03ff106d926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:31.021805 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b384f5b-846d-47ac-a6ad-c03ff106d926 admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:31.022233 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b384f5b-846d-47ac-a6ad-c03ff106d926 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:31.022866 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b384f5b-846d-47ac-a6ad-c03ff106d926 admin admin] PATH_INFO: `/v3/projects` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:31.023853 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b384f5b-846d-47ac-a6ad-c03ff106d926 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:31.026158 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b384f5b-846d-47ac-a6ad-c03ff106d926 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:31.066152 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1023/2039] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 01:00:30 2022] POST /identity/v3/projects => generated 389 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:00:31.071281 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb1f08f-fe33-4a17-a263-2bd70154bfb2 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:31.084651 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb1f08f-fe33-4a17-a263-2bd70154bfb2 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:31.117671 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:31.159995 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb606fd-120a-409a-83f1-6e403e5fdc49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:31.160881 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb606fd-120a-409a-83f1-6e403e5fdc49 admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:31.160998 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb606fd-120a-409a-83f1-6e403e5fdc49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:31.161331 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb606fd-120a-409a-83f1-6e403e5fdc49 admin admin] PATH_INFO: `/v3/users` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:31.162123 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb606fd-120a-409a-83f1-6e403e5fdc49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:31.164228 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb606fd-120a-409a-83f1-6e403e5fdc49 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:31.201182 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b384f5b-846d-47ac-a6ad-c03ff106d926 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:31.204680 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1017/2040] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 01:00:31 2022] POST /identity/v3/users => generated 295 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:00:31.228797 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b384f5b-846d-47ac-a6ad-c03ff106d926 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:31.242829 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99214d7-52f4-4461-90ee-cc8016944cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:31.243498 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99214d7-52f4-4461-90ee-cc8016944cad admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:31.243806 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99214d7-52f4-4461-90ee-cc8016944cad admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:31.244081 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99214d7-52f4-4461-90ee-cc8016944cad admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:31.244844 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99214d7-52f4-4461-90ee-cc8016944cad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:31.246686 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99214d7-52f4-4461-90ee-cc8016944cad admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:31.269949 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1024/2041] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:00:31 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:00:31.274982 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb606fd-120a-409a-83f1-6e403e5fdc49 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:31.315909 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb606fd-120a-409a-83f1-6e403e5fdc49 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:31.334369 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b8a7f9-908d-4b9e-a001-86ff5b473981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:31.335085 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8a7f9-908d-4b9e-a001-86ff5b473981 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:31.335366 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8a7f9-908d-4b9e-a001-86ff5b473981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:31.335643 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8a7f9-908d-4b9e-a001-86ff5b473981 admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:31.336600 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b8a7f9-908d-4b9e-a001-86ff5b473981 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:31.341019 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b8a7f9-908d-4b9e-a001-86ff5b473981 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:31.381274 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1018/2042] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:00:31 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:00:31.389938 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99214d7-52f4-4461-90ee-cc8016944cad admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:31.402829 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99214d7-52f4-4461-90ee-cc8016944cad admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:31.411350 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf5d1a3-3ab4-4a75-b8e6-ef58922de642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:31.412211 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5d1a3-3ab4-4a75-b8e6-ef58922de642 admin admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:31.412492 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5d1a3-3ab4-4a75-b8e6-ef58922de642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:31.412762 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5d1a3-3ab4-4a75-b8e6-ef58922de642 admin admin] PATH_INFO: `/v3/projects/7cd5444891ce4adfa67e5a795c8fbf62/users/efce0ee2de244a638613b65a1557865f/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:31.445874 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf5d1a3-3ab4-4a75-b8e6-ef58922de642 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cd5444891ce4adfa67e5a795c8fbf62, user_id=efce0ee2de244a638613b65a1557865f, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:31.452447 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf5d1a3-3ab4-4a75-b8e6-ef58922de642 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:31.458925 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b8a7f9-908d-4b9e-a001-86ff5b473981 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:31.462382 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-c2b8a7f9-908d-4b9e-a001-86ff5b473981 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:31.485854 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1025/2043] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 01:00:31 2022] PUT /identity/v3/projects/7cd5444891ce4adfa67e5a795c8fbf62/users/efce0ee2de244a638613b65a1557865f/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:00:31.487803 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4237aa-9081-4c9f-8f39-891f5621f0de None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:31.489425 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4237aa-9081-4c9f-8f39-891f5621f0de None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:31.489924 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4237aa-9081-4c9f-8f39-891f5621f0de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:31.545570 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-5e4237aa-9081-4c9f-8f39-891f5621f0de None None] MFA Rules not processed for user `efce0ee2de244a638613b65a1557865f`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:31.548628 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-5e4237aa-9081-4c9f-8f39-891f5621f0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:31.600908 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b8a7f9-908d-4b9e-a001-86ff5b473981 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:31.696346 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1026/2044] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:00:31 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:00:31.705095 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55024214-4968-4355-b7a6-c32ab6aaaaf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:31.706744 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55024214-4968-4355-b7a6-c32ab6aaaaf4 service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:31.707791 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55024214-4968-4355-b7a6-c32ab6aaaaf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:31.708304 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55024214-4968-4355-b7a6-c32ab6aaaaf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:31.712133 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-55024214-4968-4355-b7a6-c32ab6aaaaf4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:31.715657 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4237aa-9081-4c9f-8f39-891f5621f0de None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:31.721737 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-5e4237aa-9081-4c9f-8f39-891f5621f0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:31.745742 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4237aa-9081-4c9f-8f39-891f5621f0de None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:31.755420 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2983e747-f8db-4abc-97ce-39ea535df945 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:31.756522 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983e747-f8db-4abc-97ce-39ea535df945 service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:31.757017 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983e747-f8db-4abc-97ce-39ea535df945 service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:31.757306 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983e747-f8db-4abc-97ce-39ea535df945 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:31.783831 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2983e747-f8db-4abc-97ce-39ea535df945 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:31.785542 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2983e747-f8db-4abc-97ce-39ea535df945 service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:31.810635 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55024214-4968-4355-b7a6-c32ab6aaaaf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:31.813862 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55024214-4968-4355-b7a6-c32ab6aaaaf4 service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:31.817589 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1027/2045] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:00:31 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:00:31.826218 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1019/2046] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:00:31 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:00:40.265450 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2983e747-f8db-4abc-97ce-39ea535df945 service neutron] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:40.268545 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-2983e747-f8db-4abc-97ce-39ea535df945 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:40.385411 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2983e747-f8db-4abc-97ce-39ea535df945 service neutron] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:40.391462 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb42b05-253e-439a-a40b-a626f8218b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:40.392221 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb42b05-253e-439a-a40b-a626f8218b92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:40.392659 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb42b05-253e-439a-a40b-a626f8218b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:40.392941 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb42b05-253e-439a-a40b-a626f8218b92 admin admin] PATH_INFO: `/v3/users/b518a34d36f045268136d597ec021e02` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:40.394181 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb42b05-253e-439a-a40b-a626f8218b92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b518a34d36f045268136d597ec021e02)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:40.398771 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb42b05-253e-439a-a40b-a626f8218b92 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:40.407651 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:40.506143 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-9eb42b05-253e-439a-a40b-a626f8218b92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b518a34d36f045268136d597ec021e02'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:40.541420 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-9eb42b05-253e-439a-a40b-a626f8218b92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b518a34d36f045268136d597ec021e02'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:40.565887 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-9eb42b05-253e-439a-a40b-a626f8218b92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b518a34d36f045268136d597ec021e02'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:40.566697 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-9eb42b05-253e-439a-a40b-a626f8218b92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b518a34d36f045268136d597ec021e02'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:40.567648 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-9eb42b05-253e-439a-a40b-a626f8218b92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b518a34d36f045268136d597ec021e02'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:40.595936 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1028/2047] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 01:00:40 2022] DELETE /identity/v3/users/b518a34d36f045268136d597ec021e02 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:00:40.600301 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d717e-2e8e-4c45-8edd-7724e1db569a None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:40.600907 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d717e-2e8e-4c45-8edd-7724e1db569a None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:40.606320 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d717e-2e8e-4c45-8edd-7724e1db569a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:40.661449 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-b16d717e-2e8e-4c45-8edd-7724e1db569a None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:40.663186 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-b16d717e-2e8e-4c45-8edd-7724e1db569a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:40.684429 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:40.762146 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1020/2048] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:00:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:00:40.843414 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb42b05-253e-439a-a40b-a626f8218b92 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:40.845052 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-9eb42b05-253e-439a-a40b-a626f8218b92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:40.977493 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb42b05-253e-439a-a40b-a626f8218b92 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:40.985314 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea3fe22-4a57-485c-bb47-b3be5f18bc73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:40.985963 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3fe22-4a57-485c-bb47-b3be5f18bc73 service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:40.986234 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3fe22-4a57-485c-bb47-b3be5f18bc73 service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:40.986550 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3fe22-4a57-485c-bb47-b3be5f18bc73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:41.013037 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea3fe22-4a57-485c-bb47-b3be5f18bc73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:41.014651 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea3fe22-4a57-485c-bb47-b3be5f18bc73 service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:41.039630 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1029/2049] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:00:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:00:42.484867 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16d717e-2e8e-4c45-8edd-7724e1db569a None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:42.487509 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-b16d717e-2e8e-4c45-8edd-7724e1db569a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:42.505287 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16d717e-2e8e-4c45-8edd-7724e1db569a None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:42.517826 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4238de65-fa55-422a-8a5a-8dd4a4a07850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:42.518880 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238de65-fa55-422a-8a5a-8dd4a4a07850 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:42.519275 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238de65-fa55-422a-8a5a-8dd4a4a07850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:42.519686 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238de65-fa55-422a-8a5a-8dd4a4a07850 admin admin] PATH_INFO: `/v3/projects/911beccb7d074513b09f87afd273de23` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:42.523718 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4238de65-fa55-422a-8a5a-8dd4a4a07850 admin admin] RBAC: Authorizing `identity:delete_project(project_id=911beccb7d074513b09f87afd273de23)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:42.532943 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4238de65-fa55-422a-8a5a-8dd4a4a07850 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:42.647170 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-4238de65-fa55-422a-8a5a-8dd4a4a07850 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '911beccb7d074513b09f87afd273de23', 'request_id': 'req-4238de65-fa55-422a-8a5a-8dd4a4a07850'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:42.656556 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-4238de65-fa55-422a-8a5a-8dd4a4a07850 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '911beccb7d074513b09f87afd273de23', 'request_id': 'req-4238de65-fa55-422a-8a5a-8dd4a4a07850'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:42.677251 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-4238de65-fa55-422a-8a5a-8dd4a4a07850 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '911beccb7d074513b09f87afd273de23', 'request_id': 'req-4238de65-fa55-422a-8a5a-8dd4a4a07850'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:42.732292 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-4238de65-fa55-422a-8a5a-8dd4a4a07850 admin admin] The token cache is being invalidate because project 911beccb7d074513b09f87afd273de23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81808) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:00:42.732744 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-4238de65-fa55-422a-8a5a-8dd4a4a07850 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:42.751241 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-4238de65-fa55-422a-8a5a-8dd4a4a07850 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:42.757536 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1021/2050] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 01:00:42 2022] DELETE /identity/v3/projects/911beccb7d074513b09f87afd273de23 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:00:42.762198 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea3fe22-4a57-485c-bb47-b3be5f18bc73 service neutron] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:42.798431 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea3fe22-4a57-485c-bb47-b3be5f18bc73 service neutron] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:42.907827 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfaf9d8-b831-429a-aede-8c52deb09fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:42.909351 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfaf9d8-b831-429a-aede-8c52deb09fa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:42.909670 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfaf9d8-b831-429a-aede-8c52deb09fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:42.910058 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfaf9d8-b831-429a-aede-8c52deb09fa6 admin admin] PATH_INFO: `/v3/users/147369e9456043d294948fec0487049e` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:42.912513 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfaf9d8-b831-429a-aede-8c52deb09fa6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=147369e9456043d294948fec0487049e)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:42.916488 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfaf9d8-b831-429a-aede-8c52deb09fa6 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:42.967539 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:43.010687 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-ebfaf9d8-b831-429a-aede-8c52deb09fa6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '147369e9456043d294948fec0487049e'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:43.029011 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-ebfaf9d8-b831-429a-aede-8c52deb09fa6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '147369e9456043d294948fec0487049e'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:43.042876 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-ebfaf9d8-b831-429a-aede-8c52deb09fa6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '147369e9456043d294948fec0487049e'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:43.048934 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-ebfaf9d8-b831-429a-aede-8c52deb09fa6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '147369e9456043d294948fec0487049e'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:43.049798 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-ebfaf9d8-b831-429a-aede-8c52deb09fa6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '147369e9456043d294948fec0487049e'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:43.088914 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1030/2051] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 01:00:42 2022] DELETE /identity/v3/users/147369e9456043d294948fec0487049e => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:00:44.285361 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4238de65-fa55-422a-8a5a-8dd4a4a07850 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:44.287784 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-4238de65-fa55-422a-8a5a-8dd4a4a07850 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:44.331724 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4238de65-fa55-422a-8a5a-8dd4a4a07850 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:44.426200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268238f-7c70-458a-ba90-8bb345def058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:44.434998 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268238f-7c70-458a-ba90-8bb345def058 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:44.435615 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268238f-7c70-458a-ba90-8bb345def058 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:44.436150 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268238f-7c70-458a-ba90-8bb345def058 admin admin] PATH_INFO: `/v3/projects/cd10809df7674cd7b8416e7310dde2ec` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:44.438282 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7268238f-7c70-458a-ba90-8bb345def058 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd10809df7674cd7b8416e7310dde2ec)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:44.440794 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7268238f-7c70-458a-ba90-8bb345def058 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:44.518708 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:44.530787 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-7268238f-7c70-458a-ba90-8bb345def058 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd10809df7674cd7b8416e7310dde2ec', 'request_id': 'req-7268238f-7c70-458a-ba90-8bb345def058'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:44.552410 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-7268238f-7c70-458a-ba90-8bb345def058 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd10809df7674cd7b8416e7310dde2ec', 'request_id': 'req-7268238f-7c70-458a-ba90-8bb345def058'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:44.579374 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-7268238f-7c70-458a-ba90-8bb345def058 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd10809df7674cd7b8416e7310dde2ec', 'request_id': 'req-7268238f-7c70-458a-ba90-8bb345def058'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:44.604494 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-7268238f-7c70-458a-ba90-8bb345def058 admin admin] The token cache is being invalidate because project cd10809df7674cd7b8416e7310dde2ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81808) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:00:44.605090 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-7268238f-7c70-458a-ba90-8bb345def058 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:44.606374 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-7268238f-7c70-458a-ba90-8bb345def058 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:44.610064 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1022/2052] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 01:00:44 2022] DELETE /identity/v3/projects/cd10809df7674cd7b8416e7310dde2ec => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:00:44.619184 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ff51c-952e-4a0b-9fc7-e5a3dfac5be1 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:44.620557 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ff51c-952e-4a0b-9fc7-e5a3dfac5be1 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:44.621666 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ff51c-952e-4a0b-9fc7-e5a3dfac5be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:44.670645 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-514ff51c-952e-4a0b-9fc7-e5a3dfac5be1 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:44.676283 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-514ff51c-952e-4a0b-9fc7-e5a3dfac5be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:44.802646 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1031/2053] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:00:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:00:44.810255 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d6000-fc17-42d2-9471-0484cba69918 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:44.810976 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d6000-fc17-42d2-9471-0484cba69918 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:44.811376 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d6000-fc17-42d2-9471-0484cba69918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:44.842768 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-273d6000-fc17-42d2-9471-0484cba69918 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:44.845213 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-273d6000-fc17-42d2-9471-0484cba69918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:44.859947 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1023/2054] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:00:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:00:44.863900 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514ff51c-952e-4a0b-9fc7-e5a3dfac5be1 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:44.932910 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514ff51c-952e-4a0b-9fc7-e5a3dfac5be1 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:44.962204 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92781b3a-547e-47eb-a0c7-a33e28d2716b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:44.963362 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92781b3a-547e-47eb-a0c7-a33e28d2716b admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:44.963805 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92781b3a-547e-47eb-a0c7-a33e28d2716b admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:44.964344 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92781b3a-547e-47eb-a0c7-a33e28d2716b admin admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:44.965472 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92781b3a-547e-47eb-a0c7-a33e28d2716b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:00:44.966100 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92781b3a-547e-47eb-a0c7-a33e28d2716b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:44.971919 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92781b3a-547e-47eb-a0c7-a33e28d2716b admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:45.027480 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1032/2055] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 01:00:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:00:45.029301 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d6000-fc17-42d2-9471-0484cba69918 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:45.055881 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d6000-fc17-42d2-9471-0484cba69918 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:45.079698 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ebe84d-830d-41f8-9571-9a7e376c10a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:45.081900 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ebe84d-830d-41f8-9571-9a7e376c10a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:45.082371 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ebe84d-830d-41f8-9571-9a7e376c10a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:45.082864 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ebe84d-830d-41f8-9571-9a7e376c10a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:45.084152 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ebe84d-830d-41f8-9571-9a7e376c10a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:45.093384 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ebe84d-830d-41f8-9571-9a7e376c10a3 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:45.180635 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1024/2056] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 01:00:45 2022] POST /identity/v3/projects => generated 377 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:00:45.182344 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92781b3a-547e-47eb-a0c7-a33e28d2716b admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:45.199900 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92781b3a-547e-47eb-a0c7-a33e28d2716b admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:45.411814 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592bc4b6-b474-4889-a877-5623047f8067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:45.413154 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592bc4b6-b474-4889-a877-5623047f8067 admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:45.413708 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592bc4b6-b474-4889-a877-5623047f8067 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:45.414089 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592bc4b6-b474-4889-a877-5623047f8067 admin admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:45.415470 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592bc4b6-b474-4889-a877-5623047f8067 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:45.418723 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592bc4b6-b474-4889-a877-5623047f8067 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:45.459430 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1033/2057] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 01:00:45 2022] POST /identity/v3/users => generated 289 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:00:45.461532 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ebe84d-830d-41f8-9571-9a7e376c10a3 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:45.478581 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ebe84d-830d-41f8-9571-9a7e376c10a3 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:45.487395 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cadb404-9f9a-4830-9745-feea6d8a4507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:45.488831 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cadb404-9f9a-4830-9745-feea6d8a4507 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:45.489339 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cadb404-9f9a-4830-9745-feea6d8a4507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:45.489811 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cadb404-9f9a-4830-9745-feea6d8a4507 admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:45.499614 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cadb404-9f9a-4830-9745-feea6d8a4507 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:45.502069 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cadb404-9f9a-4830-9745-feea6d8a4507 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:45.525301 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1025/2058] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:00:45.531117 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592bc4b6-b474-4889-a877-5623047f8067 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:45.550671 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592bc4b6-b474-4889-a877-5623047f8067 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:45.562134 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f21a20d-4b54-4539-9292-71c4a182557b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:45.562900 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f21a20d-4b54-4539-9292-71c4a182557b admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:45.563275 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f21a20d-4b54-4539-9292-71c4a182557b admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:45.563737 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f21a20d-4b54-4539-9292-71c4a182557b admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:45.565128 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f21a20d-4b54-4539-9292-71c4a182557b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:45.567219 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f21a20d-4b54-4539-9292-71c4a182557b admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:45.597631 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1034/2059] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:00:45.602469 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cadb404-9f9a-4830-9745-feea6d8a4507 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:45.662955 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cadb404-9f9a-4830-9745-feea6d8a4507 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:45.688846 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9dba74-00a8-40fd-904c-93c2147c3dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:45.690938 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9dba74-00a8-40fd-904c-93c2147c3dfc admin admin] REQUEST_METHOD: `PUT` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:45.691226 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9dba74-00a8-40fd-904c-93c2147c3dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:45.691501 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9dba74-00a8-40fd-904c-93c2147c3dfc admin admin] PATH_INFO: `/v3/projects/1f48fcca642748a8901f1b3c7529a2d5/users/e56eaafe892b4047b558861437a84816/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:45.752108 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9dba74-00a8-40fd-904c-93c2147c3dfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f48fcca642748a8901f1b3c7529a2d5, user_id=e56eaafe892b4047b558861437a84816, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:45.764673 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9dba74-00a8-40fd-904c-93c2147c3dfc admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:45.802713 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1026/2060] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 01:00:45 2022] PUT /identity/v3/projects/1f48fcca642748a8901f1b3c7529a2d5/users/e56eaafe892b4047b558861437a84816/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:00:45.821001 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b09ef1-7a22-49c6-8aae-e4e374148eed None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:45.821574 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b09ef1-7a22-49c6-8aae-e4e374148eed None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:45.821934 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b09ef1-7a22-49c6-8aae-e4e374148eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:45.929123 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:45.961703 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-d5b09ef1-7a22-49c6-8aae-e4e374148eed None None] MFA Rules not processed for user `e56eaafe892b4047b558861437a84816`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:45.963464 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-d5b09ef1-7a22-49c6-8aae-e4e374148eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:46.224079 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1035/2061] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:00:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:00:46.228798 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9dba74-00a8-40fd-904c-93c2147c3dfc admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:46.401689 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9dba74-00a8-40fd-904c-93c2147c3dfc admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:46.421412 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acfcc58-46cc-4865-8fb5-29754098be6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:46.421972 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfcc58-46cc-4865-8fb5-29754098be6c admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:46.422271 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfcc58-46cc-4865-8fb5-29754098be6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:46.422533 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfcc58-46cc-4865-8fb5-29754098be6c admin admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:46.423473 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acfcc58-46cc-4865-8fb5-29754098be6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:46.425488 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acfcc58-46cc-4865-8fb5-29754098be6c admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:46.477753 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1027/2062] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 01:00:46 2022] POST /identity/v3/projects => generated 375 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:00:46.481740 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b09ef1-7a22-49c6-8aae-e4e374148eed None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:46.500774 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b09ef1-7a22-49c6-8aae-e4e374148eed None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:46.666021 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd056e0-2077-4088-8ee4-8665a3c64b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:46.667086 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd056e0-2077-4088-8ee4-8665a3c64b68 admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:46.667586 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd056e0-2077-4088-8ee4-8665a3c64b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:46.668087 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd056e0-2077-4088-8ee4-8665a3c64b68 admin admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:46.669816 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd056e0-2077-4088-8ee4-8665a3c64b68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:46.672829 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd056e0-2077-4088-8ee4-8665a3c64b68 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:46.715602 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1036/2063] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 01:00:46 2022] POST /identity/v3/users => generated 294 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:00:46.717239 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acfcc58-46cc-4865-8fb5-29754098be6c admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:46.731272 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acfcc58-46cc-4865-8fb5-29754098be6c admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:46.737909 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee690e06-77b7-477d-a99a-656f6b3d2bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:46.738547 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee690e06-77b7-477d-a99a-656f6b3d2bd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:46.738821 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee690e06-77b7-477d-a99a-656f6b3d2bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:46.739140 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee690e06-77b7-477d-a99a-656f6b3d2bd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:46.739855 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee690e06-77b7-477d-a99a-656f6b3d2bd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:46.741911 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee690e06-77b7-477d-a99a-656f6b3d2bd1 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:46.761297 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1028/2064] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:00:46.765559 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd056e0-2077-4088-8ee4-8665a3c64b68 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:46.790105 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd056e0-2077-4088-8ee4-8665a3c64b68 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:46.808460 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d6e2a1-b4c7-4b2e-9417-1fa8cfbb14ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:46.809040 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6e2a1-b4c7-4b2e-9417-1fa8cfbb14ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:46.809384 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6e2a1-b4c7-4b2e-9417-1fa8cfbb14ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:46.809803 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6e2a1-b4c7-4b2e-9417-1fa8cfbb14ad admin admin] PATH_INFO: `/v3/projects/e92938f47856431f8868e57d055c7bb1/users/b4e2b8f84c0344b98f35a68d15edbc94/roles/2e4889bb71f9434392c0baba59f2534e` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:46.830353 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d6e2a1-b4c7-4b2e-9417-1fa8cfbb14ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=e92938f47856431f8868e57d055c7bb1, user_id=b4e2b8f84c0344b98f35a68d15edbc94, role_id=2e4889bb71f9434392c0baba59f2534e)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:46.833364 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d6e2a1-b4c7-4b2e-9417-1fa8cfbb14ad admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:46.855941 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1037/2065] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 01:00:46 2022] PUT /identity/v3/projects/e92938f47856431f8868e57d055c7bb1/users/b4e2b8f84c0344b98f35a68d15edbc94/roles/2e4889bb71f9434392c0baba59f2534e => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:00:46.860669 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee690e06-77b7-477d-a99a-656f6b3d2bd1 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:46.875324 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee690e06-77b7-477d-a99a-656f6b3d2bd1 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:47.038161 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:47.170722 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86514dc-e7f2-4b48-96d9-d0572ebfec93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:47.174897 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86514dc-e7f2-4b48-96d9-d0572ebfec93 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:47.175309 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86514dc-e7f2-4b48-96d9-d0572ebfec93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:47.175585 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86514dc-e7f2-4b48-96d9-d0572ebfec93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:47.178922 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86514dc-e7f2-4b48-96d9-d0572ebfec93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:47.186613 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86514dc-e7f2-4b48-96d9-d0572ebfec93 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:47.236171 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1029/2066] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:00:46 2022] GET /identity/v3/roles => generated 1420 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:00:47.237449 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d6e2a1-b4c7-4b2e-9417-1fa8cfbb14ad admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:47.263051 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d6e2a1-b4c7-4b2e-9417-1fa8cfbb14ad admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:47.276237 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cfa43e-b581-4ab8-991a-7b892646ca3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:47.279234 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cfa43e-b581-4ab8-991a-7b892646ca3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:47.279518 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cfa43e-b581-4ab8-991a-7b892646ca3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:47.279962 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cfa43e-b581-4ab8-991a-7b892646ca3b admin admin] PATH_INFO: `/v3/projects/e92938f47856431f8868e57d055c7bb1/users/b4e2b8f84c0344b98f35a68d15edbc94/roles/2e4889bb71f9434392c0baba59f2534e` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:47.285294 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cfa43e-b581-4ab8-991a-7b892646ca3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e92938f47856431f8868e57d055c7bb1, user_id=b4e2b8f84c0344b98f35a68d15edbc94, role_id=2e4889bb71f9434392c0baba59f2534e)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:47.290841 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cfa43e-b581-4ab8-991a-7b892646ca3b admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:47.327721 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1038/2067] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 01:00:47 2022] PUT /identity/v3/projects/e92938f47856431f8868e57d055c7bb1/users/b4e2b8f84c0344b98f35a68d15edbc94/roles/2e4889bb71f9434392c0baba59f2534e => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:00:47.340063 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed1048-f5cc-4145-97ca-5eac33ed886e None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:47.340349 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed1048-f5cc-4145-97ca-5eac33ed886e None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:47.340829 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbed1048-f5cc-4145-97ca-5eac33ed886e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:47.388653 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-cbed1048-f5cc-4145-97ca-5eac33ed886e None None] MFA Rules not processed for user `b4e2b8f84c0344b98f35a68d15edbc94`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:47.390177 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-cbed1048-f5cc-4145-97ca-5eac33ed886e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:47.563252 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1030/2068] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:00:47 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:00:47.600048 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cfa43e-b581-4ab8-991a-7b892646ca3b admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:47.602062 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-e8cfa43e-b581-4ab8-991a-7b892646ca3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:47.693929 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cfa43e-b581-4ab8-991a-7b892646ca3b admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:47.701169 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e24a5b-9410-4182-a0a6-79f9d4d97016 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:47.702054 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e24a5b-9410-4182-a0a6-79f9d4d97016 service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:47.702525 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e24a5b-9410-4182-a0a6-79f9d4d97016 service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:47.702634 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e24a5b-9410-4182-a0a6-79f9d4d97016 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:47.712486 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:47.727570 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e24a5b-9410-4182-a0a6-79f9d4d97016 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:47.727570 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e24a5b-9410-4182-a0a6-79f9d4d97016 service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:47.743828 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1039/2069] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:00:47 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:00:57.561811 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=44 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:57.735168 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=2 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:00:59.432795 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed1048-f5cc-4145-97ca-5eac33ed886e None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:59.434782 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-cbed1048-f5cc-4145-97ca-5eac33ed886e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:59.506795 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e24a5b-9410-4182-a0a6-79f9d4d97016 service neutron] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:59.509643 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-b7e24a5b-9410-4182-a0a6-79f9d4d97016 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:59.560044 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbed1048-f5cc-4145-97ca-5eac33ed886e None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:59.566286 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ff26c-311c-4912-9572-a81092054bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:59.567123 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ff26c-311c-4912-9572-a81092054bff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:59.567546 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ff26c-311c-4912-9572-a81092054bff admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:59.568061 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ff26c-311c-4912-9572-a81092054bff admin admin] PATH_INFO: `/v3/users/d067737911814ccf9661b23739243d26` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:59.569365 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988ff26c-311c-4912-9572-a81092054bff admin admin] RBAC: Authorizing `identity:delete_user(user_id=d067737911814ccf9661b23739243d26)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:59.571350 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988ff26c-311c-4912-9572-a81092054bff admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:59.661030 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e24a5b-9410-4182-a0a6-79f9d4d97016 service neutron] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:00:59.666757 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d22ad5-44c5-425f-a2f2-551a4e5d65a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:00:59.667736 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d22ad5-44c5-425f-a2f2-551a4e5d65a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:59.668175 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d22ad5-44c5-425f-a2f2-551a4e5d65a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:59.668906 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d22ad5-44c5-425f-a2f2-551a4e5d65a1 admin admin] PATH_INFO: `/v3/users/35da3e3737ca4fee90b22924a9441e23` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:59.670653 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d22ad5-44c5-425f-a2f2-551a4e5d65a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35da3e3737ca4fee90b22924a9441e23)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:00:59.671364 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-988ff26c-311c-4912-9572-a81092054bff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd067737911814ccf9661b23739243d26'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:59.672937 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d22ad5-44c5-425f-a2f2-551a4e5d65a1 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:00:59.689468 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-988ff26c-311c-4912-9572-a81092054bff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd067737911814ccf9661b23739243d26'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:59.714313 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-988ff26c-311c-4912-9572-a81092054bff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd067737911814ccf9661b23739243d26'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:59.715346 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-988ff26c-311c-4912-9572-a81092054bff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd067737911814ccf9661b23739243d26'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:59.716406 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-988ff26c-311c-4912-9572-a81092054bff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd067737911814ccf9661b23739243d26'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:59.762822 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1031/2070] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 01:00:59 2022] DELETE /identity/v3/users/d067737911814ccf9661b23739243d26 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:00:59.764986 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123817a-753c-49d2-9098-efafa1532ab9 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:59.768119 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123817a-753c-49d2-9098-efafa1532ab9 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:59.769201 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123817a-753c-49d2-9098-efafa1532ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:59.776074 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-66d22ad5-44c5-425f-a2f2-551a4e5d65a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35da3e3737ca4fee90b22924a9441e23'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:59.796338 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-a123817a-753c-49d2-9098-efafa1532ab9 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:59.798348 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-a123817a-753c-49d2-9098-efafa1532ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:59.802247 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-66d22ad5-44c5-425f-a2f2-551a4e5d65a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35da3e3737ca4fee90b22924a9441e23'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:59.814138 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-66d22ad5-44c5-425f-a2f2-551a4e5d65a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35da3e3737ca4fee90b22924a9441e23'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:59.814870 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-66d22ad5-44c5-425f-a2f2-551a4e5d65a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35da3e3737ca4fee90b22924a9441e23'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:59.816017 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-66d22ad5-44c5-425f-a2f2-551a4e5d65a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35da3e3737ca4fee90b22924a9441e23'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:00:59.840830 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1040/2071] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 01:00:59 2022] DELETE /identity/v3/users/35da3e3737ca4fee90b22924a9441e23 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:00:59.846149 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb493ef-2ccc-43ae-88a5-84c055a735d6 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:00:59.846857 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb493ef-2ccc-43ae-88a5-84c055a735d6 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:00:59.847235 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb493ef-2ccc-43ae-88a5-84c055a735d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:00:59.887638 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-0eb493ef-2ccc-43ae-88a5-84c055a735d6 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:00:59.893410 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-0eb493ef-2ccc-43ae-88a5-84c055a735d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:00:59.932041 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1032/2072] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:00:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:00:59.968342 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a123817a-753c-49d2-9098-efafa1532ab9 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:00:59.971141 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-a123817a-753c-49d2-9098-efafa1532ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:00.058177 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:00.093969 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1041/2073] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:00:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:00.132168 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a123817a-753c-49d2-9098-efafa1532ab9 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:00.147847 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb493ef-2ccc-43ae-88a5-84c055a735d6 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:00.225738 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:00.261892 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b630c121-fae7-4a96-9da7-a172297644a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:00.262810 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630c121-fae7-4a96-9da7-a172297644a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:00.263104 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630c121-fae7-4a96-9da7-a172297644a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:00.263379 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630c121-fae7-4a96-9da7-a172297644a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:00.278193 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b630c121-fae7-4a96-9da7-a172297644a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:00.280154 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b630c121-fae7-4a96-9da7-a172297644a6 service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:00.294592 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb493ef-2ccc-43ae-88a5-84c055a735d6 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:00.299275 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f108505-eb8e-443b-ab55-1e2a898daf8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:00.300043 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1033/2074] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:00:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:01:00.300637 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f108505-eb8e-443b-ab55-1e2a898daf8a service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:00.301061 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f108505-eb8e-443b-ab55-1e2a898daf8a service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:00.301482 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f108505-eb8e-443b-ab55-1e2a898daf8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:00.312982 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f108505-eb8e-443b-ab55-1e2a898daf8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:00.315452 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f108505-eb8e-443b-ab55-1e2a898daf8a service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:00.329970 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1042/2075] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:01:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:01:01.232571 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b630c121-fae7-4a96-9da7-a172297644a6 service neutron] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:01.234218 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-b630c121-fae7-4a96-9da7-a172297644a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:01.252309 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b630c121-fae7-4a96-9da7-a172297644a6 service neutron] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:01.271171 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c679a93b-fc25-451c-b1d7-3e16d9c28766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:01.272180 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c679a93b-fc25-451c-b1d7-3e16d9c28766 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:01.273945 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c679a93b-fc25-451c-b1d7-3e16d9c28766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:01.274231 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c679a93b-fc25-451c-b1d7-3e16d9c28766 admin admin] PATH_INFO: `/v3/projects/cb514dd4797f4f898d52148ff65ba41e` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:01.277351 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c679a93b-fc25-451c-b1d7-3e16d9c28766 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb514dd4797f4f898d52148ff65ba41e)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:01.284549 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c679a93b-fc25-451c-b1d7-3e16d9c28766 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:01.295854 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f108505-eb8e-443b-ab55-1e2a898daf8a service neutron] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:01.297344 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-6f108505-eb8e-443b-ab55-1e2a898daf8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:01.322386 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f108505-eb8e-443b-ab55-1e2a898daf8a service neutron] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:01.331360 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5892fe7e-4b32-4cb4-89aa-26a49c7fd206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:01.332036 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892fe7e-4b32-4cb4-89aa-26a49c7fd206 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:01.332311 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892fe7e-4b32-4cb4-89aa-26a49c7fd206 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:01.332580 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892fe7e-4b32-4cb4-89aa-26a49c7fd206 admin admin] PATH_INFO: `/v3/projects/cd0a6f433e674f72a41d4efa397d5869` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:01.340825 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5892fe7e-4b32-4cb4-89aa-26a49c7fd206 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd0a6f433e674f72a41d4efa397d5869)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:01.343266 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5892fe7e-4b32-4cb4-89aa-26a49c7fd206 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:01.423375 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-c679a93b-fc25-451c-b1d7-3e16d9c28766 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb514dd4797f4f898d52148ff65ba41e', 'request_id': 'req-c679a93b-fc25-451c-b1d7-3e16d9c28766'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:01.440496 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-c679a93b-fc25-451c-b1d7-3e16d9c28766 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb514dd4797f4f898d52148ff65ba41e', 'request_id': 'req-c679a93b-fc25-451c-b1d7-3e16d9c28766'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:01.443922 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-5892fe7e-4b32-4cb4-89aa-26a49c7fd206 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd0a6f433e674f72a41d4efa397d5869', 'request_id': 'req-5892fe7e-4b32-4cb4-89aa-26a49c7fd206'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:01.456490 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-5892fe7e-4b32-4cb4-89aa-26a49c7fd206 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd0a6f433e674f72a41d4efa397d5869', 'request_id': 'req-5892fe7e-4b32-4cb4-89aa-26a49c7fd206'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:01.459551 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-c679a93b-fc25-451c-b1d7-3e16d9c28766 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb514dd4797f4f898d52148ff65ba41e', 'request_id': 'req-c679a93b-fc25-451c-b1d7-3e16d9c28766'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:01.471086 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-5892fe7e-4b32-4cb4-89aa-26a49c7fd206 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd0a6f433e674f72a41d4efa397d5869', 'request_id': 'req-5892fe7e-4b32-4cb4-89aa-26a49c7fd206'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:01.493891 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-5892fe7e-4b32-4cb4-89aa-26a49c7fd206 admin admin] The token cache is being invalidate because project cd0a6f433e674f72a41d4efa397d5869 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81807) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:01:01.494209 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-5892fe7e-4b32-4cb4-89aa-26a49c7fd206 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:01.495218 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-5892fe7e-4b32-4cb4-89aa-26a49c7fd206 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:01.496363 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-c679a93b-fc25-451c-b1d7-3e16d9c28766 admin admin] The token cache is being invalidate because project cb514dd4797f4f898d52148ff65ba41e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81808) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:01:01.496874 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1043/2076] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 01:01:01 2022] DELETE /identity/v3/projects/cd0a6f433e674f72a41d4efa397d5869 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:01:01.497276 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-c679a93b-fc25-451c-b1d7-3e16d9c28766 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:01.500431 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-c679a93b-fc25-451c-b1d7-3e16d9c28766 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:01.500801 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5892fe7e-4b32-4cb4-89aa-26a49c7fd206 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:01.502189 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-5892fe7e-4b32-4cb4-89aa-26a49c7fd206 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:01.503601 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1034/2077] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 01:01:01 2022] DELETE /identity/v3/projects/cb514dd4797f4f898d52148ff65ba41e => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:01.509740 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085950df-8fe8-460d-ac59-9fefc33c11d4 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:01.510396 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085950df-8fe8-460d-ac59-9fefc33c11d4 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:01.510835 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085950df-8fe8-460d-ac59-9fefc33c11d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:01.542213 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-085950df-8fe8-460d-ac59-9fefc33c11d4 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:01.545290 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-085950df-8fe8-460d-ac59-9fefc33c11d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:01.655503 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5892fe7e-4b32-4cb4-89aa-26a49c7fd206 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:01.666250 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9660fbeb-1a99-4a0e-b251-d4f6c9d17b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:01.667233 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9660fbeb-1a99-4a0e-b251-d4f6c9d17b5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:01.667520 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9660fbeb-1a99-4a0e-b251-d4f6c9d17b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:01.667856 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9660fbeb-1a99-4a0e-b251-d4f6c9d17b5d admin admin] PATH_INFO: `/v3/users/5acf0814c16b47688bd3a2ac9986105e` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:01.671160 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9660fbeb-1a99-4a0e-b251-d4f6c9d17b5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5acf0814c16b47688bd3a2ac9986105e)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:01.673569 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9660fbeb-1a99-4a0e-b251-d4f6c9d17b5d admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:01.691103 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1035/2078] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:01:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:01.738972 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c86ce-d32b-4d2d-b3bd-091af3e39b2e None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:01.739247 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c86ce-d32b-4d2d-b3bd-091af3e39b2e None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:01.739506 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c86ce-d32b-4d2d-b3bd-091af3e39b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:01.762534 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:01.777361 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-9660fbeb-1a99-4a0e-b251-d4f6c9d17b5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5acf0814c16b47688bd3a2ac9986105e'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:01.778750 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:01.796906 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-1d2c86ce-d32b-4d2d-b3bd-091af3e39b2e None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:01.798150 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-1d2c86ce-d32b-4d2d-b3bd-091af3e39b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:01.799803 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-9660fbeb-1a99-4a0e-b251-d4f6c9d17b5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5acf0814c16b47688bd3a2ac9986105e'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:01.807523 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1036/2079] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:01:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:01.816057 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-9660fbeb-1a99-4a0e-b251-d4f6c9d17b5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5acf0814c16b47688bd3a2ac9986105e'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:01.817240 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-9660fbeb-1a99-4a0e-b251-d4f6c9d17b5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5acf0814c16b47688bd3a2ac9986105e'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:01.817982 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-9660fbeb-1a99-4a0e-b251-d4f6c9d17b5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5acf0814c16b47688bd3a2ac9986105e'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:01.820757 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c86ce-d32b-4d2d-b3bd-091af3e39b2e None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:01.830961 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c86ce-d32b-4d2d-b3bd-091af3e39b2e None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:01.844418 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d690d8-06f3-4c46-be85-808a17a42fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:01.844924 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d690d8-06f3-4c46-be85-808a17a42fbe admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:01.845205 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d690d8-06f3-4c46-be85-808a17a42fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:01.845460 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d690d8-06f3-4c46-be85-808a17a42fbe admin admin] PATH_INFO: `/v3/domains` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:01.846120 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d690d8-06f3-4c46-be85-808a17a42fbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:01:01.846418 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d690d8-06f3-4c46-be85-808a17a42fbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:01.846716 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1044/2080] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 01:01:01 2022] DELETE /identity/v3/users/5acf0814c16b47688bd3a2ac9986105e => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:01.848064 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d690d8-06f3-4c46-be85-808a17a42fbe admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:01.879589 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9660fbeb-1a99-4a0e-b251-d4f6c9d17b5d admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:01.881382 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1037/2081] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 01:01:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:01:01.882186 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-9660fbeb-1a99-4a0e-b251-d4f6c9d17b5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:02.029829 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9660fbeb-1a99-4a0e-b251-d4f6c9d17b5d admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:02.036420 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b380df-bc24-48a8-8cf5-81fbdd5d737a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:02.037073 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b380df-bc24-48a8-8cf5-81fbdd5d737a admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:02.037872 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b380df-bc24-48a8-8cf5-81fbdd5d737a admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:02.038446 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b380df-bc24-48a8-8cf5-81fbdd5d737a admin admin] PATH_INFO: `/v3/projects` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:02.039133 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b380df-bc24-48a8-8cf5-81fbdd5d737a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:02.041245 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b380df-bc24-48a8-8cf5-81fbdd5d737a admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:02.100806 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1045/2082] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 01:01:01 2022] POST /identity/v3/projects => generated 381 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:01:02.108676 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d690d8-06f3-4c46-be85-808a17a42fbe admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:02.139995 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d690d8-06f3-4c46-be85-808a17a42fbe admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:02.256215 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f8bf9a-c170-4df9-8fba-6c8022c83fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:02.256843 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f8bf9a-c170-4df9-8fba-6c8022c83fcd admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:02.257104 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f8bf9a-c170-4df9-8fba-6c8022c83fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:02.257375 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f8bf9a-c170-4df9-8fba-6c8022c83fcd admin admin] PATH_INFO: `/v3/users` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:02.258023 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f8bf9a-c170-4df9-8fba-6c8022c83fcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:02.260020 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f8bf9a-c170-4df9-8fba-6c8022c83fcd admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:02.295190 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1038/2083] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 01:01:02 2022] POST /identity/v3/users => generated 291 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:01:02.296944 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b380df-bc24-48a8-8cf5-81fbdd5d737a admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:02.313166 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b380df-bc24-48a8-8cf5-81fbdd5d737a admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:02.319245 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967881a5-80b9-4d07-9d29-cf0d201c0875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:02.319819 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967881a5-80b9-4d07-9d29-cf0d201c0875 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:02.320116 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967881a5-80b9-4d07-9d29-cf0d201c0875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:02.320477 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967881a5-80b9-4d07-9d29-cf0d201c0875 admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:02.321478 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967881a5-80b9-4d07-9d29-cf0d201c0875 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:02.324835 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967881a5-80b9-4d07-9d29-cf0d201c0875 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:02.345590 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1046/2084] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:01:02 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:01:02.347297 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f8bf9a-c170-4df9-8fba-6c8022c83fcd admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:02.366709 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f8bf9a-c170-4df9-8fba-6c8022c83fcd admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:02.373787 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febeb7b6-c167-4bda-b646-fbd33d971ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:02.374811 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febeb7b6-c167-4bda-b646-fbd33d971ce0 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:02.375266 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febeb7b6-c167-4bda-b646-fbd33d971ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:02.375775 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febeb7b6-c167-4bda-b646-fbd33d971ce0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:02.376724 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febeb7b6-c167-4bda-b646-fbd33d971ce0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:02.379568 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febeb7b6-c167-4bda-b646-fbd33d971ce0 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:02.400689 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1039/2085] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:01:02 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:01:02.404738 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967881a5-80b9-4d07-9d29-cf0d201c0875 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:02.416906 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967881a5-80b9-4d07-9d29-cf0d201c0875 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:02.424475 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121818de-6ec1-4e96-90b3-636589562547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:02.425438 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121818de-6ec1-4e96-90b3-636589562547 admin admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:02.425925 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121818de-6ec1-4e96-90b3-636589562547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:02.426721 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121818de-6ec1-4e96-90b3-636589562547 admin admin] PATH_INFO: `/v3/projects/52e27948285b41779884f1a874fa045d/users/dace8a8d3e6c44978a35c1b3ce38c9ee/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:02.447963 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121818de-6ec1-4e96-90b3-636589562547 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52e27948285b41779884f1a874fa045d, user_id=dace8a8d3e6c44978a35c1b3ce38c9ee, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:02.451284 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121818de-6ec1-4e96-90b3-636589562547 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:02.487766 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1047/2086] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 01:01:02 2022] PUT /identity/v3/projects/52e27948285b41779884f1a874fa045d/users/dace8a8d3e6c44978a35c1b3ce38c9ee/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:02.497123 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29bf836-2ceb-4b46-bc76-2730a6338c47 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:02.497405 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29bf836-2ceb-4b46-bc76-2730a6338c47 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:02.497677 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29bf836-2ceb-4b46-bc76-2730a6338c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:02.578339 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-b29bf836-2ceb-4b46-bc76-2730a6338c47 None None] MFA Rules not processed for user `dace8a8d3e6c44978a35c1b3ce38c9ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:02.579583 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-b29bf836-2ceb-4b46-bc76-2730a6338c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:02.709783 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1040/2087] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:01:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:02.731231 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121818de-6ec1-4e96-90b3-636589562547 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:02.735406 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-121818de-6ec1-4e96-90b3-636589562547 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:02.836927 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121818de-6ec1-4e96-90b3-636589562547 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:02.845859 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e1157a-478d-4706-b1d8-5f99de320548 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:02.847442 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e1157a-478d-4706-b1d8-5f99de320548 service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:02.848341 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e1157a-478d-4706-b1d8-5f99de320548 service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:02.852105 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e1157a-478d-4706-b1d8-5f99de320548 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:02.870436 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e1157a-478d-4706-b1d8-5f99de320548 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:02.872779 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e1157a-478d-4706-b1d8-5f99de320548 service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:02.888541 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1048/2088] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:01:02 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:01:02.942953 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29bf836-2ceb-4b46-bc76-2730a6338c47 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:02.971866 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e1157a-478d-4706-b1d8-5f99de320548 service neutron] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:02.973577 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-64e1157a-478d-4706-b1d8-5f99de320548 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:03.024696 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:03.092973 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:03.127091 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29bf836-2ceb-4b46-bc76-2730a6338c47 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:03.140433 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e645d5-5817-4b2e-a868-f0415ff63185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:03.141101 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e645d5-5817-4b2e-a868-f0415ff63185 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:03.141381 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e645d5-5817-4b2e-a868-f0415ff63185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:03.141650 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e645d5-5817-4b2e-a868-f0415ff63185 admin admin] PATH_INFO: `/v3/users/dace8a8d3e6c44978a35c1b3ce38c9ee` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:03.160724 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e645d5-5817-4b2e-a868-f0415ff63185 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dace8a8d3e6c44978a35c1b3ce38c9ee)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:03.165323 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e645d5-5817-4b2e-a868-f0415ff63185 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:03.176435 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e1157a-478d-4706-b1d8-5f99de320548 service neutron] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:03.196671 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233325af-88ca-4758-a8e1-69ddab094a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:03.198129 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233325af-88ca-4758-a8e1-69ddab094a66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:03.198491 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233325af-88ca-4758-a8e1-69ddab094a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:03.198986 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233325af-88ca-4758-a8e1-69ddab094a66 admin admin] PATH_INFO: `/v3/projects/07cccfa37b9648de95f7df5cadb98ce4` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:03.202116 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233325af-88ca-4758-a8e1-69ddab094a66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07cccfa37b9648de95f7df5cadb98ce4)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:03.212768 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233325af-88ca-4758-a8e1-69ddab094a66 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:03.281844 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-d9e645d5-5817-4b2e-a868-f0415ff63185 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dace8a8d3e6c44978a35c1b3ce38c9ee'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:03.295709 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-d9e645d5-5817-4b2e-a868-f0415ff63185 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dace8a8d3e6c44978a35c1b3ce38c9ee'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:03.327797 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-d9e645d5-5817-4b2e-a868-f0415ff63185 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dace8a8d3e6c44978a35c1b3ce38c9ee'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:03.333091 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-d9e645d5-5817-4b2e-a868-f0415ff63185 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dace8a8d3e6c44978a35c1b3ce38c9ee'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:03.333845 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-d9e645d5-5817-4b2e-a868-f0415ff63185 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dace8a8d3e6c44978a35c1b3ce38c9ee'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:03.343825 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-233325af-88ca-4758-a8e1-69ddab094a66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07cccfa37b9648de95f7df5cadb98ce4', 'request_id': 'req-233325af-88ca-4758-a8e1-69ddab094a66'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:03.359331 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1041/2089] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 01:01:02 2022] DELETE /identity/v3/users/dace8a8d3e6c44978a35c1b3ce38c9ee => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:03.361120 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-233325af-88ca-4758-a8e1-69ddab094a66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07cccfa37b9648de95f7df5cadb98ce4', 'request_id': 'req-233325af-88ca-4758-a8e1-69ddab094a66'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:03.365323 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e4494-5d6c-4894-9ae0-05fbe6c2fe8d None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:03.365803 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e4494-5d6c-4894-9ae0-05fbe6c2fe8d None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:03.366078 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e4494-5d6c-4894-9ae0-05fbe6c2fe8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:03.381554 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-233325af-88ca-4758-a8e1-69ddab094a66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07cccfa37b9648de95f7df5cadb98ce4', 'request_id': 'req-233325af-88ca-4758-a8e1-69ddab094a66'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:03.401611 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-233325af-88ca-4758-a8e1-69ddab094a66 admin admin] The token cache is being invalidate because project 07cccfa37b9648de95f7df5cadb98ce4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81807) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:01:03.402006 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-233325af-88ca-4758-a8e1-69ddab094a66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:03.404143 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-233325af-88ca-4758-a8e1-69ddab094a66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:03.409039 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1049/2090] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 01:01:02 2022] DELETE /identity/v3/projects/07cccfa37b9648de95f7df5cadb98ce4 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:01:03.409937 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-4d7e4494-5d6c-4894-9ae0-05fbe6c2fe8d None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:03.410334 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233325af-88ca-4758-a8e1-69ddab094a66 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:03.410652 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-4d7e4494-5d6c-4894-9ae0-05fbe6c2fe8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:03.411916 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-233325af-88ca-4758-a8e1-69ddab094a66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:03.571588 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1042/2091] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:01:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:03.602776 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233325af-88ca-4758-a8e1-69ddab094a66 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:03.631535 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56e785d-21d1-4223-a6b2-00bd6c7fa9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:03.632468 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e785d-21d1-4223-a6b2-00bd6c7fa9b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:03.632831 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e785d-21d1-4223-a6b2-00bd6c7fa9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:03.633204 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e785d-21d1-4223-a6b2-00bd6c7fa9b5 admin admin] PATH_INFO: `/v3/users/aca1578a36f94ad6989f2208f8b67ae0` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:03.636615 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56e785d-21d1-4223-a6b2-00bd6c7fa9b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aca1578a36f94ad6989f2208f8b67ae0)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:03.639128 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56e785d-21d1-4223-a6b2-00bd6c7fa9b5 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:03.771044 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-b56e785d-21d1-4223-a6b2-00bd6c7fa9b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aca1578a36f94ad6989f2208f8b67ae0'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:03.773909 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:03.800690 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-b56e785d-21d1-4223-a6b2-00bd6c7fa9b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aca1578a36f94ad6989f2208f8b67ae0'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:03.811917 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-b56e785d-21d1-4223-a6b2-00bd6c7fa9b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aca1578a36f94ad6989f2208f8b67ae0'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:03.812857 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-b56e785d-21d1-4223-a6b2-00bd6c7fa9b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aca1578a36f94ad6989f2208f8b67ae0'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:03.813601 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-b56e785d-21d1-4223-a6b2-00bd6c7fa9b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aca1578a36f94ad6989f2208f8b67ae0'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:03.829411 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1050/2092] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 01:01:03 2022] DELETE /identity/v3/users/aca1578a36f94ad6989f2208f8b67ae0 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:04.178091 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e4494-5d6c-4894-9ae0-05fbe6c2fe8d None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:04.179781 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-4d7e4494-5d6c-4894-9ae0-05fbe6c2fe8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:04.295095 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e4494-5d6c-4894-9ae0-05fbe6c2fe8d None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:04.378643 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:04.465873 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d98210e-4e5f-47d6-9753-22b77448a801 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:04.468495 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98210e-4e5f-47d6-9753-22b77448a801 service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:04.469024 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98210e-4e5f-47d6-9753-22b77448a801 service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:04.469551 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98210e-4e5f-47d6-9753-22b77448a801 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:04.473000 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-8d98210e-4e5f-47d6-9753-22b77448a801 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:04.659451 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d98210e-4e5f-47d6-9753-22b77448a801 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:04.661200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d98210e-4e5f-47d6-9753-22b77448a801 service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:04.679091 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1043/2093] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:01:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:01:06.026592 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56e785d-21d1-4223-a6b2-00bd6c7fa9b5 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:06.030452 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-b56e785d-21d1-4223-a6b2-00bd6c7fa9b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:06.083231 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56e785d-21d1-4223-a6b2-00bd6c7fa9b5 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:06.104196 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c925ccc7-eee0-4120-8a68-541e9758f42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:06.108592 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c925ccc7-eee0-4120-8a68-541e9758f42c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:06.109072 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c925ccc7-eee0-4120-8a68-541e9758f42c admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:06.109659 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c925ccc7-eee0-4120-8a68-541e9758f42c admin admin] PATH_INFO: `/v3/projects/715a9d1a4a8f43479d6090610b104709` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:06.117401 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c925ccc7-eee0-4120-8a68-541e9758f42c admin admin] RBAC: Authorizing `identity:delete_project(project_id=715a9d1a4a8f43479d6090610b104709)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:06.128459 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c925ccc7-eee0-4120-8a68-541e9758f42c admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:06.297982 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-c925ccc7-eee0-4120-8a68-541e9758f42c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '715a9d1a4a8f43479d6090610b104709', 'request_id': 'req-c925ccc7-eee0-4120-8a68-541e9758f42c'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:06.307614 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-c925ccc7-eee0-4120-8a68-541e9758f42c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '715a9d1a4a8f43479d6090610b104709', 'request_id': 'req-c925ccc7-eee0-4120-8a68-541e9758f42c'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:06.319548 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-c925ccc7-eee0-4120-8a68-541e9758f42c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '715a9d1a4a8f43479d6090610b104709', 'request_id': 'req-c925ccc7-eee0-4120-8a68-541e9758f42c'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:06.336064 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d98210e-4e5f-47d6-9753-22b77448a801 service neutron] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:06.337521 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-8d98210e-4e5f-47d6-9753-22b77448a801 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:06.350395 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-c925ccc7-eee0-4120-8a68-541e9758f42c admin admin] The token cache is being invalidate because project 715a9d1a4a8f43479d6090610b104709 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81807) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:01:06.352681 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-c925ccc7-eee0-4120-8a68-541e9758f42c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:06.355416 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-c925ccc7-eee0-4120-8a68-541e9758f42c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:06.365186 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1051/2094] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 01:01:06 2022] DELETE /identity/v3/projects/715a9d1a4a8f43479d6090610b104709 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:06.379443 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399712d1-1364-4685-a189-db3c34dacfe1 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:06.382209 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399712d1-1364-4685-a189-db3c34dacfe1 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:06.382559 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399712d1-1364-4685-a189-db3c34dacfe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:06.388325 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d98210e-4e5f-47d6-9753-22b77448a801 service neutron] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:06.447516 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-399712d1-1364-4685-a189-db3c34dacfe1 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:06.451428 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-399712d1-1364-4685-a189-db3c34dacfe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:06.639239 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bb11b3-0f77-4afc-b9f7-f2681484bd21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:06.641713 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb11b3-0f77-4afc-b9f7-f2681484bd21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:06.643065 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb11b3-0f77-4afc-b9f7-f2681484bd21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:06.643455 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb11b3-0f77-4afc-b9f7-f2681484bd21 admin admin] PATH_INFO: `/v3/projects/52e27948285b41779884f1a874fa045d` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:06.648596 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bb11b3-0f77-4afc-b9f7-f2681484bd21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52e27948285b41779884f1a874fa045d)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:06.654206 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bb11b3-0f77-4afc-b9f7-f2681484bd21 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:06.705319 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1052/2095] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:01:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:06.714579 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc8e19-28d0-4527-bdb8-23e9288b840b None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:06.715030 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc8e19-28d0-4527-bdb8-23e9288b840b None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:06.715373 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc8e19-28d0-4527-bdb8-23e9288b840b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:06.745680 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-7ffc8e19-28d0-4527-bdb8-23e9288b840b None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:06.747372 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-7ffc8e19-28d0-4527-bdb8-23e9288b840b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:06.772312 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1053/2096] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:01:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:06.774700 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffc8e19-28d0-4527-bdb8-23e9288b840b None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:06.792007 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-92bb11b3-0f77-4afc-b9f7-f2681484bd21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52e27948285b41779884f1a874fa045d', 'request_id': 'req-92bb11b3-0f77-4afc-b9f7-f2681484bd21'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:06.796450 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffc8e19-28d0-4527-bdb8-23e9288b840b None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:06.807067 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-92bb11b3-0f77-4afc-b9f7-f2681484bd21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52e27948285b41779884f1a874fa045d', 'request_id': 'req-92bb11b3-0f77-4afc-b9f7-f2681484bd21'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:06.829763 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-92bb11b3-0f77-4afc-b9f7-f2681484bd21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52e27948285b41779884f1a874fa045d', 'request_id': 'req-92bb11b3-0f77-4afc-b9f7-f2681484bd21'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:06.855705 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-92bb11b3-0f77-4afc-b9f7-f2681484bd21 admin admin] The token cache is being invalidate because project 52e27948285b41779884f1a874fa045d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81808) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:01:06.857277 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-92bb11b3-0f77-4afc-b9f7-f2681484bd21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:06.859050 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-92bb11b3-0f77-4afc-b9f7-f2681484bd21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:06.868049 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1044/2097] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 01:01:06 2022] DELETE /identity/v3/projects/52e27948285b41779884f1a874fa045d => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:01:06.870497 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325ad50-15bb-4b20-9737-132bfc0ddc50 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:06.870497 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325ad50-15bb-4b20-9737-132bfc0ddc50 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:06.870497 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b325ad50-15bb-4b20-9737-132bfc0ddc50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:06.887049 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:06.894903 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:06.906538 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-b325ad50-15bb-4b20-9737-132bfc0ddc50 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:06.913157 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-b325ad50-15bb-4b20-9737-132bfc0ddc50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:06.927125 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f2b6f7-72e8-45ca-9c98-45c818db9c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:06.927768 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2b6f7-72e8-45ca-9c98-45c818db9c56 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:06.928834 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2b6f7-72e8-45ca-9c98-45c818db9c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:06.929216 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2b6f7-72e8-45ca-9c98-45c818db9c56 admin admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:06.929887 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f2b6f7-72e8-45ca-9c98-45c818db9c56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:01:06.930189 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f2b6f7-72e8-45ca-9c98-45c818db9c56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:06.931972 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f2b6f7-72e8-45ca-9c98-45c818db9c56 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:06.958389 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1054/2098] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 01:01:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:01:06.961733 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f2b6f7-72e8-45ca-9c98-45c818db9c56 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:06.964730 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-19f2b6f7-72e8-45ca-9c98-45c818db9c56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:06.981020 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f2b6f7-72e8-45ca-9c98-45c818db9c56 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:06.988474 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8c783-7aba-4465-9080-f8ab8e6b5fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:06.989481 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8c783-7aba-4465-9080-f8ab8e6b5fb2 admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:06.989980 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8c783-7aba-4465-9080-f8ab8e6b5fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:06.990485 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d8c783-7aba-4465-9080-f8ab8e6b5fb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:06.991369 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d8c783-7aba-4465-9080-f8ab8e6b5fb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:06.995153 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d8c783-7aba-4465-9080-f8ab8e6b5fb2 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:07.039191 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1055/2099] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 01:01:06 2022] POST /identity/v3/projects => generated 389 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:01:07.044897 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8c783-7aba-4465-9080-f8ab8e6b5fb2 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:07.096242 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1045/2100] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:01:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:07.105606 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00cd4b1-ed76-4718-91e8-10c12078a7fb None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:07.105897 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00cd4b1-ed76-4718-91e8-10c12078a7fb None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:07.106171 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00cd4b1-ed76-4718-91e8-10c12078a7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:07.127868 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d8c783-7aba-4465-9080-f8ab8e6b5fb2 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:07.134929 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c70a0d-5dd5-41ed-9b64-3dc5473b58f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:07.135570 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c70a0d-5dd5-41ed-9b64-3dc5473b58f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:07.135852 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c70a0d-5dd5-41ed-9b64-3dc5473b58f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:07.136112 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c70a0d-5dd5-41ed-9b64-3dc5473b58f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:07.136890 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c70a0d-5dd5-41ed-9b64-3dc5473b58f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:07.137600 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-e00cd4b1-ed76-4718-91e8-10c12078a7fb None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:07.138878 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c70a0d-5dd5-41ed-9b64-3dc5473b58f6 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:07.139067 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-e00cd4b1-ed76-4718-91e8-10c12078a7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:07.152736 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1046/2101] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:01:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:07.158026 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00cd4b1-ed76-4718-91e8-10c12078a7fb None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:07.180867 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00cd4b1-ed76-4718-91e8-10c12078a7fb None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:07.187793 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1056/2102] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 01:01:07 2022] POST /identity/v3/users => generated 295 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:01:07.189674 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c70a0d-5dd5-41ed-9b64-3dc5473b58f6 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:07.191283 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a6263-07c9-47de-af60-ed6a2a7225ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:07.191958 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a6263-07c9-47de-af60-ed6a2a7225ae admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:07.192232 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a6263-07c9-47de-af60-ed6a2a7225ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:07.192796 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a6263-07c9-47de-af60-ed6a2a7225ae admin admin] PATH_INFO: `/v3/domains` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:07.193594 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2a6263-07c9-47de-af60-ed6a2a7225ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:01:07.197369 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2a6263-07c9-47de-af60-ed6a2a7225ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:07.199047 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2a6263-07c9-47de-af60-ed6a2a7225ae admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:07.206347 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c70a0d-5dd5-41ed-9b64-3dc5473b58f6 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:07.214645 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce2db4-3192-4bef-83a3-01e32589996b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:07.215412 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce2db4-3192-4bef-83a3-01e32589996b admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:07.215736 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce2db4-3192-4bef-83a3-01e32589996b admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:07.216012 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce2db4-3192-4bef-83a3-01e32589996b admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:07.216859 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce2db4-3192-4bef-83a3-01e32589996b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:07.219454 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce2db4-3192-4bef-83a3-01e32589996b admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:07.235984 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1047/2103] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 01:01:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:01:07.240152 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a6263-07c9-47de-af60-ed6a2a7225ae admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:07.252046 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1057/2104] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:01:07 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:01:07.257937 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce2db4-3192-4bef-83a3-01e32589996b admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:07.259576 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a6263-07c9-47de-af60-ed6a2a7225ae admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:07.265742 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6453594-771e-4525-8e84-e415b0171b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:07.266674 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6453594-771e-4525-8e84-e415b0171b37 admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:07.267048 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6453594-771e-4525-8e84-e415b0171b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:07.267412 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6453594-771e-4525-8e84-e415b0171b37 admin admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:07.268202 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6453594-771e-4525-8e84-e415b0171b37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:07.272715 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6453594-771e-4525-8e84-e415b0171b37 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:07.297829 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce2db4-3192-4bef-83a3-01e32589996b admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:07.312946 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a24f5f1-0c60-4f81-bd58-40c202585a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:07.313898 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a24f5f1-0c60-4f81-bd58-40c202585a93 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:07.314365 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a24f5f1-0c60-4f81-bd58-40c202585a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:07.314692 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a24f5f1-0c60-4f81-bd58-40c202585a93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:07.315622 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a24f5f1-0c60-4f81-bd58-40c202585a93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:07.318631 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a24f5f1-0c60-4f81-bd58-40c202585a93 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:07.334596 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1058/2105] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:01:07 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:01:07.336145 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1048/2106] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 01:01:07 2022] POST /identity/v3/projects => generated 369 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:01:07.346895 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a24f5f1-0c60-4f81-bd58-40c202585a93 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:07.347596 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6453594-771e-4525-8e84-e415b0171b37 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:07.370365 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a24f5f1-0c60-4f81-bd58-40c202585a93 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:07.513794 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a0d5d2-0edd-445a-a264-e503d614c1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:07.514784 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0d5d2-0edd-445a-a264-e503d614c1cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:07.516047 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0d5d2-0edd-445a-a264-e503d614c1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:07.516519 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0d5d2-0edd-445a-a264-e503d614c1cd admin admin] PATH_INFO: `/v3/projects/464befa0feb04db1ae218688835640ce/users/bc0253c640a840e48dafa49aa1096849/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:07.525769 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6453594-771e-4525-8e84-e415b0171b37 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:07.539628 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a0d5d2-0edd-445a-a264-e503d614c1cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=464befa0feb04db1ae218688835640ce, user_id=bc0253c640a840e48dafa49aa1096849, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:07.547303 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a0d5d2-0edd-445a-a264-e503d614c1cd admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:07.552890 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d06a71c-0fcf-494d-9f58-37bd191d829d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:07.553812 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d06a71c-0fcf-494d-9f58-37bd191d829d admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:07.554520 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d06a71c-0fcf-494d-9f58-37bd191d829d admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:07.555162 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d06a71c-0fcf-494d-9f58-37bd191d829d admin admin] PATH_INFO: `/v3/users` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:07.556353 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d06a71c-0fcf-494d-9f58-37bd191d829d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:07.560023 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d06a71c-0fcf-494d-9f58-37bd191d829d admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:07.585859 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1059/2107] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 01:01:07 2022] PUT /identity/v3/projects/464befa0feb04db1ae218688835640ce/users/bc0253c640a840e48dafa49aa1096849/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:07.598195 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3db390-aac7-4ad6-9ff3-3c04d7fd3a96 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:07.600262 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3db390-aac7-4ad6-9ff3-3c04d7fd3a96 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:07.605961 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3db390-aac7-4ad6-9ff3-3c04d7fd3a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:07.617813 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1049/2108] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 01:01:07 2022] POST /identity/v3/users => generated 285 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:01:07.625107 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d06a71c-0fcf-494d-9f58-37bd191d829d admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:07.647542 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:07.653810 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d06a71c-0fcf-494d-9f58-37bd191d829d admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:07.687452 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-ed3db390-aac7-4ad6-9ff3-3c04d7fd3a96 None None] MFA Rules not processed for user `bc0253c640a840e48dafa49aa1096849`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:07.689010 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-ed3db390-aac7-4ad6-9ff3-3c04d7fd3a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:07.753133 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:07.768035 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e4b4b-f1e8-4559-85a9-52d2f85bc173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:07.768744 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e4b4b-f1e8-4559-85a9-52d2f85bc173 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:07.769077 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e4b4b-f1e8-4559-85a9-52d2f85bc173 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:07.769542 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e4b4b-f1e8-4559-85a9-52d2f85bc173 admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:07.770259 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6e4b4b-f1e8-4559-85a9-52d2f85bc173 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:07.771984 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6e4b4b-f1e8-4559-85a9-52d2f85bc173 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:07.817547 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1050/2109] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:01:07 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:01:07.823617 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e4b4b-f1e8-4559-85a9-52d2f85bc173 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:07.850590 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e4b4b-f1e8-4559-85a9-52d2f85bc173 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:07.865752 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2aa777-44b4-4f22-b8b7-e35123111bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:07.866392 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2aa777-44b4-4f22-b8b7-e35123111bb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:07.866669 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2aa777-44b4-4f22-b8b7-e35123111bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:07.866937 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2aa777-44b4-4f22-b8b7-e35123111bb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:07.867601 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2aa777-44b4-4f22-b8b7-e35123111bb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:07.872293 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2aa777-44b4-4f22-b8b7-e35123111bb7 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:07.887505 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1060/2110] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:01:07 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:01:07.894440 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1051/2111] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:01:07 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:01:07.899493 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3db390-aac7-4ad6-9ff3-3c04d7fd3a96 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:07.916341 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3db390-aac7-4ad6-9ff3-3c04d7fd3a96 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:07.930735 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548a6b7-42da-4321-a5a3-54b60a80d0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:07.931606 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548a6b7-42da-4321-a5a3-54b60a80d0a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:07.932288 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548a6b7-42da-4321-a5a3-54b60a80d0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:07.932636 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548a6b7-42da-4321-a5a3-54b60a80d0a0 admin admin] PATH_INFO: `/v3/projects/622f8e6e59604b85a50fd339929a7434/users/feb270504df4484aa8b5cc51eee4886a/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:07.960108 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7548a6b7-42da-4321-a5a3-54b60a80d0a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=622f8e6e59604b85a50fd339929a7434, user_id=feb270504df4484aa8b5cc51eee4886a, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:07.967272 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7548a6b7-42da-4321-a5a3-54b60a80d0a0 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:07.988959 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2aa777-44b4-4f22-b8b7-e35123111bb7 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:07.992871 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-aa2aa777-44b4-4f22-b8b7-e35123111bb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:08.013952 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1061/2112] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 01:01:07 2022] PUT /identity/v3/projects/622f8e6e59604b85a50fd339929a7434/users/feb270504df4484aa8b5cc51eee4886a/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:08.026354 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc16ab-292f-4138-a267-2f408331123a None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:08.026639 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc16ab-292f-4138-a267-2f408331123a None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:08.026903 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc16ab-292f-4138-a267-2f408331123a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:08.086325 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-edcc16ab-292f-4138-a267-2f408331123a None None] MFA Rules not processed for user `feb270504df4484aa8b5cc51eee4886a`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:08.088683 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-edcc16ab-292f-4138-a267-2f408331123a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:08.126898 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2aa777-44b4-4f22-b8b7-e35123111bb7 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:08.181196 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1062/2113] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:01:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:08.194675 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751b479a-10f8-4706-8d36-ad414d8cb0fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:08.197954 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b479a-10f8-4706-8d36-ad414d8cb0fb service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:08.197954 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b479a-10f8-4706-8d36-ad414d8cb0fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:08.197954 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b479a-10f8-4706-8d36-ad414d8cb0fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:08.211863 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc16ab-292f-4138-a267-2f408331123a None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:08.215200 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-edcc16ab-292f-4138-a267-2f408331123a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:08.254859 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcc16ab-292f-4138-a267-2f408331123a None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:08.265566 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab373bc-3635-4099-9826-d6c12e9eff1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:08.267290 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab373bc-3635-4099-9826-d6c12e9eff1c service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:08.268580 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751b479a-10f8-4706-8d36-ad414d8cb0fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:08.270379 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751b479a-10f8-4706-8d36-ad414d8cb0fb service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:08.273298 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab373bc-3635-4099-9826-d6c12e9eff1c service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:08.274201 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab373bc-3635-4099-9826-d6c12e9eff1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:08.285097 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1052/2114] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:01:07 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:01:08.303646 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab373bc-3635-4099-9826-d6c12e9eff1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:08.305169 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab373bc-3635-4099-9826-d6c12e9eff1c service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:08.321220 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1063/2115] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:01:08 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:01:08.370511 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751b479a-10f8-4706-8d36-ad414d8cb0fb service neutron] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:08.464951 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:08.481353 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751b479a-10f8-4706-8d36-ad414d8cb0fb service neutron] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:08.487334 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2f4d8f-f96f-4cdf-8dc4-079a9536d08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:08.488148 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f4d8f-f96f-4cdf-8dc4-079a9536d08a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:08.488492 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f4d8f-f96f-4cdf-8dc4-079a9536d08a admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:08.489659 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2f4d8f-f96f-4cdf-8dc4-079a9536d08a admin admin] PATH_INFO: `/v3/users/bc0253c640a840e48dafa49aa1096849` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:08.490737 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2f4d8f-f96f-4cdf-8dc4-079a9536d08a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc0253c640a840e48dafa49aa1096849)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:08.493820 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2f4d8f-f96f-4cdf-8dc4-079a9536d08a admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:08.593350 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-9b2f4d8f-f96f-4cdf-8dc4-079a9536d08a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc0253c640a840e48dafa49aa1096849'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:08.608796 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-9b2f4d8f-f96f-4cdf-8dc4-079a9536d08a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc0253c640a840e48dafa49aa1096849'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:08.630372 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-9b2f4d8f-f96f-4cdf-8dc4-079a9536d08a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc0253c640a840e48dafa49aa1096849'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:08.631397 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-9b2f4d8f-f96f-4cdf-8dc4-079a9536d08a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc0253c640a840e48dafa49aa1096849'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:08.632048 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-9b2f4d8f-f96f-4cdf-8dc4-079a9536d08a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc0253c640a840e48dafa49aa1096849'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:08.648920 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1053/2116] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 01:01:08 2022] DELETE /identity/v3/users/bc0253c640a840e48dafa49aa1096849 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:08.654918 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12fa35b-9281-40a0-85ac-c66595f28161 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:08.655288 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12fa35b-9281-40a0-85ac-c66595f28161 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:08.655753 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12fa35b-9281-40a0-85ac-c66595f28161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:08.689844 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-b12fa35b-9281-40a0-85ac-c66595f28161 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:08.691091 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-b12fa35b-9281-40a0-85ac-c66595f28161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:08.777930 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:08.806259 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1064/2117] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:01:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:08.891147 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2f4d8f-f96f-4cdf-8dc4-079a9536d08a admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:08.898436 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-9b2f4d8f-f96f-4cdf-8dc4-079a9536d08a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:09.057157 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2f4d8f-f96f-4cdf-8dc4-079a9536d08a admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:09.061832 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6730881e-b7b9-4a96-8587-2ce934baf01a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:09.062575 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730881e-b7b9-4a96-8587-2ce934baf01a service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:09.062978 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730881e-b7b9-4a96-8587-2ce934baf01a service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:09.063384 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730881e-b7b9-4a96-8587-2ce934baf01a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:09.078318 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6730881e-b7b9-4a96-8587-2ce934baf01a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:09.094611 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6730881e-b7b9-4a96-8587-2ce934baf01a service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:09.113416 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1054/2118] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:01:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:01:09.151769 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12fa35b-9281-40a0-85ac-c66595f28161 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:09.153325 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-b12fa35b-9281-40a0-85ac-c66595f28161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:09.321983 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12fa35b-9281-40a0-85ac-c66595f28161 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:09.334291 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce97d0-f35a-4d36-8207-3f231c2aa7d3 tempest-RoutersIpV6AdminTest-431839325 tempest-RoutersIpV6AdminTest-431839325-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4e2b8f84c0344b98f35a68d15edbc94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e92938f47856431f8868e57d055c7bb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:09.334938 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce97d0-f35a-4d36-8207-3f231c2aa7d3 tempest-RoutersIpV6AdminTest-431839325 tempest-RoutersIpV6AdminTest-431839325-project-admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:09.335218 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce97d0-f35a-4d36-8207-3f231c2aa7d3 tempest-RoutersIpV6AdminTest-431839325 tempest-RoutersIpV6AdminTest-431839325-project-admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:09.335487 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce97d0-f35a-4d36-8207-3f231c2aa7d3 tempest-RoutersIpV6AdminTest-431839325 tempest-RoutersIpV6AdminTest-431839325-project-admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:09.336211 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cce97d0-f35a-4d36-8207-3f231c2aa7d3 tempest-RoutersIpV6AdminTest-431839325 tempest-RoutersIpV6AdminTest-431839325-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:01:09.336554 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cce97d0-f35a-4d36-8207-3f231c2aa7d3 tempest-RoutersIpV6AdminTest-431839325 tempest-RoutersIpV6AdminTest-431839325-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:09.338247 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cce97d0-f35a-4d36-8207-3f231c2aa7d3 tempest-RoutersIpV6AdminTest-431839325 tempest-RoutersIpV6AdminTest-431839325-project-admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:09.390107 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6730881e-b7b9-4a96-8587-2ce934baf01a service neutron] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:09.392536 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1065/2119] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 01:01:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:01:09.405010 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6730881e-b7b9-4a96-8587-2ce934baf01a service neutron] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:09.420494 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359d6893-6738-4af7-95a5-7fe40c57a4ac tempest-RoutersIpV6AdminTest-431839325 tempest-RoutersIpV6AdminTest-431839325-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4e2b8f84c0344b98f35a68d15edbc94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e92938f47856431f8868e57d055c7bb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:09.421285 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d6893-6738-4af7-95a5-7fe40c57a4ac tempest-RoutersIpV6AdminTest-431839325 tempest-RoutersIpV6AdminTest-431839325-project-admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:09.421391 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d6893-6738-4af7-95a5-7fe40c57a4ac tempest-RoutersIpV6AdminTest-431839325 tempest-RoutersIpV6AdminTest-431839325-project-admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:09.421648 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d6893-6738-4af7-95a5-7fe40c57a4ac tempest-RoutersIpV6AdminTest-431839325 tempest-RoutersIpV6AdminTest-431839325-project-admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:09.422341 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359d6893-6738-4af7-95a5-7fe40c57a4ac tempest-RoutersIpV6AdminTest-431839325 tempest-RoutersIpV6AdminTest-431839325-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:09.428448 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359d6893-6738-4af7-95a5-7fe40c57a4ac tempest-RoutersIpV6AdminTest-431839325 tempest-RoutersIpV6AdminTest-431839325-project-admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:09.485432 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1055/2120] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 01:01:09 2022] POST /identity/v3/projects => generated 348 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:01:09.487314 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce97d0-f35a-4d36-8207-3f231c2aa7d3 tempest-RoutersIpV6AdminTest-431839325 tempest-RoutersIpV6AdminTest-431839325-project-admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:09.524892 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce97d0-f35a-4d36-8207-3f231c2aa7d3 tempest-RoutersIpV6AdminTest-431839325 tempest-RoutersIpV6AdminTest-431839325-project-admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:09.654045 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff1c253-0595-439f-94eb-5aee90b2b9e1 tempest-RoutersIpV6AdminTest-431839325 tempest-RoutersIpV6AdminTest-431839325-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4e2b8f84c0344b98f35a68d15edbc94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e92938f47856431f8868e57d055c7bb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:09.654667 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff1c253-0595-439f-94eb-5aee90b2b9e1 tempest-RoutersIpV6AdminTest-431839325 tempest-RoutersIpV6AdminTest-431839325-project-admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:09.654944 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff1c253-0595-439f-94eb-5aee90b2b9e1 tempest-RoutersIpV6AdminTest-431839325 tempest-RoutersIpV6AdminTest-431839325-project-admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:09.655217 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff1c253-0595-439f-94eb-5aee90b2b9e1 tempest-RoutersIpV6AdminTest-431839325 tempest-RoutersIpV6AdminTest-431839325-project-admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:09.656660 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff1c253-0595-439f-94eb-5aee90b2b9e1 tempest-RoutersIpV6AdminTest-431839325 tempest-RoutersIpV6AdminTest-431839325-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:01:09.656660 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff1c253-0595-439f-94eb-5aee90b2b9e1 tempest-RoutersIpV6AdminTest-431839325 tempest-RoutersIpV6AdminTest-431839325-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:09.657958 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff1c253-0595-439f-94eb-5aee90b2b9e1 tempest-RoutersIpV6AdminTest-431839325 tempest-RoutersIpV6AdminTest-431839325-project-admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:09.675708 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1066/2121] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 01:01:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:01:10.832708 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359d6893-6738-4af7-95a5-7fe40c57a4ac tempest-RoutersIpV6AdminTest-431839325 tempest-RoutersIpV6AdminTest-431839325-project-admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:10.834584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-359d6893-6738-4af7-95a5-7fe40c57a4ac tempest-RoutersIpV6AdminTest-431839325 tempest-RoutersIpV6AdminTest-431839325-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:10.978030 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:10.997744 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff1c253-0595-439f-94eb-5aee90b2b9e1 tempest-RoutersIpV6AdminTest-431839325 tempest-RoutersIpV6AdminTest-431839325-project-admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:11.001637 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359d6893-6738-4af7-95a5-7fe40c57a4ac tempest-RoutersIpV6AdminTest-431839325 tempest-RoutersIpV6AdminTest-431839325-project-admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:11.009952 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2caef0-04f7-48c7-b542-3881e459288d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:11.010913 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2caef0-04f7-48c7-b542-3881e459288d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:11.011434 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2caef0-04f7-48c7-b542-3881e459288d admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:11.011976 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff1c253-0595-439f-94eb-5aee90b2b9e1 tempest-RoutersIpV6AdminTest-431839325 tempest-RoutersIpV6AdminTest-431839325-project-admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:11.012271 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2caef0-04f7-48c7-b542-3881e459288d admin admin] PATH_INFO: `/v3/projects/464befa0feb04db1ae218688835640ce` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:11.014136 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2caef0-04f7-48c7-b542-3881e459288d admin admin] RBAC: Authorizing `identity:delete_project(project_id=464befa0feb04db1ae218688835640ce)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:11.017153 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2caef0-04f7-48c7-b542-3881e459288d admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:11.020755 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe4441-ffef-46ca-8a65-83f082deb73e tempest-RoutersIpV6AdminTest-431839325 tempest-RoutersIpV6AdminTest-431839325-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4e2b8f84c0344b98f35a68d15edbc94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e92938f47856431f8868e57d055c7bb1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:11.023584 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe4441-ffef-46ca-8a65-83f082deb73e tempest-RoutersIpV6AdminTest-431839325 tempest-RoutersIpV6AdminTest-431839325-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:11.024245 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe4441-ffef-46ca-8a65-83f082deb73e tempest-RoutersIpV6AdminTest-431839325 tempest-RoutersIpV6AdminTest-431839325-project-admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:11.024627 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe4441-ffef-46ca-8a65-83f082deb73e tempest-RoutersIpV6AdminTest-431839325 tempest-RoutersIpV6AdminTest-431839325-project-admin] PATH_INFO: `/v3/projects/4e83bd88db0c45b79a457c3c78718741` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:11.026455 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fe4441-ffef-46ca-8a65-83f082deb73e tempest-RoutersIpV6AdminTest-431839325 tempest-RoutersIpV6AdminTest-431839325-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4e83bd88db0c45b79a457c3c78718741)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:11.030905 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fe4441-ffef-46ca-8a65-83f082deb73e tempest-RoutersIpV6AdminTest-431839325 tempest-RoutersIpV6AdminTest-431839325-project-admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:11.177686 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-63fe4441-ffef-46ca-8a65-83f082deb73e tempest-RoutersIpV6AdminTest-431839325 tempest-RoutersIpV6AdminTest-431839325-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e83bd88db0c45b79a457c3c78718741', 'request_id': 'req-63fe4441-ffef-46ca-8a65-83f082deb73e'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:11.184885 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-ab2caef0-04f7-48c7-b542-3881e459288d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '464befa0feb04db1ae218688835640ce', 'request_id': 'req-ab2caef0-04f7-48c7-b542-3881e459288d'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:11.189790 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-63fe4441-ffef-46ca-8a65-83f082deb73e tempest-RoutersIpV6AdminTest-431839325 tempest-RoutersIpV6AdminTest-431839325-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e83bd88db0c45b79a457c3c78718741', 'request_id': 'req-63fe4441-ffef-46ca-8a65-83f082deb73e'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:11.203210 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-ab2caef0-04f7-48c7-b542-3881e459288d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '464befa0feb04db1ae218688835640ce', 'request_id': 'req-ab2caef0-04f7-48c7-b542-3881e459288d'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:11.212151 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-63fe4441-ffef-46ca-8a65-83f082deb73e tempest-RoutersIpV6AdminTest-431839325 tempest-RoutersIpV6AdminTest-431839325-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e83bd88db0c45b79a457c3c78718741', 'request_id': 'req-63fe4441-ffef-46ca-8a65-83f082deb73e'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:11.218283 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-ab2caef0-04f7-48c7-b542-3881e459288d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '464befa0feb04db1ae218688835640ce', 'request_id': 'req-ab2caef0-04f7-48c7-b542-3881e459288d'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:11.238269 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:11.247828 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-ab2caef0-04f7-48c7-b542-3881e459288d admin admin] The token cache is being invalidate because project 464befa0feb04db1ae218688835640ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81808) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:01:11.248131 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-ab2caef0-04f7-48c7-b542-3881e459288d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:11.250587 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-ab2caef0-04f7-48c7-b542-3881e459288d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:11.252389 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-63fe4441-ffef-46ca-8a65-83f082deb73e tempest-RoutersIpV6AdminTest-431839325 tempest-RoutersIpV6AdminTest-431839325-project-admin] The token cache is being invalidate because project 4e83bd88db0c45b79a457c3c78718741 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81807) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:01:11.253399 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-63fe4441-ffef-46ca-8a65-83f082deb73e tempest-RoutersIpV6AdminTest-431839325 tempest-RoutersIpV6AdminTest-431839325-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:11.254752 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-63fe4441-ffef-46ca-8a65-83f082deb73e tempest-RoutersIpV6AdminTest-431839325 tempest-RoutersIpV6AdminTest-431839325-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:11.256013 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1056/2122] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 01:01:10 2022] DELETE /identity/v3/projects/464befa0feb04db1ae218688835640ce => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:11.257186 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1067/2123] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 01:01:10 2022] DELETE /identity/v3/projects/4e83bd88db0c45b79a457c3c78718741 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:11.263704 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e189a-31d0-4110-8ad5-3d741f92426f None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:11.264031 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e189a-31d0-4110-8ad5-3d741f92426f None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:11.264264 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e189a-31d0-4110-8ad5-3d741f92426f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:11.293859 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-3f7e189a-31d0-4110-8ad5-3d741f92426f None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:11.296704 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-3f7e189a-31d0-4110-8ad5-3d741f92426f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:11.328791 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe4441-ffef-46ca-8a65-83f082deb73e tempest-RoutersIpV6AdminTest-431839325 tempest-RoutersIpV6AdminTest-431839325-project-admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:11.329441 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-63fe4441-ffef-46ca-8a65-83f082deb73e tempest-RoutersIpV6AdminTest-431839325 tempest-RoutersIpV6AdminTest-431839325-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:11.461710 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1057/2124] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:01:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:11.470672 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32ee20-3dd4-47d6-b129-563d1ca37635 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:11.470672 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32ee20-3dd4-47d6-b129-563d1ca37635 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:11.470672 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db32ee20-3dd4-47d6-b129-563d1ca37635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:11.518477 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe4441-ffef-46ca-8a65-83f082deb73e tempest-RoutersIpV6AdminTest-431839325 tempest-RoutersIpV6AdminTest-431839325-project-admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:11.531379 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-db32ee20-3dd4-47d6-b129-563d1ca37635 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:11.532269 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a8b9da-a3ab-4fca-be17-3dac466bf325 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:11.533098 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-db32ee20-3dd4-47d6-b129-563d1ca37635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:11.533937 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8b9da-a3ab-4fca-be17-3dac466bf325 service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:11.540382 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8b9da-a3ab-4fca-be17-3dac466bf325 service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:11.540925 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8b9da-a3ab-4fca-be17-3dac466bf325 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:11.545132 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1058/2125] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:01:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:11.556828 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db32ee20-3dd4-47d6-b129-563d1ca37635 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:11.568254 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-92a8b9da-a3ab-4fca-be17-3dac466bf325 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:11.601520 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db32ee20-3dd4-47d6-b129-563d1ca37635 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:11.617959 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db714cb-95d4-4e8e-9561-51f5afa54f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:11.620448 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db714cb-95d4-4e8e-9561-51f5afa54f04 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:11.623600 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db714cb-95d4-4e8e-9561-51f5afa54f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:11.625251 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db714cb-95d4-4e8e-9561-51f5afa54f04 admin admin] PATH_INFO: `/v3/domains` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:11.627978 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db714cb-95d4-4e8e-9561-51f5afa54f04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:01:11.628473 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db714cb-95d4-4e8e-9561-51f5afa54f04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:11.630702 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db714cb-95d4-4e8e-9561-51f5afa54f04 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:11.665017 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1059/2126] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 01:01:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:01:11.669226 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db714cb-95d4-4e8e-9561-51f5afa54f04 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:11.698507 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db714cb-95d4-4e8e-9561-51f5afa54f04 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:11.710493 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71bb284-0272-43df-91fc-08bdc9b9e719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:11.711476 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71bb284-0272-43df-91fc-08bdc9b9e719 admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:11.712730 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71bb284-0272-43df-91fc-08bdc9b9e719 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:11.713293 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71bb284-0272-43df-91fc-08bdc9b9e719 admin admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:11.716045 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71bb284-0272-43df-91fc-08bdc9b9e719 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:11.720871 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71bb284-0272-43df-91fc-08bdc9b9e719 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:11.754095 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a8b9da-a3ab-4fca-be17-3dac466bf325 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:11.755529 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a8b9da-a3ab-4fca-be17-3dac466bf325 service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:11.788960 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1068/2127] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:01:11 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:01:11.789064 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1060/2128] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 01:01:11 2022] POST /identity/v3/projects => generated 365 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:01:11.796112 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a8b9da-a3ab-4fca-be17-3dac466bf325 service neutron] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:11.820509 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a8b9da-a3ab-4fca-be17-3dac466bf325 service neutron] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:11.971951 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8044ba83-8994-43d3-8132-2627d2429ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:11.973177 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8044ba83-8994-43d3-8132-2627d2429ec7 admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:11.973520 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8044ba83-8994-43d3-8132-2627d2429ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:11.973802 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8044ba83-8994-43d3-8132-2627d2429ec7 admin admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:11.974485 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8044ba83-8994-43d3-8132-2627d2429ec7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:11.978728 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8044ba83-8994-43d3-8132-2627d2429ec7 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:12.016825 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1069/2129] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 01:01:11 2022] POST /identity/v3/users => generated 283 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:01:12.017463 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71bb284-0272-43df-91fc-08bdc9b9e719 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:12.032709 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71bb284-0272-43df-91fc-08bdc9b9e719 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:12.047170 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46162938-9d5c-4b67-a940-745ade8428fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:12.047871 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46162938-9d5c-4b67-a940-745ade8428fd admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:12.048423 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46162938-9d5c-4b67-a940-745ade8428fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:12.048705 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46162938-9d5c-4b67-a940-745ade8428fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:12.049575 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46162938-9d5c-4b67-a940-745ade8428fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:12.052407 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46162938-9d5c-4b67-a940-745ade8428fd admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:12.092554 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8044ba83-8994-43d3-8132-2627d2429ec7 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:12.113779 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1061/2130] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:01:12 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:01:12.135321 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8044ba83-8994-43d3-8132-2627d2429ec7 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:12.152706 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6ef34c-0031-4b32-8872-ed1f4b426df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:12.154034 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6ef34c-0031-4b32-8872-ed1f4b426df1 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:12.154592 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6ef34c-0031-4b32-8872-ed1f4b426df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:12.156169 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6ef34c-0031-4b32-8872-ed1f4b426df1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:12.157885 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6ef34c-0031-4b32-8872-ed1f4b426df1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:12.161141 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6ef34c-0031-4b32-8872-ed1f4b426df1 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:12.209890 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1070/2131] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:01:12 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:01:12.217843 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46162938-9d5c-4b67-a940-745ade8428fd admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:12.243782 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46162938-9d5c-4b67-a940-745ade8428fd admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:12.266508 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ebabcb-11ea-4f64-a5a5-25c6dc3a7f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:12.268141 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ebabcb-11ea-4f64-a5a5-25c6dc3a7f3f admin admin] REQUEST_METHOD: `PUT` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:12.268469 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ebabcb-11ea-4f64-a5a5-25c6dc3a7f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:12.268837 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ebabcb-11ea-4f64-a5a5-25c6dc3a7f3f admin admin] PATH_INFO: `/v3/projects/bda29dd33df447d3a9bdc53de16db54d/users/37479b87fd534345b891edd7c358e64a/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:12.312872 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ebabcb-11ea-4f64-a5a5-25c6dc3a7f3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bda29dd33df447d3a9bdc53de16db54d, user_id=37479b87fd534345b891edd7c358e64a, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:12.318482 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ebabcb-11ea-4f64-a5a5-25c6dc3a7f3f admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:12.368167 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5ea5b-96df-40c2-adc0-4dbd9d845ff0 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:12.368660 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5ea5b-96df-40c2-adc0-4dbd9d845ff0 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:12.368741 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5ea5b-96df-40c2-adc0-4dbd9d845ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:12.369732 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1062/2132] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 01:01:12 2022] PUT /identity/v3/projects/bda29dd33df447d3a9bdc53de16db54d/users/37479b87fd534345b891edd7c358e64a/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:12.409532 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-b1f5ea5b-96df-40c2-adc0-4dbd9d845ff0 None None] MFA Rules not processed for user `37479b87fd534345b891edd7c358e64a`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:12.411249 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-b1f5ea5b-96df-40c2-adc0-4dbd9d845ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:12.456129 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:12.547721 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1071/2133] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:01:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:12.585433 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ebabcb-11ea-4f64-a5a5-25c6dc3a7f3f admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:12.587294 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-14ebabcb-11ea-4f64-a5a5-25c6dc3a7f3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:12.594523 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:12.689834 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ebabcb-11ea-4f64-a5a5-25c6dc3a7f3f admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:12.696333 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bb8fb6-5c8d-4c2d-a615-f6fec01eebb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:12.697154 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bb8fb6-5c8d-4c2d-a615-f6fec01eebb8 service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:12.697437 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bb8fb6-5c8d-4c2d-a615-f6fec01eebb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:12.697709 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bb8fb6-5c8d-4c2d-a615-f6fec01eebb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:12.720039 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bb8fb6-5c8d-4c2d-a615-f6fec01eebb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:12.721736 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bb8fb6-5c8d-4c2d-a615-f6fec01eebb8 service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:12.745464 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1063/2134] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:01:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:01:13.920887 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f5ea5b-96df-40c2-adc0-4dbd9d845ff0 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:13.923446 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-b1f5ea5b-96df-40c2-adc0-4dbd9d845ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:14.067529 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f5ea5b-96df-40c2-adc0-4dbd9d845ff0 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:14.074130 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f9eca-6fb5-46fd-8404-0fae081b5a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:14.074981 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f9eca-6fb5-46fd-8404-0fae081b5a99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:14.075769 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f9eca-6fb5-46fd-8404-0fae081b5a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:14.076214 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f9eca-6fb5-46fd-8404-0fae081b5a99 admin admin] PATH_INFO: `/v3/users/efce0ee2de244a638613b65a1557865f` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:14.078940 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5f9eca-6fb5-46fd-8404-0fae081b5a99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efce0ee2de244a638613b65a1557865f)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:14.081303 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5f9eca-6fb5-46fd-8404-0fae081b5a99 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:14.172797 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-ea5f9eca-6fb5-46fd-8404-0fae081b5a99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efce0ee2de244a638613b65a1557865f'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:14.189055 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-ea5f9eca-6fb5-46fd-8404-0fae081b5a99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efce0ee2de244a638613b65a1557865f'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:14.203649 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-ea5f9eca-6fb5-46fd-8404-0fae081b5a99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efce0ee2de244a638613b65a1557865f'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:14.203649 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-ea5f9eca-6fb5-46fd-8404-0fae081b5a99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efce0ee2de244a638613b65a1557865f'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:14.204347 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-ea5f9eca-6fb5-46fd-8404-0fae081b5a99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efce0ee2de244a638613b65a1557865f'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:14.226389 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1072/2135] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 01:01:13 2022] DELETE /identity/v3/users/efce0ee2de244a638613b65a1557865f => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:01:14.231386 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee5cb7-1aaf-4062-ad0f-edc208e62a61 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:14.232886 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee5cb7-1aaf-4062-ad0f-edc208e62a61 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:14.233610 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee5cb7-1aaf-4062-ad0f-edc208e62a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:14.267470 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-4aee5cb7-1aaf-4062-ad0f-edc208e62a61 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:14.269895 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-4aee5cb7-1aaf-4062-ad0f-edc208e62a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:14.415877 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1064/2136] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:01:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:14.481632 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f9eca-6fb5-46fd-8404-0fae081b5a99 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:14.482642 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-ea5f9eca-6fb5-46fd-8404-0fae081b5a99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:14.615242 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:14.634668 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f9eca-6fb5-46fd-8404-0fae081b5a99 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:14.646248 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0991fe9-595b-4825-8b7e-b1f777b83b52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:14.647103 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0991fe9-595b-4825-8b7e-b1f777b83b52 service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:14.647510 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0991fe9-595b-4825-8b7e-b1f777b83b52 service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:14.647952 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0991fe9-595b-4825-8b7e-b1f777b83b52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:14.669285 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0991fe9-595b-4825-8b7e-b1f777b83b52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:14.671656 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0991fe9-595b-4825-8b7e-b1f777b83b52 service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:14.694015 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1073/2137] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:01:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:01:15.749622 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee5cb7-1aaf-4062-ad0f-edc208e62a61 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:15.751990 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-4aee5cb7-1aaf-4062-ad0f-edc208e62a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:15.771174 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee5cb7-1aaf-4062-ad0f-edc208e62a61 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:15.778841 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106b8eb9-c3b8-4df0-9121-99a82e551f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:15.780053 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b8eb9-c3b8-4df0-9121-99a82e551f2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:15.780583 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b8eb9-c3b8-4df0-9121-99a82e551f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:15.781199 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b8eb9-c3b8-4df0-9121-99a82e551f2b admin admin] PATH_INFO: `/v3/projects/7cd5444891ce4adfa67e5a795c8fbf62` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:15.782830 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106b8eb9-c3b8-4df0-9121-99a82e551f2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cd5444891ce4adfa67e5a795c8fbf62)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:15.785805 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106b8eb9-c3b8-4df0-9121-99a82e551f2b admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:15.869778 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-106b8eb9-c3b8-4df0-9121-99a82e551f2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cd5444891ce4adfa67e5a795c8fbf62', 'request_id': 'req-106b8eb9-c3b8-4df0-9121-99a82e551f2b'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:15.879031 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-106b8eb9-c3b8-4df0-9121-99a82e551f2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cd5444891ce4adfa67e5a795c8fbf62', 'request_id': 'req-106b8eb9-c3b8-4df0-9121-99a82e551f2b'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:15.907300 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-106b8eb9-c3b8-4df0-9121-99a82e551f2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cd5444891ce4adfa67e5a795c8fbf62', 'request_id': 'req-106b8eb9-c3b8-4df0-9121-99a82e551f2b'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:15.934897 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-106b8eb9-c3b8-4df0-9121-99a82e551f2b admin admin] The token cache is being invalidate because project 7cd5444891ce4adfa67e5a795c8fbf62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81808) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:01:15.935636 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-106b8eb9-c3b8-4df0-9121-99a82e551f2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:15.938329 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-106b8eb9-c3b8-4df0-9121-99a82e551f2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:15.940565 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1065/2138] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 01:01:15 2022] DELETE /identity/v3/projects/7cd5444891ce4adfa67e5a795c8fbf62 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:15.945328 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f4397-1afe-471b-ba61-59ed8787f96a None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:15.945809 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f4397-1afe-471b-ba61-59ed8787f96a None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:15.945900 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f4397-1afe-471b-ba61-59ed8787f96a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:15.992788 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-9c1f4397-1afe-471b-ba61-59ed8787f96a None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:15.994824 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-9c1f4397-1afe-471b-ba61-59ed8787f96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:16.143401 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1074/2139] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:01:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:16.145497 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7f47c-37a4-4f08-bb9c-3cecb3b8aa60 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:16.146071 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7f47c-37a4-4f08-bb9c-3cecb3b8aa60 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:16.146369 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7f47c-37a4-4f08-bb9c-3cecb3b8aa60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:16.170291 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-4ab7f47c-37a4-4f08-bb9c-3cecb3b8aa60 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:16.172139 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-4ab7f47c-37a4-4f08-bb9c-3cecb3b8aa60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:16.183208 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1066/2140] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:01:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:16.189354 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1f4397-1afe-471b-ba61-59ed8787f96a None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:16.203371 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1f4397-1afe-471b-ba61-59ed8787f96a None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:16.208930 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed61ea4-24f6-4056-866e-008961bff50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:16.209564 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed61ea4-24f6-4056-866e-008961bff50a admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:16.209844 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed61ea4-24f6-4056-866e-008961bff50a admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:16.210145 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed61ea4-24f6-4056-866e-008961bff50a admin admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:16.210869 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed61ea4-24f6-4056-866e-008961bff50a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:01:16.212367 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed61ea4-24f6-4056-866e-008961bff50a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:16.214044 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed61ea4-24f6-4056-866e-008961bff50a admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:16.255361 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1075/2141] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 01:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:01:16.256409 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab7f47c-37a4-4f08-bb9c-3cecb3b8aa60 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:16.266444 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab7f47c-37a4-4f08-bb9c-3cecb3b8aa60 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:16.271917 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b493d4-b284-49a7-9181-5366bed7c44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:16.272545 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b493d4-b284-49a7-9181-5366bed7c44d admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:16.272867 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b493d4-b284-49a7-9181-5366bed7c44d admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:16.273130 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b493d4-b284-49a7-9181-5366bed7c44d admin admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:16.274358 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b493d4-b284-49a7-9181-5366bed7c44d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:16.277359 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b493d4-b284-49a7-9181-5366bed7c44d admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:16.312476 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed61ea4-24f6-4056-866e-008961bff50a admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:16.317806 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-3ed61ea4-24f6-4056-866e-008961bff50a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:16.344807 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1067/2142] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 01:01:16 2022] POST /identity/v3/projects => generated 381 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:01:16.350055 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed61ea4-24f6-4056-866e-008961bff50a admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:16.351497 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b493d4-b284-49a7-9181-5366bed7c44d admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:16.361977 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:16.470767 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0212c8-39a2-4771-bb71-dfff2c7ce398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:16.471548 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0212c8-39a2-4771-bb71-dfff2c7ce398 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:16.471924 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0212c8-39a2-4771-bb71-dfff2c7ce398 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:16.472265 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0212c8-39a2-4771-bb71-dfff2c7ce398 admin admin] PATH_INFO: `/v3/users/44b042cf34a7426cbcce8fa13c0c946e` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:16.473608 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0212c8-39a2-4771-bb71-dfff2c7ce398 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44b042cf34a7426cbcce8fa13c0c946e)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:16.474181 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b493d4-b284-49a7-9181-5366bed7c44d admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:16.475851 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0212c8-39a2-4771-bb71-dfff2c7ce398 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:16.479980 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4904b28c-daa4-4a61-9384-96a801f1d70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:16.480687 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4904b28c-daa4-4a61-9384-96a801f1d70e admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:16.480968 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4904b28c-daa4-4a61-9384-96a801f1d70e admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:16.481237 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4904b28c-daa4-4a61-9384-96a801f1d70e admin admin] PATH_INFO: `/v3/users` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:16.482256 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4904b28c-daa4-4a61-9384-96a801f1d70e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:16.485068 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4904b28c-daa4-4a61-9384-96a801f1d70e admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:16.524956 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1068/2143] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 01:01:16 2022] POST /identity/v3/users => generated 291 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:01:16.528020 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4904b28c-daa4-4a61-9384-96a801f1d70e admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:16.546603 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4904b28c-daa4-4a61-9384-96a801f1d70e admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:16.553471 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-fa0212c8-39a2-4771-bb71-dfff2c7ce398 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44b042cf34a7426cbcce8fa13c0c946e'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:16.563574 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e724f0d-0541-4664-ac9e-e1be7276d8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:16.564310 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e724f0d-0541-4664-ac9e-e1be7276d8ed admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:16.564590 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e724f0d-0541-4664-ac9e-e1be7276d8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:16.564906 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e724f0d-0541-4664-ac9e-e1be7276d8ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:16.566387 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e724f0d-0541-4664-ac9e-e1be7276d8ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:16.569257 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e724f0d-0541-4664-ac9e-e1be7276d8ed admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:16.571463 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-fa0212c8-39a2-4771-bb71-dfff2c7ce398 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44b042cf34a7426cbcce8fa13c0c946e'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:16.592983 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-fa0212c8-39a2-4771-bb71-dfff2c7ce398 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44b042cf34a7426cbcce8fa13c0c946e'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:16.596214 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-fa0212c8-39a2-4771-bb71-dfff2c7ce398 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44b042cf34a7426cbcce8fa13c0c946e'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:16.596934 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-fa0212c8-39a2-4771-bb71-dfff2c7ce398 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44b042cf34a7426cbcce8fa13c0c946e'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:16.600733 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:16.602563 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1069/2144] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:01:16.606576 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e724f0d-0541-4664-ac9e-e1be7276d8ed admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:16.609477 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-0e724f0d-0541-4664-ac9e-e1be7276d8ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:16.624923 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1076/2145] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 01:01:16 2022] DELETE /identity/v3/users/44b042cf34a7426cbcce8fa13c0c946e => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:01:16.636051 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11688a7d-8411-4e7f-a80c-016e9ff8c86f None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:16.636534 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11688a7d-8411-4e7f-a80c-016e9ff8c86f None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:16.637191 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11688a7d-8411-4e7f-a80c-016e9ff8c86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:16.657322 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e724f0d-0541-4664-ac9e-e1be7276d8ed admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:16.680222 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-11688a7d-8411-4e7f-a80c-016e9ff8c86f None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:16.682352 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-11688a7d-8411-4e7f-a80c-016e9ff8c86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:16.797751 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f823f2bc-ea20-41d8-834d-5a30cde74e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:16.800497 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823f2bc-ea20-41d8-834d-5a30cde74e43 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:16.801467 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823f2bc-ea20-41d8-834d-5a30cde74e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:16.801980 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823f2bc-ea20-41d8-834d-5a30cde74e43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:16.803369 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f823f2bc-ea20-41d8-834d-5a30cde74e43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:16.809349 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f823f2bc-ea20-41d8-834d-5a30cde74e43 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:16.812061 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1077/2146] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:01:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:16.827196 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1070/2147] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:01:16 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:01:16.828424 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11688a7d-8411-4e7f-a80c-016e9ff8c86f None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:16.840960 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f823f2bc-ea20-41d8-834d-5a30cde74e43 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:16.841965 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11688a7d-8411-4e7f-a80c-016e9ff8c86f None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:16.844553 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-f823f2bc-ea20-41d8-834d-5a30cde74e43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:16.851819 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009057f3-893a-4cec-be2f-37ed60fe54ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:16.852493 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009057f3-893a-4cec-be2f-37ed60fe54ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:16.853499 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009057f3-893a-4cec-be2f-37ed60fe54ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:16.853788 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009057f3-893a-4cec-be2f-37ed60fe54ad admin admin] PATH_INFO: `/v3/projects/e1f8db695c344fee8b6f115622e3f367/users/5e8cdcbf178e443599cddd3d1a2972f0/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:16.894044 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009057f3-893a-4cec-be2f-37ed60fe54ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1f8db695c344fee8b6f115622e3f367, user_id=5e8cdcbf178e443599cddd3d1a2972f0, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:16.899852 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009057f3-893a-4cec-be2f-37ed60fe54ad admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:16.931081 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1078/2148] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 01:01:16 2022] PUT /identity/v3/projects/e1f8db695c344fee8b6f115622e3f367/users/5e8cdcbf178e443599cddd3d1a2972f0/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:01:16.934505 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23afd46a-2338-44ff-a5c0-328e648e4a43 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:16.935967 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23afd46a-2338-44ff-a5c0-328e648e4a43 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:16.936825 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23afd46a-2338-44ff-a5c0-328e648e4a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:17.002855 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-23afd46a-2338-44ff-a5c0-328e648e4a43 None None] MFA Rules not processed for user `5e8cdcbf178e443599cddd3d1a2972f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:17.003584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f823f2bc-ea20-41d8-834d-5a30cde74e43 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:17.004103 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-23afd46a-2338-44ff-a5c0-328e648e4a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:17.066526 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:17.100072 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aeb67b-c9d8-45ca-b381-401092260917 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:17.100852 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aeb67b-c9d8-45ca-b381-401092260917 service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:17.101059 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aeb67b-c9d8-45ca-b381-401092260917 service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:17.101299 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aeb67b-c9d8-45ca-b381-401092260917 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:17.102302 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1079/2149] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:01:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:01:17.160381 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23afd46a-2338-44ff-a5c0-328e648e4a43 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:17.178632 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23afd46a-2338-44ff-a5c0-328e648e4a43 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:17.193404 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82c7af-e322-4d31-a7b5-b09bbbd2b614 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:17.194019 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82c7af-e322-4d31-a7b5-b09bbbd2b614 service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:17.194301 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82c7af-e322-4d31-a7b5-b09bbbd2b614 service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:17.197344 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82c7af-e322-4d31-a7b5-b09bbbd2b614 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:17.233353 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba82c7af-e322-4d31-a7b5-b09bbbd2b614 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:17.234986 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba82c7af-e322-4d31-a7b5-b09bbbd2b614 service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:17.252106 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1080/2150] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:01:17 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:01:17.296425 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aeb67b-c9d8-45ca-b381-401092260917 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:17.297905 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aeb67b-c9d8-45ca-b381-401092260917 service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:17.309746 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1071/2151] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:01:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:01:18.456828 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82c7af-e322-4d31-a7b5-b09bbbd2b614 service neutron] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:18.460339 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-ba82c7af-e322-4d31-a7b5-b09bbbd2b614 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:18.484434 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82c7af-e322-4d31-a7b5-b09bbbd2b614 service neutron] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:18.492473 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a793da99-4ceb-4947-83fa-fb4f0a14632e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:18.493569 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793da99-4ceb-4947-83fa-fb4f0a14632e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:18.494753 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793da99-4ceb-4947-83fa-fb4f0a14632e admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:18.496665 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793da99-4ceb-4947-83fa-fb4f0a14632e admin admin] PATH_INFO: `/v3/projects/6c112bfaa4c741c4be2eb46fe624f818` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:18.498245 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a793da99-4ceb-4947-83fa-fb4f0a14632e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c112bfaa4c741c4be2eb46fe624f818)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:18.500480 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a793da99-4ceb-4947-83fa-fb4f0a14632e admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:18.571924 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:18.610622 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-a793da99-4ceb-4947-83fa-fb4f0a14632e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c112bfaa4c741c4be2eb46fe624f818', 'request_id': 'req-a793da99-4ceb-4947-83fa-fb4f0a14632e'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:18.622284 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-a793da99-4ceb-4947-83fa-fb4f0a14632e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c112bfaa4c741c4be2eb46fe624f818', 'request_id': 'req-a793da99-4ceb-4947-83fa-fb4f0a14632e'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:18.639909 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-a793da99-4ceb-4947-83fa-fb4f0a14632e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c112bfaa4c741c4be2eb46fe624f818', 'request_id': 'req-a793da99-4ceb-4947-83fa-fb4f0a14632e'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:18.665918 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-a793da99-4ceb-4947-83fa-fb4f0a14632e admin admin] The token cache is being invalidate because project 6c112bfaa4c741c4be2eb46fe624f818 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81807) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:01:18.666910 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-a793da99-4ceb-4947-83fa-fb4f0a14632e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:18.667695 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-a793da99-4ceb-4947-83fa-fb4f0a14632e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:18.674215 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1081/2152] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 01:01:18 2022] DELETE /identity/v3/projects/6c112bfaa4c741c4be2eb46fe624f818 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:18.676038 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c066c869-beaa-497c-802d-391bfe675824 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:18.676520 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c066c869-beaa-497c-802d-391bfe675824 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:18.676827 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c066c869-beaa-497c-802d-391bfe675824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:18.710291 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-c066c869-beaa-497c-802d-391bfe675824 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:18.713089 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-c066c869-beaa-497c-802d-391bfe675824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:18.823198 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1072/2153] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:01:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:01:18.835361 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4315bfca-5179-4581-b139-becc0b6008ed None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:18.837117 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4315bfca-5179-4581-b139-becc0b6008ed None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:18.838887 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4315bfca-5179-4581-b139-becc0b6008ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:18.883177 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-4315bfca-5179-4581-b139-becc0b6008ed None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:18.890912 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-4315bfca-5179-4581-b139-becc0b6008ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:18.913853 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1082/2154] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:01:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:18.918721 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c066c869-beaa-497c-802d-391bfe675824 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:18.929975 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c066c869-beaa-497c-802d-391bfe675824 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:18.936182 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cfb134-ef7b-491f-9e4d-ec7e0d01ab08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:18.936835 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cfb134-ef7b-491f-9e4d-ec7e0d01ab08 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:18.937110 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cfb134-ef7b-491f-9e4d-ec7e0d01ab08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:18.937379 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cfb134-ef7b-491f-9e4d-ec7e0d01ab08 admin admin] PATH_INFO: `/v3/domains` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:18.938592 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cfb134-ef7b-491f-9e4d-ec7e0d01ab08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:01:18.938864 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cfb134-ef7b-491f-9e4d-ec7e0d01ab08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:18.945134 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cfb134-ef7b-491f-9e4d-ec7e0d01ab08 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:18.981009 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4315bfca-5179-4581-b139-becc0b6008ed None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:18.995179 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1073/2155] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 01:01:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:01:18.998307 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4315bfca-5179-4581-b139-becc0b6008ed None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:19.006818 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9a9055-0be8-4021-80e5-8bb7c2913e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:19.007839 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a9055-0be8-4021-80e5-8bb7c2913e7c admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:19.008699 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a9055-0be8-4021-80e5-8bb7c2913e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:19.008902 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a9055-0be8-4021-80e5-8bb7c2913e7c admin admin] PATH_INFO: `/v3/projects` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:19.009565 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9a9055-0be8-4021-80e5-8bb7c2913e7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:19.011637 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9a9055-0be8-4021-80e5-8bb7c2913e7c admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:19.062776 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1083/2156] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 01:01:18 2022] POST /identity/v3/projects => generated 377 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:01:19.065344 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cfb134-ef7b-491f-9e4d-ec7e0d01ab08 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:19.101904 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cfb134-ef7b-491f-9e4d-ec7e0d01ab08 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:19.247788 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8614b5-56fe-4079-87e0-8216464e611e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:19.252431 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8614b5-56fe-4079-87e0-8216464e611e admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:19.252782 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8614b5-56fe-4079-87e0-8216464e611e admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:19.252978 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8614b5-56fe-4079-87e0-8216464e611e admin admin] PATH_INFO: `/v3/users` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:19.253852 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8614b5-56fe-4079-87e0-8216464e611e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:19.255939 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8614b5-56fe-4079-87e0-8216464e611e admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:19.277445 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:19.291371 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9a9055-0be8-4021-80e5-8bb7c2913e7c admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:19.291721 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1074/2157] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 01:01:19 2022] POST /identity/v3/users => generated 289 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:01:19.318203 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9a9055-0be8-4021-80e5-8bb7c2913e7c admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:19.323402 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6128c18-a79a-4d4b-8106-9e22105aa768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:19.325618 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6128c18-a79a-4d4b-8106-9e22105aa768 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:19.325928 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6128c18-a79a-4d4b-8106-9e22105aa768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:19.326329 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6128c18-a79a-4d4b-8106-9e22105aa768 admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:19.327274 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6128c18-a79a-4d4b-8106-9e22105aa768 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:19.329098 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6128c18-a79a-4d4b-8106-9e22105aa768 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:19.342113 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1084/2158] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:01:19.346154 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8614b5-56fe-4079-87e0-8216464e611e admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:19.360509 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8614b5-56fe-4079-87e0-8216464e611e admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:19.385396 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cfb2ee-b853-4a7f-bbbf-5ef9c40cecba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:19.386182 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfb2ee-b853-4a7f-bbbf-5ef9c40cecba admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:19.387400 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfb2ee-b853-4a7f-bbbf-5ef9c40cecba admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:19.387400 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cfb2ee-b853-4a7f-bbbf-5ef9c40cecba admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:19.387400 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cfb2ee-b853-4a7f-bbbf-5ef9c40cecba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:19.389018 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cfb2ee-b853-4a7f-bbbf-5ef9c40cecba admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:19.415810 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6128c18-a79a-4d4b-8106-9e22105aa768 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:19.417483 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1075/2159] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:01:19.436367 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6128c18-a79a-4d4b-8106-9e22105aa768 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:19.443396 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b249a98-61bd-4668-96b6-bd7b9cb0f4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:19.445549 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b249a98-61bd-4668-96b6-bd7b9cb0f4e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:19.446266 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b249a98-61bd-4668-96b6-bd7b9cb0f4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:19.446740 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b249a98-61bd-4668-96b6-bd7b9cb0f4e3 admin admin] PATH_INFO: `/v3/projects/7a400cadb01f4dcc9beb71896222a06f/users/843b1e8a93a24c129a1d9bdf47ec979e/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:19.470935 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b249a98-61bd-4668-96b6-bd7b9cb0f4e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a400cadb01f4dcc9beb71896222a06f, user_id=843b1e8a93a24c129a1d9bdf47ec979e, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:19.475658 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b249a98-61bd-4668-96b6-bd7b9cb0f4e3 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:19.513471 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7306f7c0-87d3-4af5-8037-85f20546e163 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:19.513790 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7306f7c0-87d3-4af5-8037-85f20546e163 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:19.514127 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7306f7c0-87d3-4af5-8037-85f20546e163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:19.518202 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1085/2160] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 01:01:19 2022] PUT /identity/v3/projects/7a400cadb01f4dcc9beb71896222a06f/users/843b1e8a93a24c129a1d9bdf47ec979e/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:01:19.594303 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-7306f7c0-87d3-4af5-8037-85f20546e163 None None] MFA Rules not processed for user `843b1e8a93a24c129a1d9bdf47ec979e`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:19.596025 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-7306f7c0-87d3-4af5-8037-85f20546e163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:19.827307 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1076/2161] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:01:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:19.878518 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b249a98-61bd-4668-96b6-bd7b9cb0f4e3 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:19.884486 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-1b249a98-61bd-4668-96b6-bd7b9cb0f4e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:20.004612 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b249a98-61bd-4668-96b6-bd7b9cb0f4e3 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:20.008811 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caaa518-c057-4e46-a327-06a9579b768c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:20.009585 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caaa518-c057-4e46-a327-06a9579b768c service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:20.009984 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caaa518-c057-4e46-a327-06a9579b768c service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:20.010352 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caaa518-c057-4e46-a327-06a9579b768c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:20.020666 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caaa518-c057-4e46-a327-06a9579b768c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:20.022331 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caaa518-c057-4e46-a327-06a9579b768c service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:20.033804 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1086/2162] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:01:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:01:25.472310 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7306f7c0-87d3-4af5-8037-85f20546e163 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:25.475408 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-7306f7c0-87d3-4af5-8037-85f20546e163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:25.712271 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7306f7c0-87d3-4af5-8037-85f20546e163 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:25.732175 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176c9627-f0c2-49f3-a778-c8239cbad189 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4fc1d11f5641b0b5f301b234282aa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:25.733065 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c9627-f0c2-49f3-a778-c8239cbad189 service placement] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:25.733449 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c9627-f0c2-49f3-a778-c8239cbad189 service placement] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:25.737740 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c9627-f0c2-49f3-a778-c8239cbad189 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:25.741252 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-176c9627-f0c2-49f3-a778-c8239cbad189 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:25.767938 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176c9627-f0c2-49f3-a778-c8239cbad189 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:25.771027 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176c9627-f0c2-49f3-a778-c8239cbad189 service placement] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:25.831996 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1077/2163] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:01:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:01:30.028606 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=63,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:35.786938 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=69 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:40.741270 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caaa518-c057-4e46-a327-06a9579b768c service neutron] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:40.743488 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-3caaa518-c057-4e46-a327-06a9579b768c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:40.878783 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caaa518-c057-4e46-a327-06a9579b768c service neutron] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:40.886981 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee52bdb-e534-42bf-9c61-068f62b52046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:40.892775 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee52bdb-e534-42bf-9c61-068f62b52046 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:40.893563 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee52bdb-e534-42bf-9c61-068f62b52046 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:40.894098 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee52bdb-e534-42bf-9c61-068f62b52046 admin admin] PATH_INFO: `/v3/users/252f0ce67ecd4772a24b32c846ff8e17` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:40.896546 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee52bdb-e534-42bf-9c61-068f62b52046 admin admin] RBAC: Authorizing `identity:delete_user(user_id=252f0ce67ecd4772a24b32c846ff8e17)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:40.899548 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee52bdb-e534-42bf-9c61-068f62b52046 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:40.981480 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-3ee52bdb-e534-42bf-9c61-068f62b52046 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '252f0ce67ecd4772a24b32c846ff8e17'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:41.001678 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-3ee52bdb-e534-42bf-9c61-068f62b52046 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '252f0ce67ecd4772a24b32c846ff8e17'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:41.013958 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-3ee52bdb-e534-42bf-9c61-068f62b52046 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '252f0ce67ecd4772a24b32c846ff8e17'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:41.015040 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-3ee52bdb-e534-42bf-9c61-068f62b52046 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '252f0ce67ecd4772a24b32c846ff8e17'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:41.016246 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-3ee52bdb-e534-42bf-9c61-068f62b52046 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '252f0ce67ecd4772a24b32c846ff8e17'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:41.037576 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1087/2164] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 01:01:40 2022] DELETE /identity/v3/users/252f0ce67ecd4772a24b32c846ff8e17 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:42.267753 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176c9627-f0c2-49f3-a778-c8239cbad189 service placement] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:42.296846 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176c9627-f0c2-49f3-a778-c8239cbad189 service placement] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:42.390795 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a2370f-377a-42ef-abf2-4a567e141c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:42.391583 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2370f-377a-42ef-abf2-4a567e141c60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:42.391983 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2370f-377a-42ef-abf2-4a567e141c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:42.392349 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2370f-377a-42ef-abf2-4a567e141c60 admin admin] PATH_INFO: `/v3/projects/3391697c527c498c9897a9770aacbdbd` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:42.393695 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a2370f-377a-42ef-abf2-4a567e141c60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3391697c527c498c9897a9770aacbdbd)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:42.395902 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a2370f-377a-42ef-abf2-4a567e141c60 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:42.453614 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-01a2370f-377a-42ef-abf2-4a567e141c60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3391697c527c498c9897a9770aacbdbd', 'request_id': 'req-01a2370f-377a-42ef-abf2-4a567e141c60'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:42.460765 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-01a2370f-377a-42ef-abf2-4a567e141c60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3391697c527c498c9897a9770aacbdbd', 'request_id': 'req-01a2370f-377a-42ef-abf2-4a567e141c60'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:42.474114 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-01a2370f-377a-42ef-abf2-4a567e141c60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3391697c527c498c9897a9770aacbdbd', 'request_id': 'req-01a2370f-377a-42ef-abf2-4a567e141c60'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:42.487703 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-01a2370f-377a-42ef-abf2-4a567e141c60 admin admin] The token cache is being invalidate because project 3391697c527c498c9897a9770aacbdbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81808) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:01:42.488139 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-01a2370f-377a-42ef-abf2-4a567e141c60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:42.489239 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-01a2370f-377a-42ef-abf2-4a567e141c60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:42.495979 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1078/2165] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 01:01:42 2022] DELETE /identity/v3/projects/3391697c527c498c9897a9770aacbdbd => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:42.496842 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4020de30-a450-4f90-a339-45760989507a None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:42.497302 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4020de30-a450-4f90-a339-45760989507a None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:42.497505 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4020de30-a450-4f90-a339-45760989507a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:42.521937 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-4020de30-a450-4f90-a339-45760989507a None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:42.523238 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-4020de30-a450-4f90-a339-45760989507a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:42.652831 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1088/2166] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:01:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:42.654228 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39b2c8-4043-44b8-824f-cacc0fcc6f06 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:42.654513 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39b2c8-4043-44b8-824f-cacc0fcc6f06 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:42.654787 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39b2c8-4043-44b8-824f-cacc0fcc6f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:42.687469 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-aa39b2c8-4043-44b8-824f-cacc0fcc6f06 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:42.689044 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-aa39b2c8-4043-44b8-824f-cacc0fcc6f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:42.706288 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1079/2167] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:01:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:42.706664 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4020de30-a450-4f90-a339-45760989507a None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:42.732686 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4020de30-a450-4f90-a339-45760989507a None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:42.740468 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1606e68c-ade8-4994-a0fe-49c5ffa36438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:42.741115 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1606e68c-ade8-4994-a0fe-49c5ffa36438 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:42.745965 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1606e68c-ade8-4994-a0fe-49c5ffa36438 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:42.747141 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1606e68c-ade8-4994-a0fe-49c5ffa36438 admin admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:42.748133 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1606e68c-ade8-4994-a0fe-49c5ffa36438 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:01:42.748523 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1606e68c-ade8-4994-a0fe-49c5ffa36438 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:42.750511 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1606e68c-ade8-4994-a0fe-49c5ffa36438 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:42.766808 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1089/2168] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 01:01:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:01:42.768060 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa39b2c8-4043-44b8-824f-cacc0fcc6f06 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:42.782551 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa39b2c8-4043-44b8-824f-cacc0fcc6f06 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:42.788461 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a33f521-46bc-4bac-8df8-5dd7126d026d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:42.789097 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33f521-46bc-4bac-8df8-5dd7126d026d admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:42.789382 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33f521-46bc-4bac-8df8-5dd7126d026d admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:42.789650 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a33f521-46bc-4bac-8df8-5dd7126d026d admin admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:42.790300 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a33f521-46bc-4bac-8df8-5dd7126d026d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:42.793378 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a33f521-46bc-4bac-8df8-5dd7126d026d admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:42.840018 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1080/2169] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 01:01:42 2022] POST /identity/v3/projects => generated 391 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:01:42.841311 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1606e68c-ade8-4994-a0fe-49c5ffa36438 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:42.855979 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1606e68c-ade8-4994-a0fe-49c5ffa36438 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:42.871640 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:42.998050 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184ed4bf-5054-480a-9afa-99c73ff15315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:42.998804 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ed4bf-5054-480a-9afa-99c73ff15315 admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:42.999399 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ed4bf-5054-480a-9afa-99c73ff15315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:42.999796 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ed4bf-5054-480a-9afa-99c73ff15315 admin admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:43.000696 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184ed4bf-5054-480a-9afa-99c73ff15315 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:43.002952 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184ed4bf-5054-480a-9afa-99c73ff15315 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:43.036665 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1090/2170] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 01:01:42 2022] POST /identity/v3/users => generated 296 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:01:43.040682 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a33f521-46bc-4bac-8df8-5dd7126d026d admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:43.060122 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a33f521-46bc-4bac-8df8-5dd7126d026d admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:43.076931 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4041be-6ecd-4503-86ac-0fd419f455d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:43.077744 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4041be-6ecd-4503-86ac-0fd419f455d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:43.078170 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4041be-6ecd-4503-86ac-0fd419f455d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:43.078594 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4041be-6ecd-4503-86ac-0fd419f455d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:43.079396 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4041be-6ecd-4503-86ac-0fd419f455d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:43.085119 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4041be-6ecd-4503-86ac-0fd419f455d6 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:43.115168 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1081/2171] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:01:43.119794 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184ed4bf-5054-480a-9afa-99c73ff15315 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:43.134079 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184ed4bf-5054-480a-9afa-99c73ff15315 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:43.149178 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd250b0f-d25a-4a2d-a995-870a1f4d3518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:43.149865 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd250b0f-d25a-4a2d-a995-870a1f4d3518 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:43.151392 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd250b0f-d25a-4a2d-a995-870a1f4d3518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:43.151392 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd250b0f-d25a-4a2d-a995-870a1f4d3518 admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:43.151981 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd250b0f-d25a-4a2d-a995-870a1f4d3518 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:43.154029 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd250b0f-d25a-4a2d-a995-870a1f4d3518 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:43.183479 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1091/2172] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:01:43.188290 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4041be-6ecd-4503-86ac-0fd419f455d6 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:43.203120 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4041be-6ecd-4503-86ac-0fd419f455d6 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:43.209634 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a4547-5f14-4f3a-9056-de15049922ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:43.210411 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a4547-5f14-4f3a-9056-de15049922ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:43.210759 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a4547-5f14-4f3a-9056-de15049922ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:43.211627 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a4547-5f14-4f3a-9056-de15049922ad admin admin] PATH_INFO: `/v3/projects/fe0a04b2806044f286f6d88242550048/users/16feb182d7e4463da41682f528207cc0/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:43.236483 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18a4547-5f14-4f3a-9056-de15049922ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe0a04b2806044f286f6d88242550048, user_id=16feb182d7e4463da41682f528207cc0, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:43.240896 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18a4547-5f14-4f3a-9056-de15049922ad admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:43.276606 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1082/2173] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 01:01:43 2022] PUT /identity/v3/projects/fe0a04b2806044f286f6d88242550048/users/16feb182d7e4463da41682f528207cc0/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:43.283834 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40061012-5bed-4b5d-aff5-fab985f78f3e None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:43.285097 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40061012-5bed-4b5d-aff5-fab985f78f3e None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:43.285881 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40061012-5bed-4b5d-aff5-fab985f78f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:43.361629 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-40061012-5bed-4b5d-aff5-fab985f78f3e None None] MFA Rules not processed for user `16feb182d7e4463da41682f528207cc0`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:43.363529 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-40061012-5bed-4b5d-aff5-fab985f78f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:43.486697 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1092/2174] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:01:43 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:43.491509 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a4547-5f14-4f3a-9056-de15049922ad admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:43.529435 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:43.575219 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a4547-5f14-4f3a-9056-de15049922ad admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:43.597324 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac2aea-5622-4a2c-a412-1cb8a9c60c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:43.600852 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac2aea-5622-4a2c-a412-1cb8a9c60c39 admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:43.602487 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac2aea-5622-4a2c-a412-1cb8a9c60c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:43.603725 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac2aea-5622-4a2c-a412-1cb8a9c60c39 admin admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:43.606236 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac2aea-5622-4a2c-a412-1cb8a9c60c39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:43.611579 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac2aea-5622-4a2c-a412-1cb8a9c60c39 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:43.701501 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1083/2175] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 01:01:43 2022] POST /identity/v3/projects => generated 391 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:01:43.704379 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40061012-5bed-4b5d-aff5-fab985f78f3e None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:43.740583 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40061012-5bed-4b5d-aff5-fab985f78f3e None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:43.858586 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7b452-f17a-4761-bbec-db37e24c4db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:43.859820 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7b452-f17a-4761-bbec-db37e24c4db1 admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:43.860253 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7b452-f17a-4761-bbec-db37e24c4db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:43.860690 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7b452-f17a-4761-bbec-db37e24c4db1 admin admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:43.861729 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e7b452-f17a-4761-bbec-db37e24c4db1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:43.866482 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e7b452-f17a-4761-bbec-db37e24c4db1 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:43.910704 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac2aea-5622-4a2c-a412-1cb8a9c60c39 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:43.952964 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1093/2176] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 01:01:43 2022] POST /identity/v3/users => generated 302 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:01:43.958800 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac2aea-5622-4a2c-a412-1cb8a9c60c39 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:43.967988 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e4c262-4585-4812-84ea-1d352adeb092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:43.968710 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e4c262-4585-4812-84ea-1d352adeb092 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:43.968993 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e4c262-4585-4812-84ea-1d352adeb092 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:43.969569 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e4c262-4585-4812-84ea-1d352adeb092 admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:43.971031 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e4c262-4585-4812-84ea-1d352adeb092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:43.974365 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e4c262-4585-4812-84ea-1d352adeb092 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:44.000096 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1084/2177] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:01:44.001436 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7b452-f17a-4761-bbec-db37e24c4db1 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:44.009916 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:44.014412 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7b452-f17a-4761-bbec-db37e24c4db1 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:44.021016 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd07dd-e2bc-4e6c-859f-3904ff9e3f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:44.022414 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd07dd-e2bc-4e6c-859f-3904ff9e3f67 admin admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:44.022863 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd07dd-e2bc-4e6c-859f-3904ff9e3f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:44.023357 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd07dd-e2bc-4e6c-859f-3904ff9e3f67 admin admin] PATH_INFO: `/v3/projects/c56d8fd420b5478286ef2386cb1a325f/users/345c06906a8441f6be8031f0c080baa6/roles/2e4889bb71f9434392c0baba59f2534e` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:44.057082 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bd07dd-e2bc-4e6c-859f-3904ff9e3f67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c56d8fd420b5478286ef2386cb1a325f, user_id=345c06906a8441f6be8031f0c080baa6, role_id=2e4889bb71f9434392c0baba59f2534e)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:44.062774 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bd07dd-e2bc-4e6c-859f-3904ff9e3f67 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:44.089040 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1094/2178] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 01:01:44 2022] PUT /identity/v3/projects/c56d8fd420b5478286ef2386cb1a325f/users/345c06906a8441f6be8031f0c080baa6/roles/2e4889bb71f9434392c0baba59f2534e => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:44.093637 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e4c262-4585-4812-84ea-1d352adeb092 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:44.105522 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e4c262-4585-4812-84ea-1d352adeb092 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:44.184571 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6778f1-dd2a-44c1-9b53-83ac32e1f2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:44.185856 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6778f1-dd2a-44c1-9b53-83ac32e1f2ea admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:44.186336 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6778f1-dd2a-44c1-9b53-83ac32e1f2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:44.187109 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6778f1-dd2a-44c1-9b53-83ac32e1f2ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:44.189024 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6778f1-dd2a-44c1-9b53-83ac32e1f2ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:44.191225 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6778f1-dd2a-44c1-9b53-83ac32e1f2ea admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:44.211549 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1085/2179] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:01:44 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:01:44.216254 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd07dd-e2bc-4e6c-859f-3904ff9e3f67 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:44.230898 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd07dd-e2bc-4e6c-859f-3904ff9e3f67 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:44.252365 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e51c93f-c120-4fa8-8cf9-d3ff890d6ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:44.254372 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51c93f-c120-4fa8-8cf9-d3ff890d6ccf admin admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:44.255109 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51c93f-c120-4fa8-8cf9-d3ff890d6ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:44.255572 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51c93f-c120-4fa8-8cf9-d3ff890d6ccf admin admin] PATH_INFO: `/v3/projects/c56d8fd420b5478286ef2386cb1a325f/users/345c06906a8441f6be8031f0c080baa6/roles/2e4889bb71f9434392c0baba59f2534e` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:44.259332 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e51c93f-c120-4fa8-8cf9-d3ff890d6ccf admin admin] RBAC: Authorizing `identity:create_grant(project_id=c56d8fd420b5478286ef2386cb1a325f, user_id=345c06906a8441f6be8031f0c080baa6, role_id=2e4889bb71f9434392c0baba59f2534e)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:44.279355 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e51c93f-c120-4fa8-8cf9-d3ff890d6ccf admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:44.305829 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1095/2180] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 01:01:44 2022] PUT /identity/v3/projects/c56d8fd420b5478286ef2386cb1a325f/users/345c06906a8441f6be8031f0c080baa6/roles/2e4889bb71f9434392c0baba59f2534e => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:44.318966 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c7401-4688-4907-880d-e26121f91f20 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:44.324778 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c7401-4688-4907-880d-e26121f91f20 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:44.325628 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c7401-4688-4907-880d-e26121f91f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:44.413165 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-e51c7401-4688-4907-880d-e26121f91f20 None None] MFA Rules not processed for user `345c06906a8441f6be8031f0c080baa6`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:44.417004 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-e51c7401-4688-4907-880d-e26121f91f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:44.520419 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1086/2181] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:01:44 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:44.544688 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e51c93f-c120-4fa8-8cf9-d3ff890d6ccf admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:44.551304 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-2e51c93f-c120-4fa8-8cf9-d3ff890d6ccf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:44.677870 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e51c93f-c120-4fa8-8cf9-d3ff890d6ccf admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:44.686359 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ee9d3c-48a9-4619-91a1-c075f0e32801 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:44.688074 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee9d3c-48a9-4619-91a1-c075f0e32801 service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:44.689208 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee9d3c-48a9-4619-91a1-c075f0e32801 service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:44.690132 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee9d3c-48a9-4619-91a1-c075f0e32801 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:44.737947 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ee9d3c-48a9-4619-91a1-c075f0e32801 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:44.775330 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ee9d3c-48a9-4619-91a1-c075f0e32801 service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:44.794805 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1096/2182] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:01:44 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:01:46.513129 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51c7401-4688-4907-880d-e26121f91f20 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:46.514608 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-e51c7401-4688-4907-880d-e26121f91f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:46.572549 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:46.679365 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51c7401-4688-4907-880d-e26121f91f20 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:46.696043 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6d77e7-2070-4257-8164-a18c34f8c7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:46.696723 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d77e7-2070-4257-8164-a18c34f8c7bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:46.697001 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d77e7-2070-4257-8164-a18c34f8c7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:46.697267 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d77e7-2070-4257-8164-a18c34f8c7bb admin admin] PATH_INFO: `/v3/users/843b1e8a93a24c129a1d9bdf47ec979e` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:46.700292 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6d77e7-2070-4257-8164-a18c34f8c7bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=843b1e8a93a24c129a1d9bdf47ec979e)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:46.705754 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6d77e7-2070-4257-8164-a18c34f8c7bb admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:46.821040 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-0b6d77e7-2070-4257-8164-a18c34f8c7bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '843b1e8a93a24c129a1d9bdf47ec979e'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:46.843971 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-0b6d77e7-2070-4257-8164-a18c34f8c7bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '843b1e8a93a24c129a1d9bdf47ec979e'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:46.887348 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-0b6d77e7-2070-4257-8164-a18c34f8c7bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '843b1e8a93a24c129a1d9bdf47ec979e'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:46.889148 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-0b6d77e7-2070-4257-8164-a18c34f8c7bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '843b1e8a93a24c129a1d9bdf47ec979e'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:46.892421 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-0b6d77e7-2070-4257-8164-a18c34f8c7bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '843b1e8a93a24c129a1d9bdf47ec979e'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:46.925527 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1087/2183] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 01:01:46 2022] DELETE /identity/v3/users/843b1e8a93a24c129a1d9bdf47ec979e => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:46.927337 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97e421-40ef-432a-91d1-d36b55b5f796 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:46.927811 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97e421-40ef-432a-91d1-d36b55b5f796 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:46.927907 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f97e421-40ef-432a-91d1-d36b55b5f796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:46.969412 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-6f97e421-40ef-432a-91d1-d36b55b5f796 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:46.972015 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-6f97e421-40ef-432a-91d1-d36b55b5f796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:47.128985 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1097/2184] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:01:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:47.143312 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6d77e7-2070-4257-8164-a18c34f8c7bb admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:47.145281 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-0b6d77e7-2070-4257-8164-a18c34f8c7bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:47.299751 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6d77e7-2070-4257-8164-a18c34f8c7bb admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:47.306600 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e27c8-6b2a-4611-a071-d21eb22faca5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:47.307280 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e27c8-6b2a-4611-a071-d21eb22faca5 service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:47.308612 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e27c8-6b2a-4611-a071-d21eb22faca5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:47.308612 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e27c8-6b2a-4611-a071-d21eb22faca5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:47.322540 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91e27c8-6b2a-4611-a071-d21eb22faca5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:47.324150 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91e27c8-6b2a-4611-a071-d21eb22faca5 service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:47.348883 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1088/2185] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:01:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:01:48.521568 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f97e421-40ef-432a-91d1-d36b55b5f796 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:48.523864 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-6f97e421-40ef-432a-91d1-d36b55b5f796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:48.542594 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f97e421-40ef-432a-91d1-d36b55b5f796 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:48.548948 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f26299-e512-4a97-b03a-6ce7611c52ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:48.549992 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f26299-e512-4a97-b03a-6ce7611c52ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:48.550427 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f26299-e512-4a97-b03a-6ce7611c52ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:48.550835 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f26299-e512-4a97-b03a-6ce7611c52ec admin admin] PATH_INFO: `/v3/projects/7a400cadb01f4dcc9beb71896222a06f` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:48.552819 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f26299-e512-4a97-b03a-6ce7611c52ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a400cadb01f4dcc9beb71896222a06f)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:48.554931 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f26299-e512-4a97-b03a-6ce7611c52ec admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:48.661524 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-a8f26299-e512-4a97-b03a-6ce7611c52ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a400cadb01f4dcc9beb71896222a06f', 'request_id': 'req-a8f26299-e512-4a97-b03a-6ce7611c52ec'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:48.671221 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-a8f26299-e512-4a97-b03a-6ce7611c52ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a400cadb01f4dcc9beb71896222a06f', 'request_id': 'req-a8f26299-e512-4a97-b03a-6ce7611c52ec'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:48.694618 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-a8f26299-e512-4a97-b03a-6ce7611c52ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a400cadb01f4dcc9beb71896222a06f', 'request_id': 'req-a8f26299-e512-4a97-b03a-6ce7611c52ec'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:48.702113 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:48.719040 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-a8f26299-e512-4a97-b03a-6ce7611c52ec admin admin] The token cache is being invalidate because project 7a400cadb01f4dcc9beb71896222a06f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81807) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:01:48.719813 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-a8f26299-e512-4a97-b03a-6ce7611c52ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:48.721238 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-a8f26299-e512-4a97-b03a-6ce7611c52ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:48.728461 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de39423-707b-44a2-a827-8b7cb886adf6 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:48.728970 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1098/2186] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 01:01:48 2022] DELETE /identity/v3/projects/7a400cadb01f4dcc9beb71896222a06f => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:48.729554 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de39423-707b-44a2-a827-8b7cb886adf6 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:48.729991 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de39423-707b-44a2-a827-8b7cb886adf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:48.781539 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-0de39423-707b-44a2-a827-8b7cb886adf6 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:48.783155 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-0de39423-707b-44a2-a827-8b7cb886adf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:48.850828 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:48.892689 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9039568-d865-4cd1-a4a3-72fdda0db4f7 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:48.896559 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9039568-d865-4cd1-a4a3-72fdda0db4f7 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:48.896873 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9039568-d865-4cd1-a4a3-72fdda0db4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:48.903919 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1089/2187] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:01:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:48.936579 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-c9039568-d865-4cd1-a4a3-72fdda0db4f7 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:48.938466 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-c9039568-d865-4cd1-a4a3-72fdda0db4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:48.957316 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1099/2188] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:01:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:48.959778 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de39423-707b-44a2-a827-8b7cb886adf6 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:48.978899 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de39423-707b-44a2-a827-8b7cb886adf6 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:48.986240 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d68144-d131-4100-8596-428759049fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:48.987268 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d68144-d131-4100-8596-428759049fc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:48.987791 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d68144-d131-4100-8596-428759049fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:48.988245 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d68144-d131-4100-8596-428759049fc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:48.989912 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d68144-d131-4100-8596-428759049fc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:01:48.990603 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d68144-d131-4100-8596-428759049fc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:48.993222 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d68144-d131-4100-8596-428759049fc5 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:49.026213 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1090/2189] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 01:01:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:01:49.026908 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9039568-d865-4cd1-a4a3-72fdda0db4f7 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:49.040998 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9039568-d865-4cd1-a4a3-72fdda0db4f7 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:49.049822 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666829fc-60ea-46ff-8b09-2b0e14f42c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:49.052243 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666829fc-60ea-46ff-8b09-2b0e14f42c75 admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:49.052768 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666829fc-60ea-46ff-8b09-2b0e14f42c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:49.053332 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666829fc-60ea-46ff-8b09-2b0e14f42c75 admin admin] PATH_INFO: `/v3/projects` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:49.054460 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666829fc-60ea-46ff-8b09-2b0e14f42c75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:49.059963 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666829fc-60ea-46ff-8b09-2b0e14f42c75 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:49.102934 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1100/2190] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 01:01:49 2022] POST /identity/v3/projects => generated 375 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:01:49.107331 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d68144-d131-4100-8596-428759049fc5 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:49.120836 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d68144-d131-4100-8596-428759049fc5 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:49.251870 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bbf2c0-ed28-4dd6-8dba-4613217cd4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:49.252394 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bbf2c0-ed28-4dd6-8dba-4613217cd4ff admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:49.252746 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bbf2c0-ed28-4dd6-8dba-4613217cd4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:49.253110 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bbf2c0-ed28-4dd6-8dba-4613217cd4ff admin admin] PATH_INFO: `/v3/users` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:49.254442 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bbf2c0-ed28-4dd6-8dba-4613217cd4ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:49.262429 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bbf2c0-ed28-4dd6-8dba-4613217cd4ff admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:49.292669 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1091/2191] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 01:01:49 2022] POST /identity/v3/users => generated 288 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:01:49.294188 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666829fc-60ea-46ff-8b09-2b0e14f42c75 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:49.306812 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666829fc-60ea-46ff-8b09-2b0e14f42c75 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:49.312082 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a474525d-71a1-4373-855b-acdb9cfd49da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:49.312702 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474525d-71a1-4373-855b-acdb9cfd49da admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:49.312978 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474525d-71a1-4373-855b-acdb9cfd49da admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:49.313251 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474525d-71a1-4373-855b-acdb9cfd49da admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:49.313897 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a474525d-71a1-4373-855b-acdb9cfd49da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:49.315715 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a474525d-71a1-4373-855b-acdb9cfd49da admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:49.331689 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1101/2192] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:01:49.336138 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bbf2c0-ed28-4dd6-8dba-4613217cd4ff admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:49.351449 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bbf2c0-ed28-4dd6-8dba-4613217cd4ff admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:49.357664 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9283260-ebb0-4f91-b8ba-34e3490c6bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:49.358323 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9283260-ebb0-4f91-b8ba-34e3490c6bfd admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:49.358605 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9283260-ebb0-4f91-b8ba-34e3490c6bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:49.358932 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9283260-ebb0-4f91-b8ba-34e3490c6bfd admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:49.359710 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9283260-ebb0-4f91-b8ba-34e3490c6bfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:49.361452 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9283260-ebb0-4f91-b8ba-34e3490c6bfd admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:49.378655 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a474525d-71a1-4373-855b-acdb9cfd49da admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:49.378887 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1092/2193] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:01:49 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:01:49.396846 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a474525d-71a1-4373-855b-acdb9cfd49da admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:49.402008 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418623b7-4738-44d7-8604-05ddbe6938c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:49.402764 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418623b7-4738-44d7-8604-05ddbe6938c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:49.403117 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418623b7-4738-44d7-8604-05ddbe6938c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:49.404666 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418623b7-4738-44d7-8604-05ddbe6938c7 admin admin] PATH_INFO: `/v3/projects/066a8a8dd3d64c808fba6cafda6563ec/users/dab7f5868eb74f1bb8200e7999997a51/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:49.423040 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418623b7-4738-44d7-8604-05ddbe6938c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=066a8a8dd3d64c808fba6cafda6563ec, user_id=dab7f5868eb74f1bb8200e7999997a51, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:49.426141 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418623b7-4738-44d7-8604-05ddbe6938c7 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:49.455357 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1102/2194] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 01:01:49 2022] PUT /identity/v3/projects/066a8a8dd3d64c808fba6cafda6563ec/users/dab7f5868eb74f1bb8200e7999997a51/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:01:49.459341 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9133fdf-f35b-4454-b93b-b7e313ce23bd None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:49.459951 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9133fdf-f35b-4454-b93b-b7e313ce23bd None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:49.460408 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9133fdf-f35b-4454-b93b-b7e313ce23bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:49.510913 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-f9133fdf-f35b-4454-b93b-b7e313ce23bd None None] MFA Rules not processed for user `dab7f5868eb74f1bb8200e7999997a51`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:49.513241 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-f9133fdf-f35b-4454-b93b-b7e313ce23bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:49.673687 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1093/2195] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:01:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:49.740026 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418623b7-4738-44d7-8604-05ddbe6938c7 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:49.742183 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-418623b7-4738-44d7-8604-05ddbe6938c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:49.850247 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418623b7-4738-44d7-8604-05ddbe6938c7 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:49.855573 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c6b705-f352-469d-a370-83a102ceff8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:49.856390 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6b705-f352-469d-a370-83a102ceff8d service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:49.857126 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6b705-f352-469d-a370-83a102ceff8d service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:49.857597 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6b705-f352-469d-a370-83a102ceff8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:49.871235 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c6b705-f352-469d-a370-83a102ceff8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:49.873662 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c6b705-f352-469d-a370-83a102ceff8d service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:49.900495 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1103/2196] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:01:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:01:49.935291 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9133fdf-f35b-4454-b93b-b7e313ce23bd None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:50.013909 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:50.053300 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9133fdf-f35b-4454-b93b-b7e313ce23bd None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:50.065166 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dfb257-4e5b-429b-b91f-8b05811ca4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:50.066259 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dfb257-4e5b-429b-b91f-8b05811ca4f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:50.066779 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dfb257-4e5b-429b-b91f-8b05811ca4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:50.067380 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dfb257-4e5b-429b-b91f-8b05811ca4f6 admin admin] PATH_INFO: `/v3/users/dab7f5868eb74f1bb8200e7999997a51` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:50.069846 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dfb257-4e5b-429b-b91f-8b05811ca4f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dab7f5868eb74f1bb8200e7999997a51)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:50.072483 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dfb257-4e5b-429b-b91f-8b05811ca4f6 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:50.154771 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-29dfb257-4e5b-429b-b91f-8b05811ca4f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dab7f5868eb74f1bb8200e7999997a51'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:50.169649 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-29dfb257-4e5b-429b-b91f-8b05811ca4f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dab7f5868eb74f1bb8200e7999997a51'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:50.190452 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-29dfb257-4e5b-429b-b91f-8b05811ca4f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dab7f5868eb74f1bb8200e7999997a51'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:50.191330 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-29dfb257-4e5b-429b-b91f-8b05811ca4f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dab7f5868eb74f1bb8200e7999997a51'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:50.192328 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-29dfb257-4e5b-429b-b91f-8b05811ca4f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dab7f5868eb74f1bb8200e7999997a51'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:50.212554 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1094/2197] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 01:01:49 2022] DELETE /identity/v3/users/dab7f5868eb74f1bb8200e7999997a51 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:50.217529 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0feb52-f413-470b-9db9-292ffe1ee5ff None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:50.218170 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0feb52-f413-470b-9db9-292ffe1ee5ff None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:50.218691 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0feb52-f413-470b-9db9-292ffe1ee5ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:50.247437 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-3f0feb52-f413-470b-9db9-292ffe1ee5ff None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:50.249187 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-3f0feb52-f413-470b-9db9-292ffe1ee5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:50.349436 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1104/2198] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:01:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:50.396487 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dfb257-4e5b-429b-b91f-8b05811ca4f6 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:50.398858 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-29dfb257-4e5b-429b-b91f-8b05811ca4f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:50.482489 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dfb257-4e5b-429b-b91f-8b05811ca4f6 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:50.485888 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a323e-597a-4cfe-9e82-bf0e54549c1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:50.486551 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a323e-597a-4cfe-9e82-bf0e54549c1a service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:50.486843 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a323e-597a-4cfe-9e82-bf0e54549c1a service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:50.487160 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a323e-597a-4cfe-9e82-bf0e54549c1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:50.500021 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354a323e-597a-4cfe-9e82-bf0e54549c1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:50.502177 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354a323e-597a-4cfe-9e82-bf0e54549c1a service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:50.517402 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1095/2199] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:01:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:01:51.047396 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0feb52-f413-470b-9db9-292ffe1ee5ff None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:51.049790 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-3f0feb52-f413-470b-9db9-292ffe1ee5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:51.064288 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0feb52-f413-470b-9db9-292ffe1ee5ff None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:51.070740 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e950c-58b2-480c-b926-5f882203a604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:51.071702 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e950c-58b2-480c-b926-5f882203a604 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:51.072217 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e950c-58b2-480c-b926-5f882203a604 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:51.072565 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e950c-58b2-480c-b926-5f882203a604 admin admin] PATH_INFO: `/v3/users/16feb182d7e4463da41682f528207cc0` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:51.074560 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889e950c-58b2-480c-b926-5f882203a604 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16feb182d7e4463da41682f528207cc0)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:51.077619 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889e950c-58b2-480c-b926-5f882203a604 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:51.122839 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:51.160326 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-889e950c-58b2-480c-b926-5f882203a604 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16feb182d7e4463da41682f528207cc0'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:51.183241 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-889e950c-58b2-480c-b926-5f882203a604 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16feb182d7e4463da41682f528207cc0'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:51.197401 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-889e950c-58b2-480c-b926-5f882203a604 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16feb182d7e4463da41682f528207cc0'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:51.198372 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-889e950c-58b2-480c-b926-5f882203a604 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16feb182d7e4463da41682f528207cc0'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:51.201413 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-889e950c-58b2-480c-b926-5f882203a604 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16feb182d7e4463da41682f528207cc0'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:51.223053 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1105/2200] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 01:01:51 2022] DELETE /identity/v3/users/16feb182d7e4463da41682f528207cc0 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:51.223371 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ad4e7-c4d5-44d6-b5d2-fc656619023d None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:51.223913 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ad4e7-c4d5-44d6-b5d2-fc656619023d None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:51.224084 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ad4e7-c4d5-44d6-b5d2-fc656619023d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:51.253747 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-925ad4e7-c4d5-44d6-b5d2-fc656619023d None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:51.257442 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-925ad4e7-c4d5-44d6-b5d2-fc656619023d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:51.280291 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e950c-58b2-480c-b926-5f882203a604 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:51.282371 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-889e950c-58b2-480c-b926-5f882203a604 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:51.384605 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e950c-58b2-480c-b926-5f882203a604 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:51.394483 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1096/2201] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:01:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:01:51.396796 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ad97b-7967-4036-80eb-07c713192967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:51.397558 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ad97b-7967-4036-80eb-07c713192967 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:51.397987 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ad97b-7967-4036-80eb-07c713192967 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:51.398299 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ad97b-7967-4036-80eb-07c713192967 admin admin] PATH_INFO: `/v3/users/feb270504df4484aa8b5cc51eee4886a` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:51.400207 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868ad97b-7967-4036-80eb-07c713192967 admin admin] RBAC: Authorizing `identity:delete_user(user_id=feb270504df4484aa8b5cc51eee4886a)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:51.402393 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868ad97b-7967-4036-80eb-07c713192967 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:51.466059 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-868ad97b-7967-4036-80eb-07c713192967 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'feb270504df4484aa8b5cc51eee4886a'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:51.471200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ad4e7-c4d5-44d6-b5d2-fc656619023d None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:51.473880 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-925ad4e7-c4d5-44d6-b5d2-fc656619023d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:51.484215 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:51.494929 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-868ad97b-7967-4036-80eb-07c713192967 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'feb270504df4484aa8b5cc51eee4886a'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:51.508517 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-868ad97b-7967-4036-80eb-07c713192967 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'feb270504df4484aa8b5cc51eee4886a'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:51.510066 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-868ad97b-7967-4036-80eb-07c713192967 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'feb270504df4484aa8b5cc51eee4886a'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:51.511800 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-868ad97b-7967-4036-80eb-07c713192967 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'feb270504df4484aa8b5cc51eee4886a'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:51.537938 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1106/2202] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 01:01:51 2022] DELETE /identity/v3/users/feb270504df4484aa8b5cc51eee4886a => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:51.540228 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1a34a-93a2-4c80-9de0-dccbc740cd1f None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:51.542397 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1a34a-93a2-4c80-9de0-dccbc740cd1f None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:51.543099 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1a34a-93a2-4c80-9de0-dccbc740cd1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:51.571814 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-ddf1a34a-93a2-4c80-9de0-dccbc740cd1f None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:51.573950 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-ddf1a34a-93a2-4c80-9de0-dccbc740cd1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:51.601868 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:51.617302 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ad4e7-c4d5-44d6-b5d2-fc656619023d None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:51.664785 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1107/2203] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:01:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:51.693414 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf1a34a-93a2-4c80-9de0-dccbc740cd1f None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:51.695896 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-ddf1a34a-93a2-4c80-9de0-dccbc740cd1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:51.718731 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c2e5b0-11fa-46cc-9b59-06699cb36d4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:51.719853 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2e5b0-11fa-46cc-9b59-06699cb36d4d service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:51.720358 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2e5b0-11fa-46cc-9b59-06699cb36d4d service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:51.720889 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2e5b0-11fa-46cc-9b59-06699cb36d4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:51.725713 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-c4c2e5b0-11fa-46cc-9b59-06699cb36d4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:51.778381 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c2e5b0-11fa-46cc-9b59-06699cb36d4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:51.784183 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c2e5b0-11fa-46cc-9b59-06699cb36d4d service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:51.819632 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf1a34a-93a2-4c80-9de0-dccbc740cd1f None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:51.820263 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1097/2204] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:01:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:01:51.821172 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c2e5b0-11fa-46cc-9b59-06699cb36d4d service neutron] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:51.823556 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-c4c2e5b0-11fa-46cc-9b59-06699cb36d4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:51.831427 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ef43e8-120d-41be-b534-6bacd38153f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:51.832100 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef43e8-120d-41be-b534-6bacd38153f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:51.832384 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef43e8-120d-41be-b534-6bacd38153f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:51.832659 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef43e8-120d-41be-b534-6bacd38153f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:51.853170 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c2e5b0-11fa-46cc-9b59-06699cb36d4d service neutron] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:51.862929 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ef43e8-120d-41be-b534-6bacd38153f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:51.864314 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ef43e8-120d-41be-b534-6bacd38153f2 service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:51.876525 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1108/2205] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:01:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:01:51.878249 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a5e6a3-ac29-4136-94f9-3ef0bfaa168d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:51.878911 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5e6a3-ac29-4136-94f9-3ef0bfaa168d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:51.879242 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5e6a3-ac29-4136-94f9-3ef0bfaa168d admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:51.879515 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5e6a3-ac29-4136-94f9-3ef0bfaa168d admin admin] PATH_INFO: `/v3/projects/066a8a8dd3d64c808fba6cafda6563ec` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:51.881355 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a5e6a3-ac29-4136-94f9-3ef0bfaa168d admin admin] RBAC: Authorizing `identity:delete_project(project_id=066a8a8dd3d64c808fba6cafda6563ec)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:51.883935 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a5e6a3-ac29-4136-94f9-3ef0bfaa168d admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:51.943162 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-15a5e6a3-ac29-4136-94f9-3ef0bfaa168d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '066a8a8dd3d64c808fba6cafda6563ec', 'request_id': 'req-15a5e6a3-ac29-4136-94f9-3ef0bfaa168d'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:51.952719 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-15a5e6a3-ac29-4136-94f9-3ef0bfaa168d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '066a8a8dd3d64c808fba6cafda6563ec', 'request_id': 'req-15a5e6a3-ac29-4136-94f9-3ef0bfaa168d'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:51.962803 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-15a5e6a3-ac29-4136-94f9-3ef0bfaa168d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '066a8a8dd3d64c808fba6cafda6563ec', 'request_id': 'req-15a5e6a3-ac29-4136-94f9-3ef0bfaa168d'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:51.977199 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-15a5e6a3-ac29-4136-94f9-3ef0bfaa168d admin admin] The token cache is being invalidate because project 066a8a8dd3d64c808fba6cafda6563ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81808) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:01:51.977512 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-15a5e6a3-ac29-4136-94f9-3ef0bfaa168d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:51.978244 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-15a5e6a3-ac29-4136-94f9-3ef0bfaa168d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:51.980296 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1098/2206] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 01:01:51 2022] DELETE /identity/v3/projects/066a8a8dd3d64c808fba6cafda6563ec => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:52.940433 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ef43e8-120d-41be-b534-6bacd38153f2 service neutron] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:52.942182 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-c6ef43e8-120d-41be-b534-6bacd38153f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:52.962265 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ef43e8-120d-41be-b534-6bacd38153f2 service neutron] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:53.084563 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e720744-bbae-442d-ad30-4335cc1a58d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:53.085879 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e720744-bbae-442d-ad30-4335cc1a58d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:53.086534 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e720744-bbae-442d-ad30-4335cc1a58d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:53.087183 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e720744-bbae-442d-ad30-4335cc1a58d6 admin admin] PATH_INFO: `/v3/projects/622f8e6e59604b85a50fd339929a7434` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:53.089883 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e720744-bbae-442d-ad30-4335cc1a58d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=622f8e6e59604b85a50fd339929a7434)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:53.094185 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e720744-bbae-442d-ad30-4335cc1a58d6 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:53.184114 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a5e6a3-ac29-4136-94f9-3ef0bfaa168d admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:53.187610 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-15a5e6a3-ac29-4136-94f9-3ef0bfaa168d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:53.241864 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a5e6a3-ac29-4136-94f9-3ef0bfaa168d admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:53.261503 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49d8df5-9e90-44b2-9f6b-0f2ca91db96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:53.264075 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d8df5-9e90-44b2-9f6b-0f2ca91db96c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:53.265391 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d8df5-9e90-44b2-9f6b-0f2ca91db96c admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:53.268304 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d8df5-9e90-44b2-9f6b-0f2ca91db96c admin admin] PATH_INFO: `/v3/users/5e8cdcbf178e443599cddd3d1a2972f0` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:53.272654 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49d8df5-9e90-44b2-9f6b-0f2ca91db96c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e8cdcbf178e443599cddd3d1a2972f0)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:53.283462 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49d8df5-9e90-44b2-9f6b-0f2ca91db96c admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:53.290119 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-0e720744-bbae-442d-ad30-4335cc1a58d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '622f8e6e59604b85a50fd339929a7434', 'request_id': 'req-0e720744-bbae-442d-ad30-4335cc1a58d6'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:53.311225 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-0e720744-bbae-442d-ad30-4335cc1a58d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '622f8e6e59604b85a50fd339929a7434', 'request_id': 'req-0e720744-bbae-442d-ad30-4335cc1a58d6'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:53.346696 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-0e720744-bbae-442d-ad30-4335cc1a58d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '622f8e6e59604b85a50fd339929a7434', 'request_id': 'req-0e720744-bbae-442d-ad30-4335cc1a58d6'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:53.375535 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:53.395471 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-0e720744-bbae-442d-ad30-4335cc1a58d6 admin admin] The token cache is being invalidate because project 622f8e6e59604b85a50fd339929a7434 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81807) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:01:53.395997 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-0e720744-bbae-442d-ad30-4335cc1a58d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:53.400988 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-0e720744-bbae-442d-ad30-4335cc1a58d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:53.412674 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1109/2207] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 01:01:52 2022] DELETE /identity/v3/projects/622f8e6e59604b85a50fd339929a7434 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:53.415181 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca26354-f45d-4c92-b086-ac71b97cc02e None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:53.415469 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca26354-f45d-4c92-b086-ac71b97cc02e None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:53.415914 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca26354-f45d-4c92-b086-ac71b97cc02e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:53.447467 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:53.464849 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-f49d8df5-9e90-44b2-9f6b-0f2ca91db96c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e8cdcbf178e443599cddd3d1a2972f0'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:53.485124 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-f49d8df5-9e90-44b2-9f6b-0f2ca91db96c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e8cdcbf178e443599cddd3d1a2972f0'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:53.501720 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-eca26354-f45d-4c92-b086-ac71b97cc02e None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:53.507875 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-eca26354-f45d-4c92-b086-ac71b97cc02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:53.565332 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-f49d8df5-9e90-44b2-9f6b-0f2ca91db96c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e8cdcbf178e443599cddd3d1a2972f0'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:53.582159 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-f49d8df5-9e90-44b2-9f6b-0f2ca91db96c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e8cdcbf178e443599cddd3d1a2972f0'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:53.584537 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-f49d8df5-9e90-44b2-9f6b-0f2ca91db96c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e8cdcbf178e443599cddd3d1a2972f0'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:53.635467 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1099/2208] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 01:01:53 2022] DELETE /identity/v3/users/5e8cdcbf178e443599cddd3d1a2972f0 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:53.638355 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643e556-b5ef-4a49-8e13-5778c470e9c3 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:53.641311 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643e556-b5ef-4a49-8e13-5778c470e9c3 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:53.641311 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643e556-b5ef-4a49-8e13-5778c470e9c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:53.699070 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-5643e556-b5ef-4a49-8e13-5778c470e9c3 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:53.705341 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-5643e556-b5ef-4a49-8e13-5778c470e9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:53.752781 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1110/2209] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:01:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:53.755402 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2623c-87bf-4eb6-99d6-12e39e60885c None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:53.756272 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2623c-87bf-4eb6-99d6-12e39e60885c None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:53.756902 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf2623c-87bf-4eb6-99d6-12e39e60885c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:53.806938 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-2cf2623c-87bf-4eb6-99d6-12e39e60885c None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:53.812299 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-2cf2623c-87bf-4eb6-99d6-12e39e60885c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:53.885563 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1100/2210] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:01:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:53.887849 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5643e556-b5ef-4a49-8e13-5778c470e9c3 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:53.893771 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-5643e556-b5ef-4a49-8e13-5778c470e9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:53.943741 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5643e556-b5ef-4a49-8e13-5778c470e9c3 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:53.954121 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb2e361-1279-4630-b4e3-9089c444e19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:53.957954 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2e361-1279-4630-b4e3-9089c444e19e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:53.960583 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2e361-1279-4630-b4e3-9089c444e19e admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:53.961201 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2e361-1279-4630-b4e3-9089c444e19e admin admin] PATH_INFO: `/v3/projects/fe0a04b2806044f286f6d88242550048` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:53.964110 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb2e361-1279-4630-b4e3-9089c444e19e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe0a04b2806044f286f6d88242550048)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:53.969520 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb2e361-1279-4630-b4e3-9089c444e19e admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:54.058615 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1111/2211] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:01:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:54.060331 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2623c-87bf-4eb6-99d6-12e39e60885c None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:54.066813 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-2cf2623c-87bf-4eb6-99d6-12e39e60885c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:54.120346 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-adb2e361-1279-4630-b4e3-9089c444e19e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe0a04b2806044f286f6d88242550048', 'request_id': 'req-adb2e361-1279-4630-b4e3-9089c444e19e'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:54.140425 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-adb2e361-1279-4630-b4e3-9089c444e19e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe0a04b2806044f286f6d88242550048', 'request_id': 'req-adb2e361-1279-4630-b4e3-9089c444e19e'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:54.155128 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-adb2e361-1279-4630-b4e3-9089c444e19e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe0a04b2806044f286f6d88242550048', 'request_id': 'req-adb2e361-1279-4630-b4e3-9089c444e19e'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:54.178712 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-adb2e361-1279-4630-b4e3-9089c444e19e admin admin] The token cache is being invalidate because project fe0a04b2806044f286f6d88242550048 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81808) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:01:54.179127 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-adb2e361-1279-4630-b4e3-9089c444e19e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:54.179976 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-adb2e361-1279-4630-b4e3-9089c444e19e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:54.186717 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1101/2212] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 01:01:53 2022] DELETE /identity/v3/projects/fe0a04b2806044f286f6d88242550048 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:54.186717 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb2e361-1279-4630-b4e3-9089c444e19e admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:54.189880 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-adb2e361-1279-4630-b4e3-9089c444e19e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:54.239272 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf2623c-87bf-4eb6-99d6-12e39e60885c None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:54.339445 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:54.369937 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6e0bf3-9d19-45fa-89dd-7241c5909301 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:54.370647 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e0bf3-9d19-45fa-89dd-7241c5909301 service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:54.370854 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e0bf3-9d19-45fa-89dd-7241c5909301 service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:54.371130 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e0bf3-9d19-45fa-89dd-7241c5909301 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:54.379496 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-5e6e0bf3-9d19-45fa-89dd-7241c5909301 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:54.395709 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb2e361-1279-4630-b4e3-9089c444e19e admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:54.411620 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6e0bf3-9d19-45fa-89dd-7241c5909301 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:54.412736 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6e0bf3-9d19-45fa-89dd-7241c5909301 service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:54.414893 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ff4fc-ade8-474e-927a-3ac1cace059d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:54.415538 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ff4fc-ade8-474e-927a-3ac1cace059d admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:54.415854 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ff4fc-ade8-474e-927a-3ac1cace059d admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:54.416221 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ff4fc-ade8-474e-927a-3ac1cace059d admin admin] PATH_INFO: `/v3/domains` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:54.417162 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76ff4fc-ade8-474e-927a-3ac1cace059d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:01:54.417423 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76ff4fc-ade8-474e-927a-3ac1cace059d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:54.424068 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76ff4fc-ade8-474e-927a-3ac1cace059d admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:54.429068 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:54.447399 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1112/2213] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:01:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:01:54.450229 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6e0bf3-9d19-45fa-89dd-7241c5909301 service neutron] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:54.454921 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-5e6e0bf3-9d19-45fa-89dd-7241c5909301 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:54.458670 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1102/2214] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 01:01:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:01:54.465644 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ff4fc-ade8-474e-927a-3ac1cace059d admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:54.483762 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ff4fc-ade8-474e-927a-3ac1cace059d admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:54.488688 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6e0bf3-9d19-45fa-89dd-7241c5909301 service neutron] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:54.498276 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf5973-937f-4eea-a20f-65cc802a0e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:54.501868 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf5973-937f-4eea-a20f-65cc802a0e34 admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:54.502165 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf5973-937f-4eea-a20f-65cc802a0e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:54.502447 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf5973-937f-4eea-a20f-65cc802a0e34 admin admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:54.505249 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ec21c5-3e13-4508-99f2-dae56def7a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:54.506526 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cf5973-937f-4eea-a20f-65cc802a0e34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:54.507810 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec21c5-3e13-4508-99f2-dae56def7a34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:54.508919 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec21c5-3e13-4508-99f2-dae56def7a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:54.509373 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec21c5-3e13-4508-99f2-dae56def7a34 admin admin] PATH_INFO: `/v3/users/345c06906a8441f6be8031f0c080baa6` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:54.518602 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ec21c5-3e13-4508-99f2-dae56def7a34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=345c06906a8441f6be8031f0c080baa6)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:54.520380 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cf5973-937f-4eea-a20f-65cc802a0e34 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:54.524890 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ec21c5-3e13-4508-99f2-dae56def7a34 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:54.621632 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1103/2215] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 01:01:54 2022] POST /identity/v3/projects => generated 375 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:01:54.623698 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf5973-937f-4eea-a20f-65cc802a0e34 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:54.681420 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-15ec21c5-3e13-4508-99f2-dae56def7a34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '345c06906a8441f6be8031f0c080baa6'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:54.714638 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-15ec21c5-3e13-4508-99f2-dae56def7a34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '345c06906a8441f6be8031f0c080baa6'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:54.734155 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-15ec21c5-3e13-4508-99f2-dae56def7a34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '345c06906a8441f6be8031f0c080baa6'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:54.734955 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-15ec21c5-3e13-4508-99f2-dae56def7a34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '345c06906a8441f6be8031f0c080baa6'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:54.735838 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-15ec21c5-3e13-4508-99f2-dae56def7a34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '345c06906a8441f6be8031f0c080baa6'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:54.758470 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf5973-937f-4eea-a20f-65cc802a0e34 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:54.765329 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10067dc9-d02f-4150-9183-0ffb5566cdc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:54.766231 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10067dc9-d02f-4150-9183-0ffb5566cdc6 admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:54.766673 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10067dc9-d02f-4150-9183-0ffb5566cdc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:54.767092 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10067dc9-d02f-4150-9183-0ffb5566cdc6 admin admin] PATH_INFO: `/v3/users` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:54.769067 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10067dc9-d02f-4150-9183-0ffb5566cdc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:54.771475 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10067dc9-d02f-4150-9183-0ffb5566cdc6 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:54.780838 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1113/2216] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 01:01:54 2022] DELETE /identity/v3/users/345c06906a8441f6be8031f0c080baa6 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:54.811359 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1104/2217] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 01:01:54 2022] POST /identity/v3/users => generated 288 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:01:54.812748 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ec21c5-3e13-4508-99f2-dae56def7a34 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:54.815410 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-15ec21c5-3e13-4508-99f2-dae56def7a34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:54.957133 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ec21c5-3e13-4508-99f2-dae56def7a34 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:54.970998 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ace1eb-b5d8-4fa3-9443-2bee8514df8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:54.972054 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ace1eb-b5d8-4fa3-9443-2bee8514df8f admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:54.972501 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ace1eb-b5d8-4fa3-9443-2bee8514df8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:54.972946 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ace1eb-b5d8-4fa3-9443-2bee8514df8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:54.974072 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ace1eb-b5d8-4fa3-9443-2bee8514df8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:54.977154 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ace1eb-b5d8-4fa3-9443-2bee8514df8f admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:54.991149 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1114/2218] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:01:54 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:01:54.995769 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10067dc9-d02f-4150-9183-0ffb5566cdc6 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:55.018348 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10067dc9-d02f-4150-9183-0ffb5566cdc6 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:55.028727 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a69f05-8cc5-44f9-a151-ad678f6adaf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:55.030273 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a69f05-8cc5-44f9-a151-ad678f6adaf5 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:55.031083 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a69f05-8cc5-44f9-a151-ad678f6adaf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:55.032492 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a69f05-8cc5-44f9-a151-ad678f6adaf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:55.033704 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a69f05-8cc5-44f9-a151-ad678f6adaf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:55.035739 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a69f05-8cc5-44f9-a151-ad678f6adaf5 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:55.052789 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1105/2219] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:01:54 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:01:55.057286 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ace1eb-b5d8-4fa3-9443-2bee8514df8f admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:55.074380 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ace1eb-b5d8-4fa3-9443-2bee8514df8f admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:55.081985 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b36492-5b41-4802-b46b-8e7c032ddf97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:55.084597 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b36492-5b41-4802-b46b-8e7c032ddf97 admin admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:55.085236 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b36492-5b41-4802-b46b-8e7c032ddf97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:55.085791 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b36492-5b41-4802-b46b-8e7c032ddf97 admin admin] PATH_INFO: `/v3/projects/7957ad0a214147ecb7f2858e4d3c3272/users/1f6108050e934edf922491f983d9c9f1/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:55.108711 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b36492-5b41-4802-b46b-8e7c032ddf97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7957ad0a214147ecb7f2858e4d3c3272, user_id=1f6108050e934edf922491f983d9c9f1, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:55.112897 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b36492-5b41-4802-b46b-8e7c032ddf97 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:55.166875 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1115/2220] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 01:01:55 2022] PUT /identity/v3/projects/7957ad0a214147ecb7f2858e4d3c3272/users/1f6108050e934edf922491f983d9c9f1/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:55.181279 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85859e0-6f7d-4375-ac20-7078b5b95652 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:55.182514 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85859e0-6f7d-4375-ac20-7078b5b95652 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:55.183816 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85859e0-6f7d-4375-ac20-7078b5b95652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:55.260818 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b36492-5b41-4802-b46b-8e7c032ddf97 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:55.263787 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-e6b36492-5b41-4802-b46b-8e7c032ddf97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:55.344330 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-d85859e0-6f7d-4375-ac20-7078b5b95652 None None] MFA Rules not processed for user `1f6108050e934edf922491f983d9c9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:55.350640 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-d85859e0-6f7d-4375-ac20-7078b5b95652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:55.362345 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:55.391196 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b36492-5b41-4802-b46b-8e7c032ddf97 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:55.410078 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df6304a-5ffb-4c0d-8540-bdeaa21cb918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:55.411248 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6304a-5ffb-4c0d-8540-bdeaa21cb918 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:55.411248 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6304a-5ffb-4c0d-8540-bdeaa21cb918 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:55.411995 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6304a-5ffb-4c0d-8540-bdeaa21cb918 admin admin] PATH_INFO: `/v3/projects/e1f8db695c344fee8b6f115622e3f367` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:55.413031 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df6304a-5ffb-4c0d-8540-bdeaa21cb918 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1f8db695c344fee8b6f115622e3f367)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:55.415065 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df6304a-5ffb-4c0d-8540-bdeaa21cb918 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:55.501453 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-1df6304a-5ffb-4c0d-8540-bdeaa21cb918 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1f8db695c344fee8b6f115622e3f367', 'request_id': 'req-1df6304a-5ffb-4c0d-8540-bdeaa21cb918'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:55.509532 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-1df6304a-5ffb-4c0d-8540-bdeaa21cb918 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1f8db695c344fee8b6f115622e3f367', 'request_id': 'req-1df6304a-5ffb-4c0d-8540-bdeaa21cb918'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:55.525653 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-1df6304a-5ffb-4c0d-8540-bdeaa21cb918 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1f8db695c344fee8b6f115622e3f367', 'request_id': 'req-1df6304a-5ffb-4c0d-8540-bdeaa21cb918'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:55.567388 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-1df6304a-5ffb-4c0d-8540-bdeaa21cb918 admin admin] The token cache is being invalidate because project e1f8db695c344fee8b6f115622e3f367 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81807) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:01:55.567858 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-1df6304a-5ffb-4c0d-8540-bdeaa21cb918 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:55.569002 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-1df6304a-5ffb-4c0d-8540-bdeaa21cb918 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:55.575329 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1116/2221] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 01:01:55 2022] DELETE /identity/v3/projects/e1f8db695c344fee8b6f115622e3f367 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:01:55.575329 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df6304a-5ffb-4c0d-8540-bdeaa21cb918 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:55.576693 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-1df6304a-5ffb-4c0d-8540-bdeaa21cb918 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:55.585306 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1106/2222] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:01:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:55.587740 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7881c4f3-16f6-40ee-b16d-ea2cdefa9f66 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:55.590217 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7881c4f3-16f6-40ee-b16d-ea2cdefa9f66 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:55.590670 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7881c4f3-16f6-40ee-b16d-ea2cdefa9f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:55.623877 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-7881c4f3-16f6-40ee-b16d-ea2cdefa9f66 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:55.625137 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-7881c4f3-16f6-40ee-b16d-ea2cdefa9f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:55.646224 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:55.738601 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1107/2223] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:01:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:55.739623 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7881c4f3-16f6-40ee-b16d-ea2cdefa9f66 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:55.741193 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-7881c4f3-16f6-40ee-b16d-ea2cdefa9f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:55.763170 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7881c4f3-16f6-40ee-b16d-ea2cdefa9f66 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:55.763548 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df6304a-5ffb-4c0d-8540-bdeaa21cb918 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:55.778838 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2f0cb1-fe5c-4e71-ae41-6ec9d514881f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:55.779571 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f0cb1-fe5c-4e71-ae41-6ec9d514881f admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:55.779885 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f0cb1-fe5c-4e71-ae41-6ec9d514881f admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:55.780156 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f0cb1-fe5c-4e71-ae41-6ec9d514881f admin admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:55.781490 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2f0cb1-fe5c-4e71-ae41-6ec9d514881f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:55.783582 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2f0cb1-fe5c-4e71-ae41-6ec9d514881f admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:55.789420 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d10a2e-15b6-4a14-b082-3416b56649ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:55.790365 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d10a2e-15b6-4a14-b082-3416b56649ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:55.791155 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d10a2e-15b6-4a14-b082-3416b56649ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:55.791155 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d10a2e-15b6-4a14-b082-3416b56649ef admin admin] PATH_INFO: `/v3/projects/c56d8fd420b5478286ef2386cb1a325f` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:55.796678 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d10a2e-15b6-4a14-b082-3416b56649ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=c56d8fd420b5478286ef2386cb1a325f)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:55.797499 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d10a2e-15b6-4a14-b082-3416b56649ef admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:55.847340 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1108/2224] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 01:01:55 2022] POST /identity/v3/projects => generated 375 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:01:55.849800 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb8e9d-709e-44d7-a68e-f9133d6d8e6a None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:55.850274 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb8e9d-709e-44d7-a68e-f9133d6d8e6a None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:55.850688 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb8e9d-709e-44d7-a68e-f9133d6d8e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:55.892460 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-aacb8e9d-709e-44d7-a68e-f9133d6d8e6a None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:55.894243 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-aacb8e9d-709e-44d7-a68e-f9133d6d8e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:55.905579 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-d0d10a2e-15b6-4a14-b082-3416b56649ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c56d8fd420b5478286ef2386cb1a325f', 'request_id': 'req-d0d10a2e-15b6-4a14-b082-3416b56649ef'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:55.919456 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-d0d10a2e-15b6-4a14-b082-3416b56649ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c56d8fd420b5478286ef2386cb1a325f', 'request_id': 'req-d0d10a2e-15b6-4a14-b082-3416b56649ef'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:55.935979 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-d0d10a2e-15b6-4a14-b082-3416b56649ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c56d8fd420b5478286ef2386cb1a325f', 'request_id': 'req-d0d10a2e-15b6-4a14-b082-3416b56649ef'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:55.961139 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-d0d10a2e-15b6-4a14-b082-3416b56649ef admin admin] The token cache is being invalidate because project c56d8fd420b5478286ef2386cb1a325f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81807) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:01:55.963788 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-d0d10a2e-15b6-4a14-b082-3416b56649ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:55.965693 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-d0d10a2e-15b6-4a14-b082-3416b56649ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:01:55.974914 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1117/2225] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 01:01:55 2022] DELETE /identity/v3/projects/c56d8fd420b5478286ef2386cb1a325f => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:55.976528 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d10a2e-15b6-4a14-b082-3416b56649ef admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:55.980965 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-d0d10a2e-15b6-4a14-b082-3416b56649ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:55.996196 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:56.020835 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1109/2226] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:01:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:56.022280 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6946030-5862-4896-a12d-37fe14222ed6 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:56.022771 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6946030-5862-4896-a12d-37fe14222ed6 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:56.023254 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6946030-5862-4896-a12d-37fe14222ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:56.048391 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-c6946030-5862-4896-a12d-37fe14222ed6 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:56.049752 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-c6946030-5862-4896-a12d-37fe14222ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:56.062852 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1110/2227] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:01:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:56.064551 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6946030-5862-4896-a12d-37fe14222ed6 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:56.076763 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6946030-5862-4896-a12d-37fe14222ed6 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:56.094839 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f547a9-c307-4937-844e-47ec38b0c574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:56.097491 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f547a9-c307-4937-844e-47ec38b0c574 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:56.098250 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f547a9-c307-4937-844e-47ec38b0c574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:56.099237 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f547a9-c307-4937-844e-47ec38b0c574 admin admin] PATH_INFO: `/v3/domains` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:56.100298 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f547a9-c307-4937-844e-47ec38b0c574 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:01:56.100773 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f547a9-c307-4937-844e-47ec38b0c574 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:56.103902 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f547a9-c307-4937-844e-47ec38b0c574 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:56.142416 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1111/2228] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 01:01:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:01:56.145128 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d10a2e-15b6-4a14-b082-3416b56649ef admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:56.151810 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef256f1c-28a0-42dd-8c9a-778a314db246 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:56.152441 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef256f1c-28a0-42dd-8c9a-778a314db246 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:56.152791 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef256f1c-28a0-42dd-8c9a-778a314db246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:56.160522 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b4677f-7428-46b1-a5bf-29647aec98e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:56.161170 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b4677f-7428-46b1-a5bf-29647aec98e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:56.161457 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b4677f-7428-46b1-a5bf-29647aec98e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:56.162008 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b4677f-7428-46b1-a5bf-29647aec98e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:56.162692 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b4677f-7428-46b1-a5bf-29647aec98e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:56.165633 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b4677f-7428-46b1-a5bf-29647aec98e1 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:56.188214 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-ef256f1c-28a0-42dd-8c9a-778a314db246 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:56.191482 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-ef256f1c-28a0-42dd-8c9a-778a314db246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:56.204116 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1112/2229] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:01:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:56.205000 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef256f1c-28a0-42dd-8c9a-778a314db246 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:56.209557 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1118/2230] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 01:01:55 2022] POST /identity/v3/users => generated 294 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:01:56.210568 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b4677f-7428-46b1-a5bf-29647aec98e1 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:56.221668 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b4677f-7428-46b1-a5bf-29647aec98e1 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:56.226131 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef256f1c-28a0-42dd-8c9a-778a314db246 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:56.227236 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e49386-85c1-4994-85ed-b14a078545ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:56.227905 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e49386-85c1-4994-85ed-b14a078545ea admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:56.228188 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e49386-85c1-4994-85ed-b14a078545ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:56.228464 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e49386-85c1-4994-85ed-b14a078545ea admin admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:56.229678 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e49386-85c1-4994-85ed-b14a078545ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:01:56.229678 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e49386-85c1-4994-85ed-b14a078545ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:56.231189 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e49386-85c1-4994-85ed-b14a078545ea admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:56.240624 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba50765-b5e1-4a28-bc11-3db000da4e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:56.244890 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba50765-b5e1-4a28-bc11-3db000da4e79 admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:56.245623 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba50765-b5e1-4a28-bc11-3db000da4e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:56.245763 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1119/2231] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 01:01:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:01:56.247932 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba50765-b5e1-4a28-bc11-3db000da4e79 admin admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:56.248824 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba50765-b5e1-4a28-bc11-3db000da4e79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:56.249624 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e49386-85c1-4994-85ed-b14a078545ea admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:56.257190 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba50765-b5e1-4a28-bc11-3db000da4e79 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:56.260723 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e49386-85c1-4994-85ed-b14a078545ea admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:56.266035 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77e5936-226c-4cce-a21c-e2eb98582c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:56.267716 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e5936-226c-4cce-a21c-e2eb98582c88 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:56.267716 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e5936-226c-4cce-a21c-e2eb98582c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:56.267716 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77e5936-226c-4cce-a21c-e2eb98582c88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:56.268139 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77e5936-226c-4cce-a21c-e2eb98582c88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:56.269620 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77e5936-226c-4cce-a21c-e2eb98582c88 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:56.281624 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1120/2232] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:01:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:01:56.282939 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77e5936-226c-4cce-a21c-e2eb98582c88 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:56.294506 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77e5936-226c-4cce-a21c-e2eb98582c88 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:56.299510 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe090e7-aa8d-4932-a8ce-3575230897ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:56.300177 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe090e7-aa8d-4932-a8ce-3575230897ae admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:56.300458 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe090e7-aa8d-4932-a8ce-3575230897ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:56.300736 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe090e7-aa8d-4932-a8ce-3575230897ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:56.301386 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe090e7-aa8d-4932-a8ce-3575230897ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:56.303692 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe090e7-aa8d-4932-a8ce-3575230897ae admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:56.338736 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1113/2233] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 01:01:56 2022] POST /identity/v3/projects => generated 373 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:01:56.342709 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba50765-b5e1-4a28-bc11-3db000da4e79 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:56.346644 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1121/2234] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 01:01:56 2022] POST /identity/v3/projects => generated 389 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:01:56.354806 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe090e7-aa8d-4932-a8ce-3575230897ae admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:56.552125 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:56.582226 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe090e7-aa8d-4932-a8ce-3575230897ae admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:56.584273 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba50765-b5e1-4a28-bc11-3db000da4e79 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:56.591487 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9972e7f-7859-420e-a611-31305ed31716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:56.593002 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9972e7f-7859-420e-a611-31305ed31716 admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:56.593825 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9972e7f-7859-420e-a611-31305ed31716 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:56.594643 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9972e7f-7859-420e-a611-31305ed31716 admin admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:56.595899 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9972e7f-7859-420e-a611-31305ed31716 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:56.599988 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9972e7f-7859-420e-a611-31305ed31716 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:56.603944 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84daf807-6cbb-483c-ad31-65c2c93a5031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:56.604876 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84daf807-6cbb-483c-ad31-65c2c93a5031 admin admin] REQUEST_METHOD: `PUT` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:56.605161 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84daf807-6cbb-483c-ad31-65c2c93a5031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:56.605488 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84daf807-6cbb-483c-ad31-65c2c93a5031 admin admin] PATH_INFO: `/v3/projects/5e997656129a4ed2bc63b40a3f0fe70c/users/5de1b33cb7ff4cbbbd21f44adace0909/roles/2e4889bb71f9434392c0baba59f2534e` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:56.637630 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84daf807-6cbb-483c-ad31-65c2c93a5031 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e997656129a4ed2bc63b40a3f0fe70c, user_id=5de1b33cb7ff4cbbbd21f44adace0909, role_id=2e4889bb71f9434392c0baba59f2534e)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:56.640906 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84daf807-6cbb-483c-ad31-65c2c93a5031 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:56.650316 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1122/2235] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 01:01:56 2022] POST /identity/v3/users => generated 287 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:01:56.652749 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9972e7f-7859-420e-a611-31305ed31716 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:56.675855 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1114/2236] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 01:01:56 2022] PUT /identity/v3/projects/5e997656129a4ed2bc63b40a3f0fe70c/users/5de1b33cb7ff4cbbbd21f44adace0909/roles/2e4889bb71f9434392c0baba59f2534e => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:56.677329 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84daf807-6cbb-483c-ad31-65c2c93a5031 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:56.687901 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9972e7f-7859-420e-a611-31305ed31716 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:56.797360 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:56.872370 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9540de-54ad-4357-9d0f-91e82895a46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:56.872998 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84daf807-6cbb-483c-ad31-65c2c93a5031 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:56.884294 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9540de-54ad-4357-9d0f-91e82895a46a admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:56.886531 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9540de-54ad-4357-9d0f-91e82895a46a admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:56.887553 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9540de-54ad-4357-9d0f-91e82895a46a admin admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:56.889723 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9540de-54ad-4357-9d0f-91e82895a46a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:56.891696 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9540de-54ad-4357-9d0f-91e82895a46a admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:56.901706 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51303c3b-4abe-49df-9cab-b0d9de3cfb26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:56.903301 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51303c3b-4abe-49df-9cab-b0d9de3cfb26 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:56.904019 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51303c3b-4abe-49df-9cab-b0d9de3cfb26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:56.908436 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51303c3b-4abe-49df-9cab-b0d9de3cfb26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:56.914950 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51303c3b-4abe-49df-9cab-b0d9de3cfb26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:56.917368 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51303c3b-4abe-49df-9cab-b0d9de3cfb26 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:56.945139 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1115/2237] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:01:56 2022] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:01:56.945139 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51303c3b-4abe-49df-9cab-b0d9de3cfb26 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:56.956480 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1123/2238] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 01:01:56 2022] POST /identity/v3/users => generated 295 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:01:56.961338 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9540de-54ad-4357-9d0f-91e82895a46a admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:56.964161 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51303c3b-4abe-49df-9cab-b0d9de3cfb26 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:56.975011 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a15a239-e700-46af-be0d-e2c0b1c9d22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:56.977820 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15a239-e700-46af-be0d-e2c0b1c9d22a admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:56.978183 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15a239-e700-46af-be0d-e2c0b1c9d22a admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:56.978528 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a15a239-e700-46af-be0d-e2c0b1c9d22a admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:56.979617 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a15a239-e700-46af-be0d-e2c0b1c9d22a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:56.982261 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a15a239-e700-46af-be0d-e2c0b1c9d22a admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:56.994595 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9540de-54ad-4357-9d0f-91e82895a46a admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:56.999877 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b4669f-f1df-4e0c-9605-52039cad1337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:57.000522 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4669f-f1df-4e0c-9605-52039cad1337 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:57.000801 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4669f-f1df-4e0c-9605-52039cad1337 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:57.001074 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4669f-f1df-4e0c-9605-52039cad1337 admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:57.002019 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b4669f-f1df-4e0c-9605-52039cad1337 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:57.003701 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b4669f-f1df-4e0c-9605-52039cad1337 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:57.005152 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1116/2239] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:01:56 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:01:57.007752 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a15a239-e700-46af-be0d-e2c0b1c9d22a admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:57.028709 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1124/2240] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:01:56 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:01:57.029282 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b4669f-f1df-4e0c-9605-52039cad1337 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:57.031869 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a15a239-e700-46af-be0d-e2c0b1c9d22a admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:57.056538 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b4669f-f1df-4e0c-9605-52039cad1337 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:57.064428 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0c5001-6a3f-4c5b-80b6-6f44a62be646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:57.070840 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c5001-6a3f-4c5b-80b6-6f44a62be646 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:57.070840 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c5001-6a3f-4c5b-80b6-6f44a62be646 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:57.070840 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c5001-6a3f-4c5b-80b6-6f44a62be646 admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:57.070840 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0c5001-6a3f-4c5b-80b6-6f44a62be646 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:57.072147 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0c5001-6a3f-4c5b-80b6-6f44a62be646 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:57.092704 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1117/2241] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:01:57 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:01:57.094473 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0c5001-6a3f-4c5b-80b6-6f44a62be646 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:57.102019 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabc97f9-b150-4807-85ed-2ea2e0b69838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:57.103116 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc97f9-b150-4807-85ed-2ea2e0b69838 admin admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:57.103463 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc97f9-b150-4807-85ed-2ea2e0b69838 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:57.103838 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc97f9-b150-4807-85ed-2ea2e0b69838 admin admin] PATH_INFO: `/v3/projects/5e997656129a4ed2bc63b40a3f0fe70c/users/5de1b33cb7ff4cbbbd21f44adace0909/roles/2e4889bb71f9434392c0baba59f2534e` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:57.107106 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabc97f9-b150-4807-85ed-2ea2e0b69838 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e997656129a4ed2bc63b40a3f0fe70c, user_id=5de1b33cb7ff4cbbbd21f44adace0909, role_id=2e4889bb71f9434392c0baba59f2534e)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:57.111973 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabc97f9-b150-4807-85ed-2ea2e0b69838 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:57.124088 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0c5001-6a3f-4c5b-80b6-6f44a62be646 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:57.138657 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1997d3b7-dc94-4cc8-8b45-5ead2cbb0bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:57.140528 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1997d3b7-dc94-4cc8-8b45-5ead2cbb0bd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:57.145863 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1997d3b7-dc94-4cc8-8b45-5ead2cbb0bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:57.145863 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1997d3b7-dc94-4cc8-8b45-5ead2cbb0bd9 admin admin] PATH_INFO: `/v3/projects/d75faf822f94454485448d6b9656f3bf/users/7fdba9e25c36413ab776727a21ef0d11/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:57.172283 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1125/2242] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 01:01:57 2022] PUT /identity/v3/projects/5e997656129a4ed2bc63b40a3f0fe70c/users/5de1b33cb7ff4cbbbd21f44adace0909/roles/2e4889bb71f9434392c0baba59f2534e => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:57.185793 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabc97f9-b150-4807-85ed-2ea2e0b69838 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:57.201364 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1997d3b7-dc94-4cc8-8b45-5ead2cbb0bd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d75faf822f94454485448d6b9656f3bf, user_id=7fdba9e25c36413ab776727a21ef0d11, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:57.210406 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1997d3b7-dc94-4cc8-8b45-5ead2cbb0bd9 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:57.242892 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1118/2243] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 01:01:57 2022] PUT /identity/v3/projects/d75faf822f94454485448d6b9656f3bf/users/7fdba9e25c36413ab776727a21ef0d11/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:57.245838 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa1726-bd47-4e0a-9889-9c246b080f3f None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:57.246629 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa1726-bd47-4e0a-9889-9c246b080f3f None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:57.247187 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa1726-bd47-4e0a-9889-9c246b080f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:57.303622 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-22fa1726-bd47-4e0a-9889-9c246b080f3f None None] MFA Rules not processed for user `5de1b33cb7ff4cbbbd21f44adace0909`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:57.306364 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-22fa1726-bd47-4e0a-9889-9c246b080f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:57.335915 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabc97f9-b150-4807-85ed-2ea2e0b69838 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:57.438558 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1119/2244] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:01:57 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:57.445332 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9fe7eb-a421-45e6-a05d-3e45dd184f13 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:57.445830 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9fe7eb-a421-45e6-a05d-3e45dd184f13 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:57.447124 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9fe7eb-a421-45e6-a05d-3e45dd184f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:57.502401 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2901c1-930d-47f4-8935-a42f45934481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:57.503324 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2901c1-930d-47f4-8935-a42f45934481 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:57.504017 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2901c1-930d-47f4-8935-a42f45934481 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:57.504543 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2901c1-930d-47f4-8935-a42f45934481 admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:57.506273 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2901c1-930d-47f4-8935-a42f45934481 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:57.508973 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:57.511211 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2901c1-930d-47f4-8935-a42f45934481 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:57.530602 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1126/2245] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:01:57 2022] GET /identity/v3/roles => generated 1420 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:01:57.530780 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-1c9fe7eb-a421-45e6-a05d-3e45dd184f13 None None] MFA Rules not processed for user `7fdba9e25c36413ab776727a21ef0d11`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:57.531870 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2901c1-930d-47f4-8935-a42f45934481 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:57.532007 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-1c9fe7eb-a421-45e6-a05d-3e45dd184f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:57.534075 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-7a2901c1-930d-47f4-8935-a42f45934481 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:57.641085 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:57.652042 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1120/2246] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:01:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:57.653250 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9fe7eb-a421-45e6-a05d-3e45dd184f13 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:57.673920 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2901c1-930d-47f4-8935-a42f45934481 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:57.674599 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9fe7eb-a421-45e6-a05d-3e45dd184f13 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:57.681660 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6f1d16-80e8-4c4f-82f0-c3fcea72768d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:57.682629 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f1d16-80e8-4c4f-82f0-c3fcea72768d admin admin] REQUEST_METHOD: `PUT` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:57.682999 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f1d16-80e8-4c4f-82f0-c3fcea72768d admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:57.683381 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f1d16-80e8-4c4f-82f0-c3fcea72768d admin admin] PATH_INFO: `/v3/projects/fbff69648dc841b2ac70cf0e4b1dd53b/users/a7bb63e817354088b9e975d83572b276/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:57.684015 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2001421-3747-435f-b04d-4789f073953c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:57.684729 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2001421-3747-435f-b04d-4789f073953c service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:57.685144 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2001421-3747-435f-b04d-4789f073953c service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:57.695728 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2001421-3747-435f-b04d-4789f073953c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:57.695728 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-f2001421-3747-435f-b04d-4789f073953c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:57.704571 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6f1d16-80e8-4c4f-82f0-c3fcea72768d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbff69648dc841b2ac70cf0e4b1dd53b, user_id=a7bb63e817354088b9e975d83572b276, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:57.710107 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6f1d16-80e8-4c4f-82f0-c3fcea72768d admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:57.742237 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1121/2247] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 01:01:57 2022] PUT /identity/v3/projects/fbff69648dc841b2ac70cf0e4b1dd53b/users/a7bb63e817354088b9e975d83572b276/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:01:57.745284 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161d3dd2-faf9-4071-9ca6-795df20d6870 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:57.746720 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161d3dd2-faf9-4071-9ca6-795df20d6870 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:57.746720 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161d3dd2-faf9-4071-9ca6-795df20d6870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:57.790655 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-161d3dd2-faf9-4071-9ca6-795df20d6870 None None] MFA Rules not processed for user `a7bb63e817354088b9e975d83572b276`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:01:57.792769 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-161d3dd2-faf9-4071-9ca6-795df20d6870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:57.881026 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2001421-3747-435f-b04d-4789f073953c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:57.882977 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2001421-3747-435f-b04d-4789f073953c service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:57.907556 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1122/2248] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:01:57 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:01:57.907857 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1127/2249] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:01:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:01:57.907997 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161d3dd2-faf9-4071-9ca6-795df20d6870 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:57.907997 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-161d3dd2-faf9-4071-9ca6-795df20d6870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:57.947269 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2001421-3747-435f-b04d-4789f073953c service neutron] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:01:57.948904 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-f2001421-3747-435f-b04d-4789f073953c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:01:57.968555 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2001421-3747-435f-b04d-4789f073953c service neutron] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:58.097085 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161d3dd2-faf9-4071-9ca6-795df20d6870 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:01:58.117164 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c090651-de7d-40c2-a2d6-74160dfcd0fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:58.118184 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c090651-de7d-40c2-a2d6-74160dfcd0fa service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:58.122084 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c090651-de7d-40c2-a2d6-74160dfcd0fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:58.122719 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c090651-de7d-40c2-a2d6-74160dfcd0fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:58.154958 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a119f2d4-cad4-4019-a55b-562f43c5a609 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:01:58.156653 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119f2d4-cad4-4019-a55b-562f43c5a609 service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:01:58.156937 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119f2d4-cad4-4019-a55b-562f43c5a609 service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:01:58.157210 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119f2d4-cad4-4019-a55b-562f43c5a609 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:01:58.169300 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:01:58.179055 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a119f2d4-cad4-4019-a55b-562f43c5a609 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:58.182633 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a119f2d4-cad4-4019-a55b-562f43c5a609 service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:58.211116 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1128/2250] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:01:57 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:01:58.249252 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c090651-de7d-40c2-a2d6-74160dfcd0fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:01:58.250732 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c090651-de7d-40c2-a2d6-74160dfcd0fa service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:01:58.273433 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1123/2251] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:01:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:02:08.198937 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=54 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:02:08.269735 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=19 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:02:09.886672 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a119f2d4-cad4-4019-a55b-562f43c5a609 service neutron] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:09.897029 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a119f2d4-cad4-4019-a55b-562f43c5a609 service neutron] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:09.912229 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd06c6e-71e3-4ecc-98b3-63a847a85aa2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:09.913132 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd06c6e-71e3-4ecc-98b3-63a847a85aa2 service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:09.913599 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd06c6e-71e3-4ecc-98b3-63a847a85aa2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:09.914023 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd06c6e-71e3-4ecc-98b3-63a847a85aa2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:10.040234 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd06c6e-71e3-4ecc-98b3-63a847a85aa2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:10.042044 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd06c6e-71e3-4ecc-98b3-63a847a85aa2 service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:10.053565 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1129/2252] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:02:09 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:02:20.052119 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=30 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:02:23.617308 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c090651-de7d-40c2-a2d6-74160dfcd0fa service neutron] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:23.618915 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-7c090651-de7d-40c2-a2d6-74160dfcd0fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:23.801267 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c090651-de7d-40c2-a2d6-74160dfcd0fa service neutron] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:23.818206 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abc106f-170f-4a98-b0a1-727844964fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:23.819021 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc106f-170f-4a98-b0a1-727844964fda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:23.819431 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc106f-170f-4a98-b0a1-727844964fda admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:23.819814 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc106f-170f-4a98-b0a1-727844964fda admin admin] PATH_INFO: `/v3/users/b039629a6d084b17a44fe6934e1aaa33` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:23.824287 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abc106f-170f-4a98-b0a1-727844964fda admin admin] RBAC: Authorizing `identity:delete_user(user_id=b039629a6d084b17a44fe6934e1aaa33)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:23.826928 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abc106f-170f-4a98-b0a1-727844964fda admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:23.925167 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-8abc106f-170f-4a98-b0a1-727844964fda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b039629a6d084b17a44fe6934e1aaa33'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:23.947189 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-8abc106f-170f-4a98-b0a1-727844964fda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b039629a6d084b17a44fe6934e1aaa33'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:23.971880 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-8abc106f-170f-4a98-b0a1-727844964fda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b039629a6d084b17a44fe6934e1aaa33'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:23.972635 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-8abc106f-170f-4a98-b0a1-727844964fda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b039629a6d084b17a44fe6934e1aaa33'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:23.973253 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-8abc106f-170f-4a98-b0a1-727844964fda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b039629a6d084b17a44fe6934e1aaa33'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:23.995208 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1124/2253] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 01:02:23 2022] DELETE /identity/v3/users/b039629a6d084b17a44fe6934e1aaa33 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:02:23.999104 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f840832-22fb-4d5f-a697-e5352ee0337d None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:23.999854 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f840832-22fb-4d5f-a697-e5352ee0337d None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:24.000448 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f840832-22fb-4d5f-a697-e5352ee0337d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:24.060246 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-1f840832-22fb-4d5f-a697-e5352ee0337d None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:02:24.063192 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-1f840832-22fb-4d5f-a697-e5352ee0337d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:24.202946 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1130/2254] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:02:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:02:24.260948 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abc106f-170f-4a98-b0a1-727844964fda admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:24.264992 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-8abc106f-170f-4a98-b0a1-727844964fda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:24.357050 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abc106f-170f-4a98-b0a1-727844964fda admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:24.367001 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b4f930-de8d-4dbd-82cd-4a6d720a66df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:24.367849 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b4f930-de8d-4dbd-82cd-4a6d720a66df service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:24.368309 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b4f930-de8d-4dbd-82cd-4a6d720a66df service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:24.368721 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b4f930-de8d-4dbd-82cd-4a6d720a66df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:24.404552 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b4f930-de8d-4dbd-82cd-4a6d720a66df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:24.406429 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b4f930-de8d-4dbd-82cd-4a6d720a66df service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:24.420944 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1125/2255] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:02:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:02:25.457553 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f840832-22fb-4d5f-a697-e5352ee0337d None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:25.459207 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-1f840832-22fb-4d5f-a697-e5352ee0337d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:25.486161 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f840832-22fb-4d5f-a697-e5352ee0337d None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:25.513603 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a3181f-fc8d-4755-be50-9b326e9b888c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:25.515118 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3181f-fc8d-4755-be50-9b326e9b888c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:25.515884 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3181f-fc8d-4755-be50-9b326e9b888c admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:25.516363 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a3181f-fc8d-4755-be50-9b326e9b888c admin admin] PATH_INFO: `/v3/projects/8960f53cd115440fa4545d54ad9eb26f` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:25.519145 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a3181f-fc8d-4755-be50-9b326e9b888c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8960f53cd115440fa4545d54ad9eb26f)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:25.521937 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a3181f-fc8d-4755-be50-9b326e9b888c admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:25.622319 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-e1a3181f-fc8d-4755-be50-9b326e9b888c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8960f53cd115440fa4545d54ad9eb26f', 'request_id': 'req-e1a3181f-fc8d-4755-be50-9b326e9b888c'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:25.629554 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-e1a3181f-fc8d-4755-be50-9b326e9b888c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8960f53cd115440fa4545d54ad9eb26f', 'request_id': 'req-e1a3181f-fc8d-4755-be50-9b326e9b888c'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:25.643785 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-e1a3181f-fc8d-4755-be50-9b326e9b888c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8960f53cd115440fa4545d54ad9eb26f', 'request_id': 'req-e1a3181f-fc8d-4755-be50-9b326e9b888c'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:25.664466 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-e1a3181f-fc8d-4755-be50-9b326e9b888c admin admin] The token cache is being invalidate because project 8960f53cd115440fa4545d54ad9eb26f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81807) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:02:25.664905 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-e1a3181f-fc8d-4755-be50-9b326e9b888c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:25.665688 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-e1a3181f-fc8d-4755-be50-9b326e9b888c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:25.667484 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1131/2256] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 01:02:25 2022] DELETE /identity/v3/projects/8960f53cd115440fa4545d54ad9eb26f => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:02:25.675116 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eef0e8-4d00-4399-8a8d-65b7abf21f0e None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:25.675581 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eef0e8-4d00-4399-8a8d-65b7abf21f0e None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:25.675835 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eef0e8-4d00-4399-8a8d-65b7abf21f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:25.700389 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-08eef0e8-4d00-4399-8a8d-65b7abf21f0e None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:02:25.702010 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-08eef0e8-4d00-4399-8a8d-65b7abf21f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:25.722988 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:02:25.777861 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1126/2257] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:02:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:02:25.785942 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7febd31b-407f-4b62-9b27-be0a41a29a92 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:25.786273 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7febd31b-407f-4b62-9b27-be0a41a29a92 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:25.786635 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7febd31b-407f-4b62-9b27-be0a41a29a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:25.807842 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-7febd31b-407f-4b62-9b27-be0a41a29a92 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:02:25.809061 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-7febd31b-407f-4b62-9b27-be0a41a29a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:25.828193 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1132/2258] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:02:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:02:25.829131 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eef0e8-4d00-4399-8a8d-65b7abf21f0e None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:25.840851 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eef0e8-4d00-4399-8a8d-65b7abf21f0e None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:25.846009 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40c990a-1d9f-4d82-808d-7eb42fd863ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:25.846944 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c990a-1d9f-4d82-808d-7eb42fd863ab admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:25.846944 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c990a-1d9f-4d82-808d-7eb42fd863ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:25.847193 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c990a-1d9f-4d82-808d-7eb42fd863ab admin admin] PATH_INFO: `/v3/domains` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:25.847872 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40c990a-1d9f-4d82-808d-7eb42fd863ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:02:25.848637 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40c990a-1d9f-4d82-808d-7eb42fd863ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:25.849857 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40c990a-1d9f-4d82-808d-7eb42fd863ab admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:25.869978 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1127/2259] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 01:02:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:02:25.870752 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7febd31b-407f-4b62-9b27-be0a41a29a92 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:25.881434 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7febd31b-407f-4b62-9b27-be0a41a29a92 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:25.887461 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0221747-d662-40e4-bcdb-df4eb0878e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:25.888169 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0221747-d662-40e4-bcdb-df4eb0878e9e admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:25.888450 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0221747-d662-40e4-bcdb-df4eb0878e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:25.888726 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0221747-d662-40e4-bcdb-df4eb0878e9e admin admin] PATH_INFO: `/v3/projects` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:25.889661 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0221747-d662-40e4-bcdb-df4eb0878e9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:25.891814 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0221747-d662-40e4-bcdb-df4eb0878e9e admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:25.963710 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1133/2260] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 01:02:25 2022] POST /identity/v3/projects => generated 379 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:02:25.966136 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40c990a-1d9f-4d82-808d-7eb42fd863ab admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:25.999381 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40c990a-1d9f-4d82-808d-7eb42fd863ab admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:26.118674 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daede290-defe-4d81-b48d-a51f9a3d9a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:26.119774 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daede290-defe-4d81-b48d-a51f9a3d9a85 admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:26.119998 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daede290-defe-4d81-b48d-a51f9a3d9a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:26.120343 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daede290-defe-4d81-b48d-a51f9a3d9a85 admin admin] PATH_INFO: `/v3/users` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:26.121283 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daede290-defe-4d81-b48d-a51f9a3d9a85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:26.123611 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daede290-defe-4d81-b48d-a51f9a3d9a85 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:26.185432 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1128/2261] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 01:02:25 2022] POST /identity/v3/users => generated 290 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:02:26.186488 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0221747-d662-40e4-bcdb-df4eb0878e9e admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:26.200552 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0221747-d662-40e4-bcdb-df4eb0878e9e admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:26.207774 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55218c85-f58c-436f-9d53-e614da7cce1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:26.209023 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55218c85-f58c-436f-9d53-e614da7cce1d admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:26.209656 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55218c85-f58c-436f-9d53-e614da7cce1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:26.210233 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55218c85-f58c-436f-9d53-e614da7cce1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:26.211789 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55218c85-f58c-436f-9d53-e614da7cce1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:26.214515 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55218c85-f58c-436f-9d53-e614da7cce1d admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:26.235024 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daede290-defe-4d81-b48d-a51f9a3d9a85 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:26.241620 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1134/2262] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:02:26.255602 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daede290-defe-4d81-b48d-a51f9a3d9a85 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:26.261582 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1ba7d6-3ae8-42e4-9449-fc490c197406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:26.262354 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ba7d6-3ae8-42e4-9449-fc490c197406 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:26.262730 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ba7d6-3ae8-42e4-9449-fc490c197406 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:26.263130 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1ba7d6-3ae8-42e4-9449-fc490c197406 admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:26.263953 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1ba7d6-3ae8-42e4-9449-fc490c197406 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:26.265671 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1ba7d6-3ae8-42e4-9449-fc490c197406 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:26.286134 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1129/2263] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:02:26.290784 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55218c85-f58c-436f-9d53-e614da7cce1d admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:26.310155 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55218c85-f58c-436f-9d53-e614da7cce1d admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:26.326534 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d365da-749a-4c77-b7b0-c42c6bf084cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:26.328087 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d365da-749a-4c77-b7b0-c42c6bf084cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:26.328609 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d365da-749a-4c77-b7b0-c42c6bf084cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:26.329788 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d365da-749a-4c77-b7b0-c42c6bf084cb admin admin] PATH_INFO: `/v3/projects/83e9d430d57a409d921420b1211ebb8b/users/b44e7109127a468aa2574c23fc9807b2/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:26.360052 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d365da-749a-4c77-b7b0-c42c6bf084cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=83e9d430d57a409d921420b1211ebb8b, user_id=b44e7109127a468aa2574c23fc9807b2, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:26.363971 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d365da-749a-4c77-b7b0-c42c6bf084cb admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:26.391254 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1135/2264] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 01:02:26 2022] PUT /identity/v3/projects/83e9d430d57a409d921420b1211ebb8b/users/b44e7109127a468aa2574c23fc9807b2/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:02:26.396451 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ecc90-614b-4f2b-9c6a-a358a1c4b91a None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:26.396735 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ecc90-614b-4f2b-9c6a-a358a1c4b91a None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:26.397013 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ecc90-614b-4f2b-9c6a-a358a1c4b91a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:26.433028 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-8e3ecc90-614b-4f2b-9c6a-a358a1c4b91a None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:02:26.434558 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-8e3ecc90-614b-4f2b-9c6a-a358a1c4b91a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:26.570175 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1130/2265] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:02:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:02:26.589856 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d365da-749a-4c77-b7b0-c42c6bf084cb admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:26.592198 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-55d365da-749a-4c77-b7b0-c42c6bf084cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:26.633456 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:02:26.736983 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d365da-749a-4c77-b7b0-c42c6bf084cb admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:26.750492 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738eebb7-6160-4da2-92b4-6ecd1c264d5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:26.753133 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738eebb7-6160-4da2-92b4-6ecd1c264d5b service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:26.753692 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738eebb7-6160-4da2-92b4-6ecd1c264d5b service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:26.754121 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738eebb7-6160-4da2-92b4-6ecd1c264d5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:26.769172 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738eebb7-6160-4da2-92b4-6ecd1c264d5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:26.771282 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738eebb7-6160-4da2-92b4-6ecd1c264d5b service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:26.787164 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1136/2266] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:02:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:02:28.616952 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4cc919-f0d4-425a-b1dc-08a68b88721b None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:28.617462 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4cc919-f0d4-425a-b1dc-08a68b88721b None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:28.617943 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4cc919-f0d4-425a-b1dc-08a68b88721b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:28.641766 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-8d4cc919-f0d4-425a-b1dc-08a68b88721b None None] MFA Rules not processed for user `1f6108050e934edf922491f983d9c9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:02:28.643474 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-8d4cc919-f0d4-425a-b1dc-08a68b88721b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:28.672046 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:02:28.708353 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1131/2267] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:02:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:02:36.778892 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=17 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:02:38.703011 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=12 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:02:40.982666 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738eebb7-6160-4da2-92b4-6ecd1c264d5b service neutron] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:40.985072 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-738eebb7-6160-4da2-92b4-6ecd1c264d5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:41.013186 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738eebb7-6160-4da2-92b4-6ecd1c264d5b service neutron] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:41.028726 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b442f472-4d64-4e7e-8d22-d2ffeee3b4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:41.029937 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442f472-4d64-4e7e-8d22-d2ffeee3b4ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:41.030236 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442f472-4d64-4e7e-8d22-d2ffeee3b4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:41.030901 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b442f472-4d64-4e7e-8d22-d2ffeee3b4ca admin admin] PATH_INFO: `/v3/users/a7bb63e817354088b9e975d83572b276` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:41.032441 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b442f472-4d64-4e7e-8d22-d2ffeee3b4ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7bb63e817354088b9e975d83572b276)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:41.045755 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b442f472-4d64-4e7e-8d22-d2ffeee3b4ca admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:41.169327 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-b442f472-4d64-4e7e-8d22-d2ffeee3b4ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7bb63e817354088b9e975d83572b276'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:41.211275 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-b442f472-4d64-4e7e-8d22-d2ffeee3b4ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7bb63e817354088b9e975d83572b276'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:41.226050 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-b442f472-4d64-4e7e-8d22-d2ffeee3b4ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7bb63e817354088b9e975d83572b276'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:41.228183 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-b442f472-4d64-4e7e-8d22-d2ffeee3b4ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7bb63e817354088b9e975d83572b276'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:41.233405 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-b442f472-4d64-4e7e-8d22-d2ffeee3b4ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7bb63e817354088b9e975d83572b276'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:41.251578 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1137/2268] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 01:02:40 2022] DELETE /identity/v3/users/a7bb63e817354088b9e975d83572b276 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:02:41.257239 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5397d2f-6ed7-489c-b683-afeac42d2c9e None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:41.258152 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5397d2f-6ed7-489c-b683-afeac42d2c9e None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:41.258806 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5397d2f-6ed7-489c-b683-afeac42d2c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:41.300097 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-b5397d2f-6ed7-489c-b683-afeac42d2c9e None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:02:41.302163 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-b5397d2f-6ed7-489c-b683-afeac42d2c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:41.427848 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1132/2269] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:02:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:02:41.506023 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b442f472-4d64-4e7e-8d22-d2ffeee3b4ca admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:41.508401 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-b442f472-4d64-4e7e-8d22-d2ffeee3b4ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:41.580405 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b442f472-4d64-4e7e-8d22-d2ffeee3b4ca admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:41.583900 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c13fb0-1eb2-4ad1-b589-9547c399aa65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:41.584537 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c13fb0-1eb2-4ad1-b589-9547c399aa65 service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:41.584818 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c13fb0-1eb2-4ad1-b589-9547c399aa65 service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:41.585090 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c13fb0-1eb2-4ad1-b589-9547c399aa65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:41.595913 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c13fb0-1eb2-4ad1-b589-9547c399aa65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:41.597410 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c13fb0-1eb2-4ad1-b589-9547c399aa65 service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:41.609658 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1138/2270] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:02:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:02:42.092820 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899551c-e8a0-4809-91d1-e67aef75f2ab None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:42.093196 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899551c-e8a0-4809-91d1-e67aef75f2ab None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:42.093524 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899551c-e8a0-4809-91d1-e67aef75f2ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:42.141492 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-b899551c-e8a0-4809-91d1-e67aef75f2ab None None] MFA Rules not processed for user `b44e7109127a468aa2574c23fc9807b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:02:42.142724 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-b899551c-e8a0-4809-91d1-e67aef75f2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:42.225599 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1133/2271] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:02:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:02:42.226576 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c13fb0-1eb2-4ad1-b589-9547c399aa65 service neutron] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:42.228199 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-a2c13fb0-1eb2-4ad1-b589-9547c399aa65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:42.241948 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c13fb0-1eb2-4ad1-b589-9547c399aa65 service neutron] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:42.248315 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac56dc59-1482-47e7-a5d8-66b8be3e76e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:42.248906 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56dc59-1482-47e7-a5d8-66b8be3e76e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:42.249187 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56dc59-1482-47e7-a5d8-66b8be3e76e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:42.249457 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac56dc59-1482-47e7-a5d8-66b8be3e76e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:42.250130 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac56dc59-1482-47e7-a5d8-66b8be3e76e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:42.252092 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac56dc59-1482-47e7-a5d8-66b8be3e76e9 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:42.283811 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1139/2272] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 01:02:42 2022] POST /identity/v3/projects => generated 379 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:02:42.288192 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899551c-e8a0-4809-91d1-e67aef75f2ab None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:42.304259 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899551c-e8a0-4809-91d1-e67aef75f2ab None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:42.421125 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b433cf-a78d-4be0-ba5b-9abf49008ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:42.422237 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b433cf-a78d-4be0-ba5b-9abf49008ff1 admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:42.422649 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b433cf-a78d-4be0-ba5b-9abf49008ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:42.422853 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b433cf-a78d-4be0-ba5b-9abf49008ff1 admin admin] PATH_INFO: `/v3/users` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:42.423510 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b433cf-a78d-4be0-ba5b-9abf49008ff1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:42.425656 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b433cf-a78d-4be0-ba5b-9abf49008ff1 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:42.456725 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1134/2273] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 01:02:42 2022] POST /identity/v3/users => generated 296 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:02:42.460914 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac56dc59-1482-47e7-a5d8-66b8be3e76e9 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:42.478546 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac56dc59-1482-47e7-a5d8-66b8be3e76e9 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:42.503214 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147e1eeb-53bb-46b9-a259-97802bb75dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:42.504705 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e1eeb-53bb-46b9-a259-97802bb75dce admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:42.505150 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e1eeb-53bb-46b9-a259-97802bb75dce admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:42.505577 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e1eeb-53bb-46b9-a259-97802bb75dce admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:42.506743 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147e1eeb-53bb-46b9-a259-97802bb75dce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:42.508720 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147e1eeb-53bb-46b9-a259-97802bb75dce admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:42.525831 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1140/2274] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:02:42 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:02:42.530644 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b433cf-a78d-4be0-ba5b-9abf49008ff1 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:42.543099 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b433cf-a78d-4be0-ba5b-9abf49008ff1 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:42.549319 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff95bbe-1bdb-407c-afe3-03130559204a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:42.550341 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff95bbe-1bdb-407c-afe3-03130559204a admin admin] REQUEST_METHOD: `PUT` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:42.550864 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff95bbe-1bdb-407c-afe3-03130559204a admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:42.551431 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff95bbe-1bdb-407c-afe3-03130559204a admin admin] PATH_INFO: `/v3/projects/a7eb706f2e594a4b9d5f23c28a944e5c/users/25f4c98243da409b94a51085b05eac24/roles/2e4889bb71f9434392c0baba59f2534e` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:42.572596 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff95bbe-1bdb-407c-afe3-03130559204a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7eb706f2e594a4b9d5f23c28a944e5c, user_id=25f4c98243da409b94a51085b05eac24, role_id=2e4889bb71f9434392c0baba59f2534e)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:42.577283 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff95bbe-1bdb-407c-afe3-03130559204a admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:42.581334 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:02:42.603390 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1135/2275] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 01:02:42 2022] PUT /identity/v3/projects/a7eb706f2e594a4b9d5f23c28a944e5c/users/25f4c98243da409b94a51085b05eac24/roles/2e4889bb71f9434392c0baba59f2534e => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:02:42.607964 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147e1eeb-53bb-46b9-a259-97802bb75dce admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:42.624915 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147e1eeb-53bb-46b9-a259-97802bb75dce admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:42.689152 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:02:42.714339 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff95bbe-1bdb-407c-afe3-03130559204a admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:42.717758 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-2ff95bbe-1bdb-407c-afe3-03130559204a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:42.733351 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e9fe6c-2050-48e7-ac91-5141cea0c582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:42.736069 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e9fe6c-2050-48e7-ac91-5141cea0c582 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:42.737134 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e9fe6c-2050-48e7-ac91-5141cea0c582 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:42.738656 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e9fe6c-2050-48e7-ac91-5141cea0c582 admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:42.739948 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e9fe6c-2050-48e7-ac91-5141cea0c582 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:42.745432 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e9fe6c-2050-48e7-ac91-5141cea0c582 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:42.774769 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1141/2276] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:02:42 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:02:42.776237 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e9fe6c-2050-48e7-ac91-5141cea0c582 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:42.788669 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e9fe6c-2050-48e7-ac91-5141cea0c582 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:42.795598 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a0f584-3592-4713-bbe8-27b0a55c195f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:42.796530 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a0f584-3592-4713-bbe8-27b0a55c195f admin admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:42.797210 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a0f584-3592-4713-bbe8-27b0a55c195f admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:42.797626 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a0f584-3592-4713-bbe8-27b0a55c195f admin admin] PATH_INFO: `/v3/projects/a7eb706f2e594a4b9d5f23c28a944e5c/users/25f4c98243da409b94a51085b05eac24/roles/2e4889bb71f9434392c0baba59f2534e` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:42.801475 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a0f584-3592-4713-bbe8-27b0a55c195f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7eb706f2e594a4b9d5f23c28a944e5c, user_id=25f4c98243da409b94a51085b05eac24, role_id=2e4889bb71f9434392c0baba59f2534e)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:42.807122 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a0f584-3592-4713-bbe8-27b0a55c195f admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:42.828065 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1142/2277] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 01:02:42 2022] PUT /identity/v3/projects/a7eb706f2e594a4b9d5f23c28a944e5c/users/25f4c98243da409b94a51085b05eac24/roles/2e4889bb71f9434392c0baba59f2534e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:02:42.870872 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff95bbe-1bdb-407c-afe3-03130559204a admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:42.961898 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398b72a5-a551-4491-b28a-0a52013ecf1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:42.962565 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398b72a5-a551-4491-b28a-0a52013ecf1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:42.962843 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398b72a5-a551-4491-b28a-0a52013ecf1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:42.963300 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398b72a5-a551-4491-b28a-0a52013ecf1d admin admin] PATH_INFO: `/v3/projects/fbff69648dc841b2ac70cf0e4b1dd53b` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:42.964504 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398b72a5-a551-4491-b28a-0a52013ecf1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbff69648dc841b2ac70cf0e4b1dd53b)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:42.967455 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398b72a5-a551-4491-b28a-0a52013ecf1d admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:43.032298 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-398b72a5-a551-4491-b28a-0a52013ecf1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbff69648dc841b2ac70cf0e4b1dd53b', 'request_id': 'req-398b72a5-a551-4491-b28a-0a52013ecf1d'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:43.044595 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-398b72a5-a551-4491-b28a-0a52013ecf1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbff69648dc841b2ac70cf0e4b1dd53b', 'request_id': 'req-398b72a5-a551-4491-b28a-0a52013ecf1d'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:43.060530 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-398b72a5-a551-4491-b28a-0a52013ecf1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbff69648dc841b2ac70cf0e4b1dd53b', 'request_id': 'req-398b72a5-a551-4491-b28a-0a52013ecf1d'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:43.082429 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-398b72a5-a551-4491-b28a-0a52013ecf1d admin admin] The token cache is being invalidate because project fbff69648dc841b2ac70cf0e4b1dd53b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81808) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:02:43.082888 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-398b72a5-a551-4491-b28a-0a52013ecf1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:43.085025 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-398b72a5-a551-4491-b28a-0a52013ecf1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:43.091296 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1136/2278] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 01:02:42 2022] DELETE /identity/v3/projects/fbff69648dc841b2ac70cf0e4b1dd53b => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:02:43.092603 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f4252-a816-4f4e-8ea3-be72abeb631b None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:43.093107 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f4252-a816-4f4e-8ea3-be72abeb631b None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:43.093535 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4f4252-a816-4f4e-8ea3-be72abeb631b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:43.134098 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-8d4f4252-a816-4f4e-8ea3-be72abeb631b None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:02:43.135543 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-8d4f4252-a816-4f4e-8ea3-be72abeb631b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:43.227803 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1143/2279] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:02:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:02:43.236804 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f4435-6ac6-4f3e-8cee-aa09b80c3eba None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:43.237211 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f4435-6ac6-4f3e-8cee-aa09b80c3eba None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:43.237985 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f4435-6ac6-4f3e-8cee-aa09b80c3eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:43.261552 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-976f4435-6ac6-4f3e-8cee-aa09b80c3eba None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:02:43.262876 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-976f4435-6ac6-4f3e-8cee-aa09b80c3eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:43.276963 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1137/2280] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:02:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:02:43.281736 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4f4252-a816-4f4e-8ea3-be72abeb631b None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:43.299867 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4f4252-a816-4f4e-8ea3-be72abeb631b None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:43.305663 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b331019e-842c-4450-890e-938a378b8c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:43.306300 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331019e-842c-4450-890e-938a378b8c92 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:43.306580 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331019e-842c-4450-890e-938a378b8c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:43.306942 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331019e-842c-4450-890e-938a378b8c92 admin admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:43.307792 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b331019e-842c-4450-890e-938a378b8c92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:02:43.308095 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b331019e-842c-4450-890e-938a378b8c92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:43.309933 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b331019e-842c-4450-890e-938a378b8c92 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:43.333852 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f4435-6ac6-4f3e-8cee-aa09b80c3eba None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:43.335533 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1144/2281] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 01:02:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:02:43.351240 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f4435-6ac6-4f3e-8cee-aa09b80c3eba None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:43.360119 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ebb566-0257-4b7b-9387-c19542071223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:43.375007 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ebb566-0257-4b7b-9387-c19542071223 admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:43.375468 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ebb566-0257-4b7b-9387-c19542071223 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:43.376004 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ebb566-0257-4b7b-9387-c19542071223 admin admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:43.376839 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ebb566-0257-4b7b-9387-c19542071223 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:43.379093 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ebb566-0257-4b7b-9387-c19542071223 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:43.434576 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1138/2282] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 01:02:43 2022] POST /identity/v3/projects => generated 373 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:02:43.435889 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b331019e-842c-4450-890e-938a378b8c92 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:43.453155 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b331019e-842c-4450-890e-938a378b8c92 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:43.577140 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b392f46-1bc9-4ddc-950b-c67b286f4bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:43.577776 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b392f46-1bc9-4ddc-950b-c67b286f4bc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:43.578059 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b392f46-1bc9-4ddc-950b-c67b286f4bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:43.578650 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b392f46-1bc9-4ddc-950b-c67b286f4bc7 admin admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:43.579318 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b392f46-1bc9-4ddc-950b-c67b286f4bc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:43.582066 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b392f46-1bc9-4ddc-950b-c67b286f4bc7 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:43.633078 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1145/2283] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 01:02:43 2022] POST /identity/v3/users => generated 287 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:02:43.637222 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ebb566-0257-4b7b-9387-c19542071223 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:43.647175 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:02:43.654188 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ebb566-0257-4b7b-9387-c19542071223 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:43.663318 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b06a0a-f508-4325-863b-5e9aa0d955cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:43.664868 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b06a0a-f508-4325-863b-5e9aa0d955cd admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:43.665879 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b06a0a-f508-4325-863b-5e9aa0d955cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:43.666400 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b06a0a-f508-4325-863b-5e9aa0d955cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:43.667879 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b06a0a-f508-4325-863b-5e9aa0d955cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:43.671771 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b06a0a-f508-4325-863b-5e9aa0d955cd admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:43.689195 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1139/2284] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:02:43.694694 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b392f46-1bc9-4ddc-950b-c67b286f4bc7 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:43.709651 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b392f46-1bc9-4ddc-950b-c67b286f4bc7 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:43.725296 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69e45fa-7170-4897-a07e-9f7cc762bfa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:43.726383 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e45fa-7170-4897-a07e-9f7cc762bfa4 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:43.726806 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e45fa-7170-4897-a07e-9f7cc762bfa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:43.727491 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e45fa-7170-4897-a07e-9f7cc762bfa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:43.729381 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69e45fa-7170-4897-a07e-9f7cc762bfa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:43.732525 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69e45fa-7170-4897-a07e-9f7cc762bfa4 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:43.751131 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1146/2285] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:02:43.755490 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b06a0a-f508-4325-863b-5e9aa0d955cd admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:43.772302 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b06a0a-f508-4325-863b-5e9aa0d955cd admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:43.784275 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a890bba6-7071-4880-874d-4da837d219c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:43.785942 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890bba6-7071-4880-874d-4da837d219c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:43.786580 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890bba6-7071-4880-874d-4da837d219c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:43.787081 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890bba6-7071-4880-874d-4da837d219c8 admin admin] PATH_INFO: `/v3/projects/8bbf1053efa54b9099e632d956cbd1d0/users/804819a9cecf492880df53e3a5e2cdf8/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:43.810176 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a890bba6-7071-4880-874d-4da837d219c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bbf1053efa54b9099e632d956cbd1d0, user_id=804819a9cecf492880df53e3a5e2cdf8, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:43.814326 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a890bba6-7071-4880-874d-4da837d219c8 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:43.837675 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1140/2286] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 01:02:43 2022] PUT /identity/v3/projects/8bbf1053efa54b9099e632d956cbd1d0/users/804819a9cecf492880df53e3a5e2cdf8/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:02:43.849240 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee5e5d-79f4-4e86-b3d8-0beba699ae6f None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:43.849923 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee5e5d-79f4-4e86-b3d8-0beba699ae6f None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:43.850514 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee5e5d-79f4-4e86-b3d8-0beba699ae6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:43.894434 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-79ee5e5d-79f4-4e86-b3d8-0beba699ae6f None None] MFA Rules not processed for user `804819a9cecf492880df53e3a5e2cdf8`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:02:43.897302 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-79ee5e5d-79f4-4e86-b3d8-0beba699ae6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:43.924037 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:02:43.998263 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1147/2287] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:02:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:02:44.017255 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a890bba6-7071-4880-874d-4da837d219c8 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:44.027294 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-a890bba6-7071-4880-874d-4da837d219c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:44.139913 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a890bba6-7071-4880-874d-4da837d219c8 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:44.146736 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae8b30-daef-4e20-8019-3ba35fef2b3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:44.147726 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae8b30-daef-4e20-8019-3ba35fef2b3f service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:44.148245 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae8b30-daef-4e20-8019-3ba35fef2b3f service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:44.148700 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae8b30-daef-4e20-8019-3ba35fef2b3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:44.161154 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae8b30-daef-4e20-8019-3ba35fef2b3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:44.163350 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae8b30-daef-4e20-8019-3ba35fef2b3f service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:44.176500 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1141/2288] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:02:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:02:45.596866 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ee5e5d-79f4-4e86-b3d8-0beba699ae6f None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:45.598942 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-79ee5e5d-79f4-4e86-b3d8-0beba699ae6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:45.728378 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ee5e5d-79f4-4e86-b3d8-0beba699ae6f None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:45.741386 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b6d397-0cbb-47a9-a07c-18ffe21ed8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:45.742278 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b6d397-0cbb-47a9-a07c-18ffe21ed8fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:45.742561 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b6d397-0cbb-47a9-a07c-18ffe21ed8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:45.742919 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b6d397-0cbb-47a9-a07c-18ffe21ed8fb admin admin] PATH_INFO: `/v3/users/9abd234dc00e465981610912c7be6c5e` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:45.745715 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b6d397-0cbb-47a9-a07c-18ffe21ed8fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=9abd234dc00e465981610912c7be6c5e)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:45.747941 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b6d397-0cbb-47a9-a07c-18ffe21ed8fb admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:45.852382 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-d3b6d397-0cbb-47a9-a07c-18ffe21ed8fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9abd234dc00e465981610912c7be6c5e'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:45.883929 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-d3b6d397-0cbb-47a9-a07c-18ffe21ed8fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9abd234dc00e465981610912c7be6c5e'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:45.894586 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-d3b6d397-0cbb-47a9-a07c-18ffe21ed8fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9abd234dc00e465981610912c7be6c5e'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:45.895684 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-d3b6d397-0cbb-47a9-a07c-18ffe21ed8fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9abd234dc00e465981610912c7be6c5e'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:45.896605 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-d3b6d397-0cbb-47a9-a07c-18ffe21ed8fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9abd234dc00e465981610912c7be6c5e'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:45.916712 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1148/2289] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 01:02:45 2022] DELETE /identity/v3/users/9abd234dc00e465981610912c7be6c5e => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:02:45.922817 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da61e09-0af2-49cb-9236-ba5338c1a787 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:45.923359 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da61e09-0af2-49cb-9236-ba5338c1a787 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:45.923692 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da61e09-0af2-49cb-9236-ba5338c1a787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:45.957532 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-1da61e09-0af2-49cb-9236-ba5338c1a787 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:02:45.961983 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-1da61e09-0af2-49cb-9236-ba5338c1a787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:46.075748 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1142/2290] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:02:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:02:46.116177 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b6d397-0cbb-47a9-a07c-18ffe21ed8fb admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:46.117940 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-d3b6d397-0cbb-47a9-a07c-18ffe21ed8fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:46.225521 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:02:46.236845 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b6d397-0cbb-47a9-a07c-18ffe21ed8fb admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:46.244705 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0971b41d-8d5e-46e5-b7d9-561661f03d12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:46.246402 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971b41d-8d5e-46e5-b7d9-561661f03d12 service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:46.246990 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971b41d-8d5e-46e5-b7d9-561661f03d12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:46.247704 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971b41d-8d5e-46e5-b7d9-561661f03d12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:46.266748 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0971b41d-8d5e-46e5-b7d9-561661f03d12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:46.268424 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0971b41d-8d5e-46e5-b7d9-561661f03d12 service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:46.281241 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1149/2291] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:02:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:02:47.162334 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da61e09-0af2-49cb-9236-ba5338c1a787 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:47.164056 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-1da61e09-0af2-49cb-9236-ba5338c1a787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:47.179068 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da61e09-0af2-49cb-9236-ba5338c1a787 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:47.184712 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b428ce-f8cd-4be1-8ce2-d1155e9eef99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:47.185743 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b428ce-f8cd-4be1-8ce2-d1155e9eef99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:47.186226 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b428ce-f8cd-4be1-8ce2-d1155e9eef99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:47.186709 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b428ce-f8cd-4be1-8ce2-d1155e9eef99 admin admin] PATH_INFO: `/v3/users/e56eaafe892b4047b558861437a84816` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:47.188259 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b428ce-f8cd-4be1-8ce2-d1155e9eef99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e56eaafe892b4047b558861437a84816)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:47.190818 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b428ce-f8cd-4be1-8ce2-d1155e9eef99 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:47.280776 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-f7b428ce-f8cd-4be1-8ce2-d1155e9eef99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e56eaafe892b4047b558861437a84816'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:47.299693 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-f7b428ce-f8cd-4be1-8ce2-d1155e9eef99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e56eaafe892b4047b558861437a84816'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:47.319875 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:02:47.328586 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-f7b428ce-f8cd-4be1-8ce2-d1155e9eef99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e56eaafe892b4047b558861437a84816'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:47.329610 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-f7b428ce-f8cd-4be1-8ce2-d1155e9eef99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e56eaafe892b4047b558861437a84816'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:47.330366 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-f7b428ce-f8cd-4be1-8ce2-d1155e9eef99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e56eaafe892b4047b558861437a84816'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:47.351392 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1143/2292] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 01:02:47 2022] DELETE /identity/v3/users/e56eaafe892b4047b558861437a84816 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:02:47.356561 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a4e3d-5588-4ca1-a206-16d52b7924c5 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:47.357428 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a4e3d-5588-4ca1-a206-16d52b7924c5 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:47.357857 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a4e3d-5588-4ca1-a206-16d52b7924c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:47.393170 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-7d8a4e3d-5588-4ca1-a206-16d52b7924c5 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:02:47.394839 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-7d8a4e3d-5588-4ca1-a206-16d52b7924c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:47.492700 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1150/2293] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:02:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:02:47.511528 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b428ce-f8cd-4be1-8ce2-d1155e9eef99 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:47.513211 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-f7b428ce-f8cd-4be1-8ce2-d1155e9eef99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:47.638573 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b428ce-f8cd-4be1-8ce2-d1155e9eef99 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:47.644061 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aaa8e2-8a5f-4c03-8adf-001f8851eda8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:47.645034 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aaa8e2-8a5f-4c03-8adf-001f8851eda8 service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:47.645525 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aaa8e2-8a5f-4c03-8adf-001f8851eda8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:47.646390 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aaa8e2-8a5f-4c03-8adf-001f8851eda8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:47.662615 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aaa8e2-8a5f-4c03-8adf-001f8851eda8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:47.666863 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aaa8e2-8a5f-4c03-8adf-001f8851eda8 service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:47.685743 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1144/2294] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:02:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:02:47.728435 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a4e3d-5588-4ca1-a206-16d52b7924c5 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:47.729172 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-7d8a4e3d-5588-4ca1-a206-16d52b7924c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:47.753916 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a4e3d-5588-4ca1-a206-16d52b7924c5 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:47.767833 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245fe5ae-0cca-4dd7-b598-5f3d087f326e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:47.769736 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245fe5ae-0cca-4dd7-b598-5f3d087f326e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:47.770715 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245fe5ae-0cca-4dd7-b598-5f3d087f326e admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:47.771364 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245fe5ae-0cca-4dd7-b598-5f3d087f326e admin admin] PATH_INFO: `/v3/users/7fdba9e25c36413ab776727a21ef0d11` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:47.773468 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245fe5ae-0cca-4dd7-b598-5f3d087f326e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fdba9e25c36413ab776727a21ef0d11)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:47.776730 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245fe5ae-0cca-4dd7-b598-5f3d087f326e admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:47.792411 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aaa8e2-8a5f-4c03-8adf-001f8851eda8 service neutron] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:47.794203 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-85aaa8e2-8a5f-4c03-8adf-001f8851eda8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:47.816620 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aaa8e2-8a5f-4c03-8adf-001f8851eda8 service neutron] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:47.834299 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441f29f-ce18-4d9e-bcec-d32555e28df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:47.837978 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441f29f-ce18-4d9e-bcec-d32555e28df5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:47.838523 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441f29f-ce18-4d9e-bcec-d32555e28df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:47.839837 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441f29f-ce18-4d9e-bcec-d32555e28df5 admin admin] PATH_INFO: `/v3/projects/6aa218e1146048e69b37603279f0e905` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:47.846590 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f441f29f-ce18-4d9e-bcec-d32555e28df5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6aa218e1146048e69b37603279f0e905)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:47.853711 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f441f29f-ce18-4d9e-bcec-d32555e28df5 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:47.907514 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-245fe5ae-0cca-4dd7-b598-5f3d087f326e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fdba9e25c36413ab776727a21ef0d11'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:47.950325 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-245fe5ae-0cca-4dd7-b598-5f3d087f326e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fdba9e25c36413ab776727a21ef0d11'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:47.959478 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-f441f29f-ce18-4d9e-bcec-d32555e28df5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6aa218e1146048e69b37603279f0e905', 'request_id': 'req-f441f29f-ce18-4d9e-bcec-d32555e28df5'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:47.964625 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-245fe5ae-0cca-4dd7-b598-5f3d087f326e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fdba9e25c36413ab776727a21ef0d11'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:47.966736 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-245fe5ae-0cca-4dd7-b598-5f3d087f326e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fdba9e25c36413ab776727a21ef0d11'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:47.968790 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-245fe5ae-0cca-4dd7-b598-5f3d087f326e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fdba9e25c36413ab776727a21ef0d11'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:47.974106 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-f441f29f-ce18-4d9e-bcec-d32555e28df5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6aa218e1146048e69b37603279f0e905', 'request_id': 'req-f441f29f-ce18-4d9e-bcec-d32555e28df5'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:47.988746 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-f441f29f-ce18-4d9e-bcec-d32555e28df5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6aa218e1146048e69b37603279f0e905', 'request_id': 'req-f441f29f-ce18-4d9e-bcec-d32555e28df5'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:48.001669 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1151/2295] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 01:02:47 2022] DELETE /identity/v3/users/7fdba9e25c36413ab776727a21ef0d11 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:02:48.001669 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245fe5ae-0cca-4dd7-b598-5f3d087f326e admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:48.001669 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-245fe5ae-0cca-4dd7-b598-5f3d087f326e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:48.016873 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-f441f29f-ce18-4d9e-bcec-d32555e28df5 admin admin] The token cache is being invalidate because project 6aa218e1146048e69b37603279f0e905 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81808) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:02:48.017176 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-f441f29f-ce18-4d9e-bcec-d32555e28df5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:48.018172 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-f441f29f-ce18-4d9e-bcec-d32555e28df5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:48.020773 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1145/2296] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 01:02:47 2022] DELETE /identity/v3/projects/6aa218e1146048e69b37603279f0e905 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:02:48.023849 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1518069-082b-4935-8020-ff429a89bd82 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:48.024483 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1518069-082b-4935-8020-ff429a89bd82 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:48.024762 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1518069-082b-4935-8020-ff429a89bd82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:48.160535 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:02:48.197120 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245fe5ae-0cca-4dd7-b598-5f3d087f326e admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:48.204317 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00191a6-70ba-4ca0-8e09-81f907b340d7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4fc1d11f5641b0b5f301b234282aa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:48.205536 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00191a6-70ba-4ca0-8e09-81f907b340d7 service placement] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:48.205954 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00191a6-70ba-4ca0-8e09-81f907b340d7 service placement] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:48.206299 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00191a6-70ba-4ca0-8e09-81f907b340d7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:48.208330 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-c00191a6-70ba-4ca0-8e09-81f907b340d7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:48.222701 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00191a6-70ba-4ca0-8e09-81f907b340d7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:48.224733 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00191a6-70ba-4ca0-8e09-81f907b340d7 service placement] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:48.242046 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1152/2297] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:02:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:02:48.243827 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a4e95-c30b-459d-967c-5b9094b71c3d None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:48.244769 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a4e95-c30b-459d-967c-5b9094b71c3d None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:48.245053 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a4e95-c30b-459d-967c-5b9094b71c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:48.271544 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-ed2a4e95-c30b-459d-967c-5b9094b71c3d None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:02:48.272973 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-ed2a4e95-c30b-459d-967c-5b9094b71c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:48.282798 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-a1518069-082b-4935-8020-ff429a89bd82 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:02:48.284096 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-a1518069-082b-4935-8020-ff429a89bd82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:48.405988 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1153/2298] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:02:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:02:48.416824 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da440e-5b43-4d69-8f5e-ec2917881c24 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:48.417172 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da440e-5b43-4d69-8f5e-ec2917881c24 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:48.417503 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da440e-5b43-4d69-8f5e-ec2917881c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:48.441183 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1146/2299] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:02:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:02:48.455858 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-59da440e-5b43-4d69-8f5e-ec2917881c24 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:02:48.457101 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-59da440e-5b43-4d69-8f5e-ec2917881c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:48.468333 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1154/2300] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:02:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:02:48.473943 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1518069-082b-4935-8020-ff429a89bd82 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:48.487193 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da440e-5b43-4d69-8f5e-ec2917881c24 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:48.491844 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-59da440e-5b43-4d69-8f5e-ec2917881c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:48.493449 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1518069-082b-4935-8020-ff429a89bd82 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:48.505395 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ddd5e-0f1e-475b-92b9-26e9c5d05bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:48.508387 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ddd5e-0f1e-475b-92b9-26e9c5d05bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:48.508784 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ddd5e-0f1e-475b-92b9-26e9c5d05bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:48.509066 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ddd5e-0f1e-475b-92b9-26e9c5d05bf0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:48.510073 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06ddd5e-0f1e-475b-92b9-26e9c5d05bf0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:02:48.510292 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06ddd5e-0f1e-475b-92b9-26e9c5d05bf0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:48.516795 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06ddd5e-0f1e-475b-92b9-26e9c5d05bf0 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:48.538571 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:02:48.555829 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1147/2301] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 01:02:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:02:48.559878 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ddd5e-0f1e-475b-92b9-26e9c5d05bf0 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:48.584473 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ddd5e-0f1e-475b-92b9-26e9c5d05bf0 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:48.595457 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c775a71-f6f7-4ea9-b2f2-2c5e710b8a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:48.596703 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c775a71-f6f7-4ea9-b2f2-2c5e710b8a19 admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:48.597188 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c775a71-f6f7-4ea9-b2f2-2c5e710b8a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:48.597676 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c775a71-f6f7-4ea9-b2f2-2c5e710b8a19 admin admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:48.598529 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c775a71-f6f7-4ea9-b2f2-2c5e710b8a19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:48.600740 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c775a71-f6f7-4ea9-b2f2-2c5e710b8a19 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:48.642453 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1148/2302] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 01:02:48 2022] POST /identity/v3/projects => generated 379 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:02:48.647913 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c775a71-f6f7-4ea9-b2f2-2c5e710b8a19 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:48.651927 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da440e-5b43-4d69-8f5e-ec2917881c24 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:48.799480 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c775a71-f6f7-4ea9-b2f2-2c5e710b8a19 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:48.806574 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d7d02f-15a2-4e5e-9d71-697a64578f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:48.807315 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d7d02f-15a2-4e5e-9d71-697a64578f30 admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:48.807649 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d7d02f-15a2-4e5e-9d71-697a64578f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:48.807806 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d7d02f-15a2-4e5e-9d71-697a64578f30 admin admin] PATH_INFO: `/v3/users` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:48.808977 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d7d02f-15a2-4e5e-9d71-697a64578f30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:48.810360 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d7d02f-15a2-4e5e-9d71-697a64578f30 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:48.815489 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb279e-b3eb-4754-ac51-c256aed5ec8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:48.816164 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb279e-b3eb-4754-ac51-c256aed5ec8a service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:48.816446 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb279e-b3eb-4754-ac51-c256aed5ec8a service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:48.816719 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb279e-b3eb-4754-ac51-c256aed5ec8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:48.841813 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1149/2303] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 01:02:48 2022] POST /identity/v3/users => generated 290 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:02:48.843387 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d7d02f-15a2-4e5e-9d71-697a64578f30 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:48.845159 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adb279e-b3eb-4754-ac51-c256aed5ec8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:48.846658 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adb279e-b3eb-4754-ac51-c256aed5ec8a service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:48.848451 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-35d7d02f-15a2-4e5e-9d71-697a64578f30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:48.874892 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1155/2304] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:02:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:02:48.875809 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb279e-b3eb-4754-ac51-c256aed5ec8a service neutron] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:48.884795 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d7d02f-15a2-4e5e-9d71-697a64578f30 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:48.896829 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e77f86-31cf-4062-a011-3bb300453bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:48.897541 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e77f86-31cf-4062-a011-3bb300453bc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:48.897824 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e77f86-31cf-4062-a011-3bb300453bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:48.898099 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e77f86-31cf-4062-a011-3bb300453bc8 admin admin] PATH_INFO: `/v3/projects/1f48fcca642748a8901f1b3c7529a2d5` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:48.901398 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb279e-b3eb-4754-ac51-c256aed5ec8a service neutron] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:48.903145 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e77f86-31cf-4062-a011-3bb300453bc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f48fcca642748a8901f1b3c7529a2d5)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:48.905140 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e77f86-31cf-4062-a011-3bb300453bc8 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:48.911493 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09949e21-8fc3-4df1-bf39-ebcdcf54aec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:48.913208 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09949e21-8fc3-4df1-bf39-ebcdcf54aec0 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:48.913492 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09949e21-8fc3-4df1-bf39-ebcdcf54aec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:48.913763 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09949e21-8fc3-4df1-bf39-ebcdcf54aec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:48.914439 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09949e21-8fc3-4df1-bf39-ebcdcf54aec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:48.916194 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09949e21-8fc3-4df1-bf39-ebcdcf54aec0 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:48.945334 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1156/2305] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:02:48 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:02:48.949690 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09949e21-8fc3-4df1-bf39-ebcdcf54aec0 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:48.968852 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09949e21-8fc3-4df1-bf39-ebcdcf54aec0 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:48.979761 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f10ccd-5ac5-4fb1-8ab6-7e294b307891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:48.980801 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f10ccd-5ac5-4fb1-8ab6-7e294b307891 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:48.980801 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f10ccd-5ac5-4fb1-8ab6-7e294b307891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:48.980801 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f10ccd-5ac5-4fb1-8ab6-7e294b307891 admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:48.985721 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f10ccd-5ac5-4fb1-8ab6-7e294b307891 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:48.988944 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f10ccd-5ac5-4fb1-8ab6-7e294b307891 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:49.012238 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-e5e77f86-31cf-4062-a011-3bb300453bc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f48fcca642748a8901f1b3c7529a2d5', 'request_id': 'req-e5e77f86-31cf-4062-a011-3bb300453bc8'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:49.020034 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1157/2306] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:02:48 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:02:49.025512 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f10ccd-5ac5-4fb1-8ab6-7e294b307891 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:49.027010 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-e5e77f86-31cf-4062-a011-3bb300453bc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f48fcca642748a8901f1b3c7529a2d5', 'request_id': 'req-e5e77f86-31cf-4062-a011-3bb300453bc8'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:49.050337 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-e5e77f86-31cf-4062-a011-3bb300453bc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f48fcca642748a8901f1b3c7529a2d5', 'request_id': 'req-e5e77f86-31cf-4062-a011-3bb300453bc8'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:49.075118 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f10ccd-5ac5-4fb1-8ab6-7e294b307891 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:49.117259 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-e5e77f86-31cf-4062-a011-3bb300453bc8 admin admin] The token cache is being invalidate because project 1f48fcca642748a8901f1b3c7529a2d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81808) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:02:49.118989 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-e5e77f86-31cf-4062-a011-3bb300453bc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:49.120159 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-e5e77f86-31cf-4062-a011-3bb300453bc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:49.122832 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1150/2307] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 01:02:48 2022] DELETE /identity/v3/projects/1f48fcca642748a8901f1b3c7529a2d5 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:02:49.127978 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e77f86-31cf-4062-a011-3bb300453bc8 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:49.129982 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-e5e77f86-31cf-4062-a011-3bb300453bc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:49.135796 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:02:49.262223 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:02:49.264455 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d737a-f2c2-4540-ae81-1464c43acbec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:49.268815 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d737a-f2c2-4540-ae81-1464c43acbec admin admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:49.273689 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d737a-f2c2-4540-ae81-1464c43acbec admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:49.275162 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d737a-f2c2-4540-ae81-1464c43acbec admin admin] PATH_INFO: `/v3/projects/c4cf2f90b00f4a3a999d90e5497aa4d0/users/7b7c863c37fd47b1ada66191c3b9881a/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:49.311455 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e77f86-31cf-4062-a011-3bb300453bc8 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:49.320047 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66d737a-f2c2-4540-ae81-1464c43acbec admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4cf2f90b00f4a3a999d90e5497aa4d0, user_id=7b7c863c37fd47b1ada66191c3b9881a, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:49.324033 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66d737a-f2c2-4540-ae81-1464c43acbec admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:49.330251 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c5ecf3-e33d-416c-bc15-523e32c5edea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:49.331207 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5ecf3-e33d-416c-bc15-523e32c5edea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:49.331835 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5ecf3-e33d-416c-bc15-523e32c5edea admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:49.332352 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5ecf3-e33d-416c-bc15-523e32c5edea admin admin] PATH_INFO: `/v3/users/b4e2b8f84c0344b98f35a68d15edbc94` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:49.334080 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c5ecf3-e33d-416c-bc15-523e32c5edea admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4e2b8f84c0344b98f35a68d15edbc94)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:49.337108 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c5ecf3-e33d-416c-bc15-523e32c5edea admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:49.349978 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1158/2308] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 01:02:49 2022] PUT /identity/v3/projects/c4cf2f90b00f4a3a999d90e5497aa4d0/users/7b7c863c37fd47b1ada66191c3b9881a/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:02:49.362838 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43aee54-89a7-4786-a6ad-0e5c4704e041 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:49.363154 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43aee54-89a7-4786-a6ad-0e5c4704e041 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:49.363435 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43aee54-89a7-4786-a6ad-0e5c4704e041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:49.398379 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-f43aee54-89a7-4786-a6ad-0e5c4704e041 None None] MFA Rules not processed for user `7b7c863c37fd47b1ada66191c3b9881a`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:02:49.399695 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-f43aee54-89a7-4786-a6ad-0e5c4704e041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:49.440857 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-d8c5ecf3-e33d-416c-bc15-523e32c5edea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4e2b8f84c0344b98f35a68d15edbc94'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:49.459880 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-d8c5ecf3-e33d-416c-bc15-523e32c5edea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4e2b8f84c0344b98f35a68d15edbc94'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:49.493405 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1159/2309] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:02:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:02:49.501295 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-d8c5ecf3-e33d-416c-bc15-523e32c5edea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4e2b8f84c0344b98f35a68d15edbc94'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:49.502048 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-d8c5ecf3-e33d-416c-bc15-523e32c5edea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4e2b8f84c0344b98f35a68d15edbc94'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:49.502703 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-d8c5ecf3-e33d-416c-bc15-523e32c5edea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4e2b8f84c0344b98f35a68d15edbc94'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:49.521692 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1151/2310] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 01:02:49 2022] DELETE /identity/v3/users/b4e2b8f84c0344b98f35a68d15edbc94 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:02:49.542229 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43aee54-89a7-4786-a6ad-0e5c4704e041 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:49.543788 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-f43aee54-89a7-4786-a6ad-0e5c4704e041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:49.648846 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43aee54-89a7-4786-a6ad-0e5c4704e041 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:49.760439 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:02:49.781868 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a7ccb-14e1-4e83-88b2-9fe0faa3e641 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:49.782477 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a7ccb-14e1-4e83-88b2-9fe0faa3e641 service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:49.782756 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a7ccb-14e1-4e83-88b2-9fe0faa3e641 service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:49.783020 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a7ccb-14e1-4e83-88b2-9fe0faa3e641 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:49.788548 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-885a7ccb-14e1-4e83-88b2-9fe0faa3e641 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:49.816953 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c5ecf3-e33d-416c-bc15-523e32c5edea admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:49.818424 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-d8c5ecf3-e33d-416c-bc15-523e32c5edea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:49.966068 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c5ecf3-e33d-416c-bc15-523e32c5edea admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:49.968944 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a7ccb-14e1-4e83-88b2-9fe0faa3e641 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:49.970586 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a7ccb-14e1-4e83-88b2-9fe0faa3e641 service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:49.975593 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e768a96-b9f3-4a47-8004-26f042630ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:49.976605 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e768a96-b9f3-4a47-8004-26f042630ef0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:49.976984 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e768a96-b9f3-4a47-8004-26f042630ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:49.977355 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e768a96-b9f3-4a47-8004-26f042630ef0 admin admin] PATH_INFO: `/v3/projects/d75faf822f94454485448d6b9656f3bf` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:49.979380 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e768a96-b9f3-4a47-8004-26f042630ef0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d75faf822f94454485448d6b9656f3bf)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:49.981490 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e768a96-b9f3-4a47-8004-26f042630ef0 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:49.998241 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1160/2311] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:02:49 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:02:50.108705 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-0e768a96-b9f3-4a47-8004-26f042630ef0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd75faf822f94454485448d6b9656f3bf', 'request_id': 'req-0e768a96-b9f3-4a47-8004-26f042630ef0'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:50.128055 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-0e768a96-b9f3-4a47-8004-26f042630ef0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd75faf822f94454485448d6b9656f3bf', 'request_id': 'req-0e768a96-b9f3-4a47-8004-26f042630ef0'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:50.139797 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-0e768a96-b9f3-4a47-8004-26f042630ef0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd75faf822f94454485448d6b9656f3bf', 'request_id': 'req-0e768a96-b9f3-4a47-8004-26f042630ef0'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:50.155887 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:02:50.163129 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-0e768a96-b9f3-4a47-8004-26f042630ef0 admin admin] The token cache is being invalidate because project d75faf822f94454485448d6b9656f3bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81808) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:02:50.163129 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-0e768a96-b9f3-4a47-8004-26f042630ef0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:50.164163 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-0e768a96-b9f3-4a47-8004-26f042630ef0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:50.171252 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1152/2312] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 01:02:49 2022] DELETE /identity/v3/projects/d75faf822f94454485448d6b9656f3bf => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:02:50.172487 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf4d03-bb8c-43ff-aef0-d07cde52e0ec None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:50.172942 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf4d03-bb8c-43ff-aef0-d07cde52e0ec None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:50.173399 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf4d03-bb8c-43ff-aef0-d07cde52e0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:50.202224 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-54bf4d03-bb8c-43ff-aef0-d07cde52e0ec None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:02:50.206718 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-54bf4d03-bb8c-43ff-aef0-d07cde52e0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:50.369356 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1161/2313] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:02:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:02:50.392575 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f412c321-c892-4ed1-974a-b33a8744119d None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:50.393111 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f412c321-c892-4ed1-974a-b33a8744119d None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:50.393339 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f412c321-c892-4ed1-974a-b33a8744119d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:50.421786 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-f412c321-c892-4ed1-974a-b33a8744119d None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:02:50.423387 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-f412c321-c892-4ed1-974a-b33a8744119d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:50.433164 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1153/2314] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:02:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:02:50.437598 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bf4d03-bb8c-43ff-aef0-d07cde52e0ec None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:50.449977 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bf4d03-bb8c-43ff-aef0-d07cde52e0ec None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:50.459003 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db2d9b1-825e-4f0b-b5e2-a8879e01d5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:50.460370 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2d9b1-825e-4f0b-b5e2-a8879e01d5ef admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:50.461086 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2d9b1-825e-4f0b-b5e2-a8879e01d5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:50.461383 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2d9b1-825e-4f0b-b5e2-a8879e01d5ef admin admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:50.462435 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db2d9b1-825e-4f0b-b5e2-a8879e01d5ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:02:50.462819 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db2d9b1-825e-4f0b-b5e2-a8879e01d5ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:50.464728 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db2d9b1-825e-4f0b-b5e2-a8879e01d5ef admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:50.484910 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f412c321-c892-4ed1-974a-b33a8744119d None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:50.496153 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1162/2315] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 01:02:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:02:50.496834 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f412c321-c892-4ed1-974a-b33a8744119d None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:50.502061 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d2618e-27ae-449c-af0f-d23fa725f578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:50.502695 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d2618e-27ae-449c-af0f-d23fa725f578 admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:50.502972 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d2618e-27ae-449c-af0f-d23fa725f578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:50.503239 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d2618e-27ae-449c-af0f-d23fa725f578 admin admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:50.503948 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d2618e-27ae-449c-af0f-d23fa725f578 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:50.506096 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d2618e-27ae-449c-af0f-d23fa725f578 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:50.549792 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db2d9b1-825e-4f0b-b5e2-a8879e01d5ef admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:50.551760 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-2db2d9b1-825e-4f0b-b5e2-a8879e01d5ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:50.580929 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1154/2316] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 01:02:50 2022] POST /identity/v3/projects => generated 375 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:02:50.583948 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db2d9b1-825e-4f0b-b5e2-a8879e01d5ef admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:50.585721 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d2618e-27ae-449c-af0f-d23fa725f578 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:50.720420 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5871a52-a965-4069-ab8b-cd275c6a3d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:50.720420 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5871a52-a965-4069-ab8b-cd275c6a3d5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:50.720420 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5871a52-a965-4069-ab8b-cd275c6a3d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:50.720420 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5871a52-a965-4069-ab8b-cd275c6a3d5e admin admin] PATH_INFO: `/v3/projects/e92938f47856431f8868e57d055c7bb1` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:50.720949 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5871a52-a965-4069-ab8b-cd275c6a3d5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e92938f47856431f8868e57d055c7bb1)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:50.720949 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5871a52-a965-4069-ab8b-cd275c6a3d5e admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:50.770857 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d2618e-27ae-449c-af0f-d23fa725f578 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:50.778428 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d0f2cf-7977-423f-a482-50d28ed42419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:50.779335 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d0f2cf-7977-423f-a482-50d28ed42419 admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:50.779867 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d0f2cf-7977-423f-a482-50d28ed42419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:50.780762 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d0f2cf-7977-423f-a482-50d28ed42419 admin admin] PATH_INFO: `/v3/users` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:50.782721 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d0f2cf-7977-423f-a482-50d28ed42419 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:50.786087 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d0f2cf-7977-423f-a482-50d28ed42419 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:50.805200 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:02:50.868948 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1155/2317] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 01:02:50 2022] POST /identity/v3/users => generated 288 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:02:50.870546 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d0f2cf-7977-423f-a482-50d28ed42419 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:50.889322 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-f5871a52-a965-4069-ab8b-cd275c6a3d5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e92938f47856431f8868e57d055c7bb1', 'request_id': 'req-f5871a52-a965-4069-ab8b-cd275c6a3d5e'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:50.911602 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d0f2cf-7977-423f-a482-50d28ed42419 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:50.913379 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-f5871a52-a965-4069-ab8b-cd275c6a3d5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e92938f47856431f8868e57d055c7bb1', 'request_id': 'req-f5871a52-a965-4069-ab8b-cd275c6a3d5e'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:50.937715 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-f5871a52-a965-4069-ab8b-cd275c6a3d5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e92938f47856431f8868e57d055c7bb1', 'request_id': 'req-f5871a52-a965-4069-ab8b-cd275c6a3d5e'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:50.966618 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-f5871a52-a965-4069-ab8b-cd275c6a3d5e admin admin] The token cache is being invalidate because project e92938f47856431f8868e57d055c7bb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81807) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:02:50.966750 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-f5871a52-a965-4069-ab8b-cd275c6a3d5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:50.968066 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-f5871a52-a965-4069-ab8b-cd275c6a3d5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:50.974546 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1163/2318] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 01:02:50 2022] DELETE /identity/v3/projects/e92938f47856431f8868e57d055c7bb1 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:02:50.994858 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41564279-0e51-483e-9216-1c84a41fb5a1 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:50.998163 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41564279-0e51-483e-9216-1c84a41fb5a1 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:51.004653 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41564279-0e51-483e-9216-1c84a41fb5a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:51.072487 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-41564279-0e51-483e-9216-1c84a41fb5a1 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:02:51.074999 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-41564279-0e51-483e-9216-1c84a41fb5a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:51.115988 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac52d5-0cd5-4798-9708-d3a0c2dd3874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:51.116543 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac52d5-0cd5-4798-9708-d3a0c2dd3874 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:51.116838 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac52d5-0cd5-4798-9708-d3a0c2dd3874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:51.117092 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac52d5-0cd5-4798-9708-d3a0c2dd3874 admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:51.117957 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ac52d5-0cd5-4798-9708-d3a0c2dd3874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:51.122165 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ac52d5-0cd5-4798-9708-d3a0c2dd3874 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:51.147928 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1156/2319] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:02:50 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:02:51.152790 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac52d5-0cd5-4798-9708-d3a0c2dd3874 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:51.157319 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-a1ac52d5-0cd5-4798-9708-d3a0c2dd3874 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:51.182086 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac52d5-0cd5-4798-9708-d3a0c2dd3874 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:51.199641 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b3755-ea8c-41b1-9586-1eade6923913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:51.200328 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b3755-ea8c-41b1-9586-1eade6923913 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:51.200605 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b3755-ea8c-41b1-9586-1eade6923913 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:51.200872 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7b3755-ea8c-41b1-9586-1eade6923913 admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:51.201538 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7b3755-ea8c-41b1-9586-1eade6923913 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:51.211148 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7b3755-ea8c-41b1-9586-1eade6923913 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:51.258204 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1157/2320] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:02:51 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:02:51.258451 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1164/2321] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:02:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:02:51.260875 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b3755-ea8c-41b1-9586-1eade6923913 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:51.263728 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2103e9d9-7729-4f55-8dcb-32cc9545778a None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:51.264021 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2103e9d9-7729-4f55-8dcb-32cc9545778a None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:51.264288 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2103e9d9-7729-4f55-8dcb-32cc9545778a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:51.309895 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7b3755-ea8c-41b1-9586-1eade6923913 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:51.315544 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-2103e9d9-7729-4f55-8dcb-32cc9545778a None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:02:51.317484 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-2103e9d9-7729-4f55-8dcb-32cc9545778a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:51.330124 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2f4497-5766-44d6-a2e8-09ae455bad4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:51.330826 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f4497-5766-44d6-a2e8-09ae455bad4c admin admin] REQUEST_METHOD: `PUT` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:51.331105 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f4497-5766-44d6-a2e8-09ae455bad4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:51.331379 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f4497-5766-44d6-a2e8-09ae455bad4c admin admin] PATH_INFO: `/v3/projects/d52a7a9bcabb4a40a6da7c31585f52c9/users/4bd8645283b54dac9029db4694a8d7a8/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:51.339572 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1165/2322] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:02:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:02:51.343551 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2103e9d9-7729-4f55-8dcb-32cc9545778a None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:51.360742 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2103e9d9-7729-4f55-8dcb-32cc9545778a None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:51.369850 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2f4497-5766-44d6-a2e8-09ae455bad4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d52a7a9bcabb4a40a6da7c31585f52c9, user_id=4bd8645283b54dac9029db4694a8d7a8, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:51.371197 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e1146-3043-4e4b-a693-fbcc9efdb0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:51.372082 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e1146-3043-4e4b-a693-fbcc9efdb0a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:51.372582 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e1146-3043-4e4b-a693-fbcc9efdb0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:51.372702 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2f4497-5766-44d6-a2e8-09ae455bad4c admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:51.373117 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e1146-3043-4e4b-a693-fbcc9efdb0a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:51.373920 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610e1146-3043-4e4b-a693-fbcc9efdb0a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:02:51.374392 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610e1146-3043-4e4b-a693-fbcc9efdb0a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:51.376782 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610e1146-3043-4e4b-a693-fbcc9efdb0a0 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:51.401136 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1166/2323] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 01:02:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:02:51.403325 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e1146-3043-4e4b-a693-fbcc9efdb0a0 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:51.406693 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1158/2324] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 01:02:51 2022] PUT /identity/v3/projects/d52a7a9bcabb4a40a6da7c31585f52c9/users/4bd8645283b54dac9029db4694a8d7a8/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:02:51.416689 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7b848-d503-4b3d-a776-96f97c0085b5 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:51.418063 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7b848-d503-4b3d-a776-96f97c0085b5 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:51.418063 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7b848-d503-4b3d-a776-96f97c0085b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:51.420473 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e1146-3043-4e4b-a693-fbcc9efdb0a0 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:51.504026 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-39f7b848-d503-4b3d-a776-96f97c0085b5 None None] MFA Rules not processed for user `4bd8645283b54dac9029db4694a8d7a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:02:51.509641 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-39f7b848-d503-4b3d-a776-96f97c0085b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:51.529398 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:02:51.584774 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa09bab0-e4ab-47a4-8513-13da5ac9be7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:51.586048 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09bab0-e4ab-47a4-8513-13da5ac9be7c admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:51.586646 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09bab0-e4ab-47a4-8513-13da5ac9be7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:51.586996 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09bab0-e4ab-47a4-8513-13da5ac9be7c admin admin] PATH_INFO: `/v3/projects` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:51.589371 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa09bab0-e4ab-47a4-8513-13da5ac9be7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:51.593535 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa09bab0-e4ab-47a4-8513-13da5ac9be7c admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:51.645536 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1167/2325] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 01:02:51 2022] POST /identity/v3/projects => generated 383 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:02:51.653503 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa09bab0-e4ab-47a4-8513-13da5ac9be7c admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:51.670394 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1159/2326] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:02:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:02:51.697466 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f7b848-d503-4b3d-a776-96f97c0085b5 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:51.702817 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-39f7b848-d503-4b3d-a776-96f97c0085b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:51.704954 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:02:51.817277 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa09bab0-e4ab-47a4-8513-13da5ac9be7c admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:51.825669 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f7b848-d503-4b3d-a776-96f97c0085b5 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:51.831053 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fccfaa-875e-48d8-b417-53b3dbb67051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:51.832615 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fccfaa-875e-48d8-b417-53b3dbb67051 admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:51.832901 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fccfaa-875e-48d8-b417-53b3dbb67051 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:51.833179 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fccfaa-875e-48d8-b417-53b3dbb67051 admin admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:51.833838 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fccfaa-875e-48d8-b417-53b3dbb67051 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:51.837145 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fccfaa-875e-48d8-b417-53b3dbb67051 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:51.890182 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1168/2327] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 01:02:51 2022] POST /identity/v3/users => generated 292 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:02:51.894656 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fccfaa-875e-48d8-b417-53b3dbb67051 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:51.898160 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2c1beb-1013-4d0b-907d-1362c33a7729 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:51.898997 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c1beb-1013-4d0b-907d-1362c33a7729 service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:51.899278 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c1beb-1013-4d0b-907d-1362c33a7729 service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:51.899551 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c1beb-1013-4d0b-907d-1362c33a7729 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:51.909826 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fccfaa-875e-48d8-b417-53b3dbb67051 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:51.929549 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e9468d-6b3e-43c5-ad79-a7db38e73289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:51.930614 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9468d-6b3e-43c5-ad79-a7db38e73289 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:51.931149 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9468d-6b3e-43c5-ad79-a7db38e73289 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:51.931574 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e9468d-6b3e-43c5-ad79-a7db38e73289 admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:51.932455 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e9468d-6b3e-43c5-ad79-a7db38e73289 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:51.934300 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e9468d-6b3e-43c5-ad79-a7db38e73289 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:51.960951 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1169/2328] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:02:51 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:02:51.965158 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e9468d-6b3e-43c5-ad79-a7db38e73289 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:51.981534 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e9468d-6b3e-43c5-ad79-a7db38e73289 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:51.991744 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4f72f-ad81-4d29-82e3-fd9bcc808475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:51.992388 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4f72f-ad81-4d29-82e3-fd9bcc808475 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:51.992503 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2c1beb-1013-4d0b-907d-1362c33a7729 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:51.992704 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4f72f-ad81-4d29-82e3-fd9bcc808475 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:51.992979 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4f72f-ad81-4d29-82e3-fd9bcc808475 admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:51.993639 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d4f72f-ad81-4d29-82e3-fd9bcc808475 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:51.994469 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2c1beb-1013-4d0b-907d-1362c33a7729 service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:51.995259 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d4f72f-ad81-4d29-82e3-fd9bcc808475 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:52.009554 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1160/2329] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:02:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:02:52.019363 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1170/2330] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:02:51 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:02:52.025561 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2c1beb-1013-4d0b-907d-1362c33a7729 service neutron] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:52.040858 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2c1beb-1013-4d0b-907d-1362c33a7729 service neutron] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:52.041499 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4f72f-ad81-4d29-82e3-fd9bcc808475 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:52.047788 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c2fe07-3094-4f7a-82b8-0b90ed25ace8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:52.049321 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c2fe07-3094-4f7a-82b8-0b90ed25ace8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:52.049611 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c2fe07-3094-4f7a-82b8-0b90ed25ace8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:52.049959 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c2fe07-3094-4f7a-82b8-0b90ed25ace8 admin admin] PATH_INFO: `/v3/projects/0930de881d984103a5efbc2ee3c8935a/users/faca032d366e42d68d51303db29baca0/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:52.062368 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4f72f-ad81-4d29-82e3-fd9bcc808475 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:52.076348 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02885351-3e18-47db-b70e-8d1df2c6d5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:52.078161 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02885351-3e18-47db-b70e-8d1df2c6d5bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:52.078660 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02885351-3e18-47db-b70e-8d1df2c6d5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:52.079328 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02885351-3e18-47db-b70e-8d1df2c6d5bc admin admin] PATH_INFO: `/v3/users/4bd8645283b54dac9029db4694a8d7a8` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:52.082234 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02885351-3e18-47db-b70e-8d1df2c6d5bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bd8645283b54dac9029db4694a8d7a8)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:52.085461 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02885351-3e18-47db-b70e-8d1df2c6d5bc admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:52.094156 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c2fe07-3094-4f7a-82b8-0b90ed25ace8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0930de881d984103a5efbc2ee3c8935a, user_id=faca032d366e42d68d51303db29baca0, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:52.097237 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c2fe07-3094-4f7a-82b8-0b90ed25ace8 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:52.105703 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:02:52.121892 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1161/2331] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 01:02:52 2022] PUT /identity/v3/projects/0930de881d984103a5efbc2ee3c8935a/users/faca032d366e42d68d51303db29baca0/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:02:52.133573 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa01d57-1696-4655-90b4-9717dab2978c None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:52.133854 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa01d57-1696-4655-90b4-9717dab2978c None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:52.134129 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa01d57-1696-4655-90b4-9717dab2978c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:52.187460 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-dfa01d57-1696-4655-90b4-9717dab2978c None None] MFA Rules not processed for user `faca032d366e42d68d51303db29baca0`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:02:52.193135 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-dfa01d57-1696-4655-90b4-9717dab2978c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:52.221044 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-02885351-3e18-47db-b70e-8d1df2c6d5bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bd8645283b54dac9029db4694a8d7a8'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:52.259621 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-02885351-3e18-47db-b70e-8d1df2c6d5bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bd8645283b54dac9029db4694a8d7a8'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:52.285763 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-02885351-3e18-47db-b70e-8d1df2c6d5bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bd8645283b54dac9029db4694a8d7a8'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:52.289376 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-02885351-3e18-47db-b70e-8d1df2c6d5bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bd8645283b54dac9029db4694a8d7a8'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:52.290584 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-02885351-3e18-47db-b70e-8d1df2c6d5bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bd8645283b54dac9029db4694a8d7a8'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:52.308784 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1162/2332] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:02:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:02:52.330034 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa01d57-1696-4655-90b4-9717dab2978c None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:52.350518 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1171/2333] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 01:02:52 2022] DELETE /identity/v3/users/4bd8645283b54dac9029db4694a8d7a8 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:02:52.356716 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99589f25-5add-4de7-94c4-f3bc9b0fb8a8 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:52.357256 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99589f25-5add-4de7-94c4-f3bc9b0fb8a8 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:52.357632 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99589f25-5add-4de7-94c4-f3bc9b0fb8a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:52.428724 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-99589f25-5add-4de7-94c4-f3bc9b0fb8a8 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:02:52.432479 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-99589f25-5add-4de7-94c4-f3bc9b0fb8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:52.440986 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa01d57-1696-4655-90b4-9717dab2978c None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:52.580541 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af83922-7562-4c6a-98d8-c0b8e4675bed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:52.581176 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af83922-7562-4c6a-98d8-c0b8e4675bed service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:52.581449 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af83922-7562-4c6a-98d8-c0b8e4675bed service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:52.581720 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af83922-7562-4c6a-98d8-c0b8e4675bed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:52.592841 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-4af83922-7562-4c6a-98d8-c0b8e4675bed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:52.625411 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1172/2334] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:02:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:02:52.746773 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99589f25-5add-4de7-94c4-f3bc9b0fb8a8 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:52.749496 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-99589f25-5add-4de7-94c4-f3bc9b0fb8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:52.759885 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:02:52.766037 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:02:52.769171 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af83922-7562-4c6a-98d8-c0b8e4675bed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:52.787604 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af83922-7562-4c6a-98d8-c0b8e4675bed service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:52.806859 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99589f25-5add-4de7-94c4-f3bc9b0fb8a8 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:52.834933 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bea736c-4b08-4c5d-be8b-70e3e1288dbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:52.835594 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea736c-4b08-4c5d-be8b-70e3e1288dbe service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:52.835905 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea736c-4b08-4c5d-be8b-70e3e1288dbe service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:52.836179 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bea736c-4b08-4c5d-be8b-70e3e1288dbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:52.851462 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1163/2335] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:02:52 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:02:52.885672 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bea736c-4b08-4c5d-be8b-70e3e1288dbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:52.892791 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bea736c-4b08-4c5d-be8b-70e3e1288dbe service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:52.931199 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1173/2336] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:02:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:02:55.278101 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af83922-7562-4c6a-98d8-c0b8e4675bed service neutron] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:02:55.280205 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-4af83922-7562-4c6a-98d8-c0b8e4675bed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:02:55.296426 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af83922-7562-4c6a-98d8-c0b8e4675bed service neutron] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:02:55.317731 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760d76c-2044-4e17-81e4-44bc16d4e19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:02:55.320705 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760d76c-2044-4e17-81e4-44bc16d4e19d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:02:55.320929 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760d76c-2044-4e17-81e4-44bc16d4e19d admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:02:55.321619 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760d76c-2044-4e17-81e4-44bc16d4e19d admin admin] PATH_INFO: `/v3/projects/d52a7a9bcabb4a40a6da7c31585f52c9` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:02:55.323462 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760d76c-2044-4e17-81e4-44bc16d4e19d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d52a7a9bcabb4a40a6da7c31585f52c9)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:02:55.330371 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760d76c-2044-4e17-81e4-44bc16d4e19d admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:02:55.465246 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-5760d76c-2044-4e17-81e4-44bc16d4e19d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd52a7a9bcabb4a40a6da7c31585f52c9', 'request_id': 'req-5760d76c-2044-4e17-81e4-44bc16d4e19d'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:55.489463 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-5760d76c-2044-4e17-81e4-44bc16d4e19d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd52a7a9bcabb4a40a6da7c31585f52c9', 'request_id': 'req-5760d76c-2044-4e17-81e4-44bc16d4e19d'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:55.511540 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-5760d76c-2044-4e17-81e4-44bc16d4e19d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd52a7a9bcabb4a40a6da7c31585f52c9', 'request_id': 'req-5760d76c-2044-4e17-81e4-44bc16d4e19d'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:55.542799 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-5760d76c-2044-4e17-81e4-44bc16d4e19d admin admin] The token cache is being invalidate because project d52a7a9bcabb4a40a6da7c31585f52c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81808) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:02:55.543130 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-5760d76c-2044-4e17-81e4-44bc16d4e19d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:55.545699 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-5760d76c-2044-4e17-81e4-44bc16d4e19d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:02:55.550367 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1164/2337] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 01:02:55 2022] DELETE /identity/v3/projects/d52a7a9bcabb4a40a6da7c31585f52c9 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:03:02.497049 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02908a0b-83a3-437f-bb81-9adf8a07409c None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:02.497049 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02908a0b-83a3-437f-bb81-9adf8a07409c None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:02.497049 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02908a0b-83a3-437f-bb81-9adf8a07409c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:02.533441 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-02908a0b-83a3-437f-bb81-9adf8a07409c None None] MFA Rules not processed for user `25f4c98243da409b94a51085b05eac24`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:03:02.534920 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-02908a0b-83a3-437f-bb81-9adf8a07409c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:02.718834 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1174/2338] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:03:02 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:03:02.760522 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760d76c-2044-4e17-81e4-44bc16d4e19d admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:02.763886 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-5760d76c-2044-4e17-81e4-44bc16d4e19d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:02.959974 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760d76c-2044-4e17-81e4-44bc16d4e19d admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:02.971381 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd3b0a-aa03-41b1-b9fd-af19e03197ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:02.972350 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd3b0a-aa03-41b1-b9fd-af19e03197ba service nova] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:02.972782 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd3b0a-aa03-41b1-b9fd-af19e03197ba service nova] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:02.973227 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd3b0a-aa03-41b1-b9fd-af19e03197ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:02.976274 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-00bd3b0a-aa03-41b1-b9fd-af19e03197ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:03.140349 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bd3b0a-aa03-41b1-b9fd-af19e03197ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:03.146716 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bd3b0a-aa03-41b1-b9fd-af19e03197ba service nova] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:03.174104 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1165/2339] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:03:02 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:03:04.339622 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02908a0b-83a3-437f-bb81-9adf8a07409c None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:04.345600 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-02908a0b-83a3-437f-bb81-9adf8a07409c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:04.528570 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02908a0b-83a3-437f-bb81-9adf8a07409c None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:04.537109 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef130f-698e-4661-ae59-4e72a9bfafbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:04.539365 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef130f-698e-4661-ae59-4e72a9bfafbf service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:04.540290 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef130f-698e-4661-ae59-4e72a9bfafbf service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:04.541543 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef130f-698e-4661-ae59-4e72a9bfafbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:04.544242 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-46ef130f-698e-4661-ae59-4e72a9bfafbf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:04.565605 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ef130f-698e-4661-ae59-4e72a9bfafbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:04.569863 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ef130f-698e-4661-ae59-4e72a9bfafbf service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:04.590389 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1175/2340] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:03:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:03:09.552140 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd3b0a-aa03-41b1-b9fd-af19e03197ba service nova] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:09.553389 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-00bd3b0a-aa03-41b1-b9fd-af19e03197ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:09.614362 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:03:09.766059 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd3b0a-aa03-41b1-b9fd-af19e03197ba service nova] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:09.775289 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f3911-2c2d-4601-93f5-1e482eed5e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:09.777296 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f3911-2c2d-4601-93f5-1e482eed5e3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:09.778875 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f3911-2c2d-4601-93f5-1e482eed5e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:09.779164 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f3911-2c2d-4601-93f5-1e482eed5e3a admin admin] PATH_INFO: `/v3/users/804819a9cecf492880df53e3a5e2cdf8` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:09.782315 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7f3911-2c2d-4601-93f5-1e482eed5e3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=804819a9cecf492880df53e3a5e2cdf8)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:09.784374 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7f3911-2c2d-4601-93f5-1e482eed5e3a admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:09.890592 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-4b7f3911-2c2d-4601-93f5-1e482eed5e3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '804819a9cecf492880df53e3a5e2cdf8'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:03:09.906825 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-4b7f3911-2c2d-4601-93f5-1e482eed5e3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '804819a9cecf492880df53e3a5e2cdf8'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:03:09.937417 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-4b7f3911-2c2d-4601-93f5-1e482eed5e3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '804819a9cecf492880df53e3a5e2cdf8'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:03:09.938685 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-4b7f3911-2c2d-4601-93f5-1e482eed5e3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '804819a9cecf492880df53e3a5e2cdf8'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:03:09.939531 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-4b7f3911-2c2d-4601-93f5-1e482eed5e3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '804819a9cecf492880df53e3a5e2cdf8'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:03:09.963277 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1166/2341] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 01:03:09 2022] DELETE /identity/v3/users/804819a9cecf492880df53e3a5e2cdf8 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:03:09.967562 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ece28-0dd0-4ff0-b778-98d93cee83e1 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:09.968520 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ece28-0dd0-4ff0-b778-98d93cee83e1 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:09.969017 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410ece28-0dd0-4ff0-b778-98d93cee83e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:10.012754 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-410ece28-0dd0-4ff0-b778-98d93cee83e1 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:03:10.014145 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-410ece28-0dd0-4ff0-b778-98d93cee83e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:10.149511 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1176/2342] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:03:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:03:10.168373 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f3911-2c2d-4601-93f5-1e482eed5e3a admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:10.170201 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-4b7f3911-2c2d-4601-93f5-1e482eed5e3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:10.362366 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f3911-2c2d-4601-93f5-1e482eed5e3a admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:10.362366 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c6a7d4-0b7b-48fc-9b0f-f726bf53dd4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:10.362366 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6a7d4-0b7b-48fc-9b0f-f726bf53dd4c service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:10.362366 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6a7d4-0b7b-48fc-9b0f-f726bf53dd4c service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:10.374110 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6a7d4-0b7b-48fc-9b0f-f726bf53dd4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:10.400834 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c6a7d4-0b7b-48fc-9b0f-f726bf53dd4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:10.402350 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c6a7d4-0b7b-48fc-9b0f-f726bf53dd4c service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:10.444437 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1167/2343] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:03:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:03:12.283564 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ece28-0dd0-4ff0-b778-98d93cee83e1 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:12.285405 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-410ece28-0dd0-4ff0-b778-98d93cee83e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:12.324737 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410ece28-0dd0-4ff0-b778-98d93cee83e1 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:12.331992 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ffa31b-43a3-412f-b256-9d0eb1a9f872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:12.332904 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ffa31b-43a3-412f-b256-9d0eb1a9f872 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:12.333575 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ffa31b-43a3-412f-b256-9d0eb1a9f872 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:12.334005 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ffa31b-43a3-412f-b256-9d0eb1a9f872 admin admin] PATH_INFO: `/v3/projects/8bbf1053efa54b9099e632d956cbd1d0` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:12.355369 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ffa31b-43a3-412f-b256-9d0eb1a9f872 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bbf1053efa54b9099e632d956cbd1d0)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:12.363530 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ffa31b-43a3-412f-b256-9d0eb1a9f872 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:12.415205 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:03:12.533009 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-f0ffa31b-43a3-412f-b256-9d0eb1a9f872 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bbf1053efa54b9099e632d956cbd1d0', 'request_id': 'req-f0ffa31b-43a3-412f-b256-9d0eb1a9f872'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:03:12.548479 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-f0ffa31b-43a3-412f-b256-9d0eb1a9f872 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bbf1053efa54b9099e632d956cbd1d0', 'request_id': 'req-f0ffa31b-43a3-412f-b256-9d0eb1a9f872'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:03:12.561305 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-f0ffa31b-43a3-412f-b256-9d0eb1a9f872 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bbf1053efa54b9099e632d956cbd1d0', 'request_id': 'req-f0ffa31b-43a3-412f-b256-9d0eb1a9f872'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:03:12.580932 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-f0ffa31b-43a3-412f-b256-9d0eb1a9f872 admin admin] The token cache is being invalidate because project 8bbf1053efa54b9099e632d956cbd1d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81807) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:03:12.586039 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-f0ffa31b-43a3-412f-b256-9d0eb1a9f872 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:03:12.596367 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-f0ffa31b-43a3-412f-b256-9d0eb1a9f872 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:03:12.603370 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1177/2344] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 01:03:12 2022] DELETE /identity/v3/projects/8bbf1053efa54b9099e632d956cbd1d0 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:03:12.605432 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97067cfa-33d4-4a42-aaee-901a3b694cb4 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:12.605994 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97067cfa-33d4-4a42-aaee-901a3b694cb4 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:12.605994 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97067cfa-33d4-4a42-aaee-901a3b694cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:12.661674 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-97067cfa-33d4-4a42-aaee-901a3b694cb4 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:03:12.666392 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-97067cfa-33d4-4a42-aaee-901a3b694cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:12.810028 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:03:12.961071 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1168/2345] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:03:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:03:12.965397 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab4af0-caf3-49a8-921f-73cf5166ba39 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:12.965687 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab4af0-caf3-49a8-921f-73cf5166ba39 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:12.966290 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab4af0-caf3-49a8-921f-73cf5166ba39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:13.015319 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-3dab4af0-caf3-49a8-921f-73cf5166ba39 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:03:13.017631 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-3dab4af0-caf3-49a8-921f-73cf5166ba39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:13.033240 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1178/2346] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:03:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:03:13.034049 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97067cfa-33d4-4a42-aaee-901a3b694cb4 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:13.052105 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97067cfa-33d4-4a42-aaee-901a3b694cb4 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:13.058212 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72f9b80-07bd-4cee-ab57-f7d840330959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:13.059447 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f9b80-07bd-4cee-ab57-f7d840330959 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:13.064601 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f9b80-07bd-4cee-ab57-f7d840330959 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:13.065391 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f9b80-07bd-4cee-ab57-f7d840330959 admin admin] PATH_INFO: `/v3/domains` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:13.066214 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72f9b80-07bd-4cee-ab57-f7d840330959 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:03:13.066617 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72f9b80-07bd-4cee-ab57-f7d840330959 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:13.068632 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72f9b80-07bd-4cee-ab57-f7d840330959 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:13.089523 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab4af0-caf3-49a8-921f-73cf5166ba39 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:13.097540 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1169/2347] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 01:03:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:03:13.101979 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab4af0-caf3-49a8-921f-73cf5166ba39 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:13.114497 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b9e24-c1a8-4320-b6fa-cfbcb35c4852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:13.117669 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b9e24-c1a8-4320-b6fa-cfbcb35c4852 admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:13.118363 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b9e24-c1a8-4320-b6fa-cfbcb35c4852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:13.119051 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b9e24-c1a8-4320-b6fa-cfbcb35c4852 admin admin] PATH_INFO: `/v3/projects` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:13.120402 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b9e24-c1a8-4320-b6fa-cfbcb35c4852 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:13.127327 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b9e24-c1a8-4320-b6fa-cfbcb35c4852 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:13.189751 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72f9b80-07bd-4cee-ab57-f7d840330959 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:13.200493 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1179/2348] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 01:03:13 2022] POST /identity/v3/projects => generated 383 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:03:13.203011 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72f9b80-07bd-4cee-ab57-f7d840330959 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:13.320182 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aef1ea-71c2-4b01-acae-8745b041571d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:13.320948 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aef1ea-71c2-4b01-acae-8745b041571d admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:13.321266 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aef1ea-71c2-4b01-acae-8745b041571d admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:13.321537 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aef1ea-71c2-4b01-acae-8745b041571d admin admin] PATH_INFO: `/v3/users` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:13.322678 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aef1ea-71c2-4b01-acae-8745b041571d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:13.325003 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aef1ea-71c2-4b01-acae-8745b041571d admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:13.371175 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1170/2349] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 01:03:13 2022] POST /identity/v3/users => generated 292 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:03:13.377281 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b9e24-c1a8-4320-b6fa-cfbcb35c4852 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:13.390467 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b9e24-c1a8-4320-b6fa-cfbcb35c4852 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:13.396266 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad0145-d393-4991-b13e-a86a6a1cae78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:13.397471 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad0145-d393-4991-b13e-a86a6a1cae78 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:13.397938 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad0145-d393-4991-b13e-a86a6a1cae78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:13.398600 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad0145-d393-4991-b13e-a86a6a1cae78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:13.399642 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ad0145-d393-4991-b13e-a86a6a1cae78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:13.401920 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ad0145-d393-4991-b13e-a86a6a1cae78 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:13.420735 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1180/2350] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:03:13 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:03:13.422651 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aef1ea-71c2-4b01-acae-8745b041571d admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:13.435814 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aef1ea-71c2-4b01-acae-8745b041571d admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:13.446508 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2f4d72-7d32-4686-803a-05a8d6d3923b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:13.447008 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f4d72-7d32-4686-803a-05a8d6d3923b admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:13.447476 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f4d72-7d32-4686-803a-05a8d6d3923b admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:13.448036 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f4d72-7d32-4686-803a-05a8d6d3923b admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:13.448764 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2f4d72-7d32-4686-803a-05a8d6d3923b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:13.450747 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2f4d72-7d32-4686-803a-05a8d6d3923b admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:13.472031 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad0145-d393-4991-b13e-a86a6a1cae78 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:13.472143 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1171/2351] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:03:13 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:03:13.493021 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad0145-d393-4991-b13e-a86a6a1cae78 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:13.508928 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea51b3-2338-4dda-bbdd-dc41d84dc34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:13.512698 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea51b3-2338-4dda-bbdd-dc41d84dc34f admin admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:13.515491 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea51b3-2338-4dda-bbdd-dc41d84dc34f admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:13.516744 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea51b3-2338-4dda-bbdd-dc41d84dc34f admin admin] PATH_INFO: `/v3/projects/9d9ebd80682b4c3ab858f1191157bae6/users/512a1d17262846e3b30d8fd8b3da1675/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:13.552926 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea51b3-2338-4dda-bbdd-dc41d84dc34f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d9ebd80682b4c3ab858f1191157bae6, user_id=512a1d17262846e3b30d8fd8b3da1675, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:13.567133 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea51b3-2338-4dda-bbdd-dc41d84dc34f admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:13.608621 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f848b-b4dd-4783-845d-0a80382f6bf7 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:13.609185 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f848b-b4dd-4783-845d-0a80382f6bf7 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:13.609185 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f848b-b4dd-4783-845d-0a80382f6bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:13.617939 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1181/2352] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 01:03:13 2022] PUT /identity/v3/projects/9d9ebd80682b4c3ab858f1191157bae6/users/512a1d17262846e3b30d8fd8b3da1675/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:03:13.669695 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-735f848b-b4dd-4783-845d-0a80382f6bf7 None None] MFA Rules not processed for user `512a1d17262846e3b30d8fd8b3da1675`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:03:13.670917 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-735f848b-b4dd-4783-845d-0a80382f6bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:13.883377 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1172/2353] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:03:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:03:13.910172 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea51b3-2338-4dda-bbdd-dc41d84dc34f admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:13.924523 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-95ea51b3-2338-4dda-bbdd-dc41d84dc34f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:14.187837 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea51b3-2338-4dda-bbdd-dc41d84dc34f admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:14.196001 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32907b29-b96a-47f5-9fac-50043a372b8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:14.202659 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32907b29-b96a-47f5-9fac-50043a372b8e service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:14.203013 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32907b29-b96a-47f5-9fac-50043a372b8e service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:14.203492 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32907b29-b96a-47f5-9fac-50043a372b8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:14.229010 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32907b29-b96a-47f5-9fac-50043a372b8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:14.239011 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32907b29-b96a-47f5-9fac-50043a372b8e service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:14.265238 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1182/2354] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:03:13 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:03:14.988979 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f848b-b4dd-4783-845d-0a80382f6bf7 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:15.064934 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:03:15.121810 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f848b-b4dd-4783-845d-0a80382f6bf7 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:15.129868 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccbcb23-45cb-4883-86d0-d24ffeb24f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:15.131710 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccbcb23-45cb-4883-86d0-d24ffeb24f62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:15.132787 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccbcb23-45cb-4883-86d0-d24ffeb24f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:15.133090 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccbcb23-45cb-4883-86d0-d24ffeb24f62 admin admin] PATH_INFO: `/v3/users/512a1d17262846e3b30d8fd8b3da1675` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:15.137550 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccbcb23-45cb-4883-86d0-d24ffeb24f62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=512a1d17262846e3b30d8fd8b3da1675)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:15.141117 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccbcb23-45cb-4883-86d0-d24ffeb24f62 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:15.279484 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-fccbcb23-45cb-4883-86d0-d24ffeb24f62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '512a1d17262846e3b30d8fd8b3da1675'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:03:15.293257 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-fccbcb23-45cb-4883-86d0-d24ffeb24f62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '512a1d17262846e3b30d8fd8b3da1675'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:03:15.311114 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-fccbcb23-45cb-4883-86d0-d24ffeb24f62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '512a1d17262846e3b30d8fd8b3da1675'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:03:15.312750 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-fccbcb23-45cb-4883-86d0-d24ffeb24f62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '512a1d17262846e3b30d8fd8b3da1675'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:03:15.313971 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-fccbcb23-45cb-4883-86d0-d24ffeb24f62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '512a1d17262846e3b30d8fd8b3da1675'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:03:15.335812 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1173/2355] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 01:03:14 2022] DELETE /identity/v3/users/512a1d17262846e3b30d8fd8b3da1675 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:03:15.337298 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8fb30-0f3d-4e23-b065-a1d2a1af38e1 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:15.337849 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8fb30-0f3d-4e23-b065-a1d2a1af38e1 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:15.337849 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8fb30-0f3d-4e23-b065-a1d2a1af38e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:15.373864 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-58b8fb30-0f3d-4e23-b065-a1d2a1af38e1 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:03:15.375205 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-58b8fb30-0f3d-4e23-b065-a1d2a1af38e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:15.453645 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:03:15.537013 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1183/2356] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:03:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:03:15.573136 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccbcb23-45cb-4883-86d0-d24ffeb24f62 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:15.576066 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-fccbcb23-45cb-4883-86d0-d24ffeb24f62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:15.794269 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccbcb23-45cb-4883-86d0-d24ffeb24f62 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:15.807863 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe761414-a1ac-49f7-b55d-3244fc855239 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:15.808485 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe761414-a1ac-49f7-b55d-3244fc855239 service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:15.810985 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe761414-a1ac-49f7-b55d-3244fc855239 service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:15.810985 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe761414-a1ac-49f7-b55d-3244fc855239 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:15.839727 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe761414-a1ac-49f7-b55d-3244fc855239 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:15.841718 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe761414-a1ac-49f7-b55d-3244fc855239 service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:15.900407 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1174/2357] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:03:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:03:17.743334 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b8fb30-0f3d-4e23-b065-a1d2a1af38e1 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:17.744838 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-58b8fb30-0f3d-4e23-b065-a1d2a1af38e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:17.778810 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b8fb30-0f3d-4e23-b065-a1d2a1af38e1 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:17.794610 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be361385-7d5f-42d0-8617-2896784362d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:17.798138 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be361385-7d5f-42d0-8617-2896784362d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:17.798362 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be361385-7d5f-42d0-8617-2896784362d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:17.798640 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be361385-7d5f-42d0-8617-2896784362d0 admin admin] PATH_INFO: `/v3/projects/9d9ebd80682b4c3ab858f1191157bae6` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:17.800784 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be361385-7d5f-42d0-8617-2896784362d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d9ebd80682b4c3ab858f1191157bae6)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:17.802758 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be361385-7d5f-42d0-8617-2896784362d0 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:17.926302 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-be361385-7d5f-42d0-8617-2896784362d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d9ebd80682b4c3ab858f1191157bae6', 'request_id': 'req-be361385-7d5f-42d0-8617-2896784362d0'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:03:17.968046 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-be361385-7d5f-42d0-8617-2896784362d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d9ebd80682b4c3ab858f1191157bae6', 'request_id': 'req-be361385-7d5f-42d0-8617-2896784362d0'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:03:17.987603 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-be361385-7d5f-42d0-8617-2896784362d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d9ebd80682b4c3ab858f1191157bae6', 'request_id': 'req-be361385-7d5f-42d0-8617-2896784362d0'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:03:18.017189 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-be361385-7d5f-42d0-8617-2896784362d0 admin admin] The token cache is being invalidate because project 9d9ebd80682b4c3ab858f1191157bae6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81807) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:03:18.018269 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-be361385-7d5f-42d0-8617-2896784362d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:03:18.019029 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-be361385-7d5f-42d0-8617-2896784362d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:03:18.030568 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d634009-4386-4329-aa16-4d02e584cd37 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:18.031115 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d634009-4386-4329-aa16-4d02e584cd37 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:18.031115 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d634009-4386-4329-aa16-4d02e584cd37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:18.034373 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1184/2358] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 01:03:17 2022] DELETE /identity/v3/projects/9d9ebd80682b4c3ab858f1191157bae6 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:03:18.063009 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-7d634009-4386-4329-aa16-4d02e584cd37 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:03:18.067024 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-7d634009-4386-4329-aa16-4d02e584cd37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:18.177801 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:03:18.202124 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1175/2359] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:03:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:03:18.210688 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539913a5-e2a9-437d-b5a1-e83e7286da68 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:18.210979 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539913a5-e2a9-437d-b5a1-e83e7286da68 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:18.211251 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539913a5-e2a9-437d-b5a1-e83e7286da68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:18.275868 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-539913a5-e2a9-437d-b5a1-e83e7286da68 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:03:18.278679 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-539913a5-e2a9-437d-b5a1-e83e7286da68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:18.295313 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1185/2360] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:03:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:03:18.301272 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d634009-4386-4329-aa16-4d02e584cd37 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:18.327619 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d634009-4386-4329-aa16-4d02e584cd37 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:18.347824 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b9b47-2f8f-4358-a274-0d2520fc6a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:18.350400 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b9b47-2f8f-4358-a274-0d2520fc6a83 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:18.350791 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b9b47-2f8f-4358-a274-0d2520fc6a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:18.375344 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251b9b47-2f8f-4358-a274-0d2520fc6a83 admin admin] PATH_INFO: `/v3/domains` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:18.376723 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251b9b47-2f8f-4358-a274-0d2520fc6a83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:03:18.377202 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251b9b47-2f8f-4358-a274-0d2520fc6a83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:18.380114 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251b9b47-2f8f-4358-a274-0d2520fc6a83 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:18.402899 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1176/2361] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 01:03:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:03:18.408876 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539913a5-e2a9-437d-b5a1-e83e7286da68 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:18.441578 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539913a5-e2a9-437d-b5a1-e83e7286da68 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:18.449235 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a903f3c0-23c6-4882-aaaf-db6f23ca17e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:18.454514 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a903f3c0-23c6-4882-aaaf-db6f23ca17e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:18.456180 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a903f3c0-23c6-4882-aaaf-db6f23ca17e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:18.459142 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a903f3c0-23c6-4882-aaaf-db6f23ca17e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:18.460098 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a903f3c0-23c6-4882-aaaf-db6f23ca17e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:18.465334 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a903f3c0-23c6-4882-aaaf-db6f23ca17e3 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:18.564475 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1186/2362] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 01:03:18 2022] POST /identity/v3/projects => generated 359 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:03:18.570204 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b9b47-2f8f-4358-a274-0d2520fc6a83 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:18.597839 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251b9b47-2f8f-4358-a274-0d2520fc6a83 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:18.765321 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6142e37b-5d15-4bcc-9360-572d0991d06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:18.766319 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142e37b-5d15-4bcc-9360-572d0991d06d admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:18.766319 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142e37b-5d15-4bcc-9360-572d0991d06d admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:18.766503 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6142e37b-5d15-4bcc-9360-572d0991d06d admin admin] PATH_INFO: `/v3/users` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:18.767220 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6142e37b-5d15-4bcc-9360-572d0991d06d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:18.772368 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6142e37b-5d15-4bcc-9360-572d0991d06d admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:18.817585 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1177/2363] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 01:03:18 2022] POST /identity/v3/users => generated 280 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:03:18.825290 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a903f3c0-23c6-4882-aaaf-db6f23ca17e3 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:18.848883 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a903f3c0-23c6-4882-aaaf-db6f23ca17e3 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:18.855467 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d7bb0-cfa3-4ac7-a18a-169befa91f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:18.856363 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d7bb0-cfa3-4ac7-a18a-169befa91f00 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:18.856875 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d7bb0-cfa3-4ac7-a18a-169befa91f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:18.858088 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d7bb0-cfa3-4ac7-a18a-169befa91f00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:18.859141 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7d7bb0-cfa3-4ac7-a18a-169befa91f00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:18.863357 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7d7bb0-cfa3-4ac7-a18a-169befa91f00 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:18.893995 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1187/2364] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:03:18 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:03:18.898267 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6142e37b-5d15-4bcc-9360-572d0991d06d admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:18.909028 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6142e37b-5d15-4bcc-9360-572d0991d06d admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:18.940505 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffd6330-80ea-4fb9-8e4e-8b07748a83aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:18.941151 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd6330-80ea-4fb9-8e4e-8b07748a83aa admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:18.941433 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd6330-80ea-4fb9-8e4e-8b07748a83aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:18.941707 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd6330-80ea-4fb9-8e4e-8b07748a83aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:18.942475 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffd6330-80ea-4fb9-8e4e-8b07748a83aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:18.944852 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffd6330-80ea-4fb9-8e4e-8b07748a83aa admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:18.972435 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1178/2365] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:03:18 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:03:18.976911 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d7bb0-cfa3-4ac7-a18a-169befa91f00 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:18.997533 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d7bb0-cfa3-4ac7-a18a-169befa91f00 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:19.006267 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361a558-7f50-4f0e-b82f-1eacfa90ad6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:19.006980 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361a558-7f50-4f0e-b82f-1eacfa90ad6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:19.007625 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361a558-7f50-4f0e-b82f-1eacfa90ad6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:19.007940 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361a558-7f50-4f0e-b82f-1eacfa90ad6c admin admin] PATH_INFO: `/v3/projects/6758ef1f37c34364b9cee76a0abe18e4/users/b05f6aeb21534f4f84acbabe5a40c12c/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:19.040558 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f361a558-7f50-4f0e-b82f-1eacfa90ad6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6758ef1f37c34364b9cee76a0abe18e4, user_id=b05f6aeb21534f4f84acbabe5a40c12c, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:19.058480 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f361a558-7f50-4f0e-b82f-1eacfa90ad6c admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:19.100034 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1188/2366] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 01:03:18 2022] PUT /identity/v3/projects/6758ef1f37c34364b9cee76a0abe18e4/users/b05f6aeb21534f4f84acbabe5a40c12c/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:03:19.112052 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089159f-eea3-4716-bd1b-0e167b25066a None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:19.112681 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089159f-eea3-4716-bd1b-0e167b25066a None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:19.112681 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089159f-eea3-4716-bd1b-0e167b25066a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:19.171896 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-5089159f-eea3-4716-bd1b-0e167b25066a None None] MFA Rules not processed for user `b05f6aeb21534f4f84acbabe5a40c12c`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:03:19.173107 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-5089159f-eea3-4716-bd1b-0e167b25066a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:19.270102 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1179/2367] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:03:19 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:03:19.295776 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361a558-7f50-4f0e-b82f-1eacfa90ad6c admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:19.298208 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-f361a558-7f50-4f0e-b82f-1eacfa90ad6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:19.444476 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361a558-7f50-4f0e-b82f-1eacfa90ad6c admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:19.449289 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d022f0f-5cd6-4447-a87d-2fe659a184ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:19.450229 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d022f0f-5cd6-4447-a87d-2fe659a184ec service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:19.450417 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d022f0f-5cd6-4447-a87d-2fe659a184ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:19.450752 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d022f0f-5cd6-4447-a87d-2fe659a184ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:19.464867 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d022f0f-5cd6-4447-a87d-2fe659a184ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:19.469380 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d022f0f-5cd6-4447-a87d-2fe659a184ec service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:19.492483 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1189/2368] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:03:19 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:03:29.265985 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=74,keystone:INSERT=3 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:03:29.484054 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:03:29.503473 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5089159f-eea3-4716-bd1b-0e167b25066a None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:29.505589 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-5089159f-eea3-4716-bd1b-0e167b25066a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:29.715954 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5089159f-eea3-4716-bd1b-0e167b25066a None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:29.722031 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee77d45-a6f3-4c9f-b779-2c6ea76ac1a9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4fc1d11f5641b0b5f301b234282aa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:29.722822 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee77d45-a6f3-4c9f-b779-2c6ea76ac1a9 service placement] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:29.723103 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee77d45-a6f3-4c9f-b779-2c6ea76ac1a9 service placement] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:29.723376 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee77d45-a6f3-4c9f-b779-2c6ea76ac1a9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:29.725381 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-7ee77d45-a6f3-4c9f-b779-2c6ea76ac1a9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:29.755274 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee77d45-a6f3-4c9f-b779-2c6ea76ac1a9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:29.757157 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee77d45-a6f3-4c9f-b779-2c6ea76ac1a9 service placement] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:29.833180 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1180/2369] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:03:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:03:31.833472 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d022f0f-5cd6-4447-a87d-2fe659a184ec service neutron] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:31.837090 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-9d022f0f-5cd6-4447-a87d-2fe659a184ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:32.045924 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d022f0f-5cd6-4447-a87d-2fe659a184ec service neutron] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:32.051792 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd2661a-da30-4975-b606-816675bae416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:32.052620 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2661a-da30-4975-b606-816675bae416 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:32.053435 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2661a-da30-4975-b606-816675bae416 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:32.053867 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2661a-da30-4975-b606-816675bae416 admin admin] PATH_INFO: `/v3/users/7b7c863c37fd47b1ada66191c3b9881a` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:32.055435 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd2661a-da30-4975-b606-816675bae416 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b7c863c37fd47b1ada66191c3b9881a)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:32.057727 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd2661a-da30-4975-b606-816675bae416 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:32.244154 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-2dd2661a-da30-4975-b606-816675bae416 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b7c863c37fd47b1ada66191c3b9881a'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:03:32.300846 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-2dd2661a-da30-4975-b606-816675bae416 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b7c863c37fd47b1ada66191c3b9881a'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:03:32.321860 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-2dd2661a-da30-4975-b606-816675bae416 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b7c863c37fd47b1ada66191c3b9881a'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:03:32.322628 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-2dd2661a-da30-4975-b606-816675bae416 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b7c863c37fd47b1ada66191c3b9881a'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:03:32.323408 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-2dd2661a-da30-4975-b606-816675bae416 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b7c863c37fd47b1ada66191c3b9881a'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:03:32.412315 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1190/2370] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 01:03:31 2022] DELETE /identity/v3/users/7b7c863c37fd47b1ada66191c3b9881a => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:03:32.414241 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc321eb-0830-4ed8-9099-570f9587a5b5 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:32.414792 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc321eb-0830-4ed8-9099-570f9587a5b5 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:32.414957 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc321eb-0830-4ed8-9099-570f9587a5b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:32.455653 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-9cc321eb-0830-4ed8-9099-570f9587a5b5 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:03:32.457297 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-9cc321eb-0830-4ed8-9099-570f9587a5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:32.608140 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1181/2371] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:03:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:03:32.634134 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd2661a-da30-4975-b606-816675bae416 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:32.636347 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-2dd2661a-da30-4975-b606-816675bae416 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:32.789914 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd2661a-da30-4975-b606-816675bae416 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:32.795049 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782268a2-fe91-46f7-a078-b5b3870ce7d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:32.796503 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782268a2-fe91-46f7-a078-b5b3870ce7d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:32.797180 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782268a2-fe91-46f7-a078-b5b3870ce7d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:32.797607 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782268a2-fe91-46f7-a078-b5b3870ce7d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:32.833421 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782268a2-fe91-46f7-a078-b5b3870ce7d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:32.835238 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782268a2-fe91-46f7-a078-b5b3870ce7d7 service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:32.867237 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1191/2372] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:03:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:03:33.833764 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc321eb-0830-4ed8-9099-570f9587a5b5 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:33.835930 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-9cc321eb-0830-4ed8-9099-570f9587a5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:33.876265 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc321eb-0830-4ed8-9099-570f9587a5b5 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:33.895725 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76e5869-5d7e-44bf-bc33-ff3cda12a90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:33.896600 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e5869-5d7e-44bf-bc33-ff3cda12a90a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:33.897034 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e5869-5d7e-44bf-bc33-ff3cda12a90a admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:33.897602 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e5869-5d7e-44bf-bc33-ff3cda12a90a admin admin] PATH_INFO: `/v3/projects/c4cf2f90b00f4a3a999d90e5497aa4d0` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:33.908993 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76e5869-5d7e-44bf-bc33-ff3cda12a90a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4cf2f90b00f4a3a999d90e5497aa4d0)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:33.911297 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76e5869-5d7e-44bf-bc33-ff3cda12a90a admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:34.009078 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-e76e5869-5d7e-44bf-bc33-ff3cda12a90a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4cf2f90b00f4a3a999d90e5497aa4d0', 'request_id': 'req-e76e5869-5d7e-44bf-bc33-ff3cda12a90a'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:03:34.024746 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-e76e5869-5d7e-44bf-bc33-ff3cda12a90a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4cf2f90b00f4a3a999d90e5497aa4d0', 'request_id': 'req-e76e5869-5d7e-44bf-bc33-ff3cda12a90a'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:03:34.035577 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-e76e5869-5d7e-44bf-bc33-ff3cda12a90a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4cf2f90b00f4a3a999d90e5497aa4d0', 'request_id': 'req-e76e5869-5d7e-44bf-bc33-ff3cda12a90a'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:03:34.052321 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-e76e5869-5d7e-44bf-bc33-ff3cda12a90a admin admin] The token cache is being invalidate because project c4cf2f90b00f4a3a999d90e5497aa4d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81808) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:03:34.053088 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-e76e5869-5d7e-44bf-bc33-ff3cda12a90a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:03:34.054282 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-e76e5869-5d7e-44bf-bc33-ff3cda12a90a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:03:34.060571 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1182/2373] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 01:03:33 2022] DELETE /identity/v3/projects/c4cf2f90b00f4a3a999d90e5497aa4d0 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:03:34.061864 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27ee41-94bd-4a9f-adfb-4221db045414 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:34.062422 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27ee41-94bd-4a9f-adfb-4221db045414 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:34.062511 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27ee41-94bd-4a9f-adfb-4221db045414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:34.097719 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-1a27ee41-94bd-4a9f-adfb-4221db045414 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:03:34.111464 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-1a27ee41-94bd-4a9f-adfb-4221db045414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:34.150376 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:03:34.257126 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1192/2374] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:03:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:03:34.264247 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b23a21-258d-43fb-b5e5-48469046828a None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:34.264841 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b23a21-258d-43fb-b5e5-48469046828a None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:34.265401 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b23a21-258d-43fb-b5e5-48469046828a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:34.300811 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-51b23a21-258d-43fb-b5e5-48469046828a None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:03:34.302777 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-51b23a21-258d-43fb-b5e5-48469046828a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:34.314428 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1183/2375] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:03:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:03:34.319510 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a27ee41-94bd-4a9f-adfb-4221db045414 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:34.330699 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a27ee41-94bd-4a9f-adfb-4221db045414 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:34.346151 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e0e20-fe5f-4988-83a9-73f96d1ee66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:34.346813 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e0e20-fe5f-4988-83a9-73f96d1ee66b admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:34.347092 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e0e20-fe5f-4988-83a9-73f96d1ee66b admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:34.347363 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e0e20-fe5f-4988-83a9-73f96d1ee66b admin admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:34.348077 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e0e20-fe5f-4988-83a9-73f96d1ee66b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:03:34.348378 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e0e20-fe5f-4988-83a9-73f96d1ee66b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:34.354705 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e0e20-fe5f-4988-83a9-73f96d1ee66b admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:34.386196 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1193/2376] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 01:03:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:03:34.390377 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b23a21-258d-43fb-b5e5-48469046828a None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:34.407612 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b23a21-258d-43fb-b5e5-48469046828a None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:34.414056 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458b5b02-54be-48a1-9f1b-3ef581796b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:34.415776 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b5b02-54be-48a1-9f1b-3ef581796b84 admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:34.416237 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b5b02-54be-48a1-9f1b-3ef581796b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:34.416669 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b5b02-54be-48a1-9f1b-3ef581796b84 admin admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:34.417490 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458b5b02-54be-48a1-9f1b-3ef581796b84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:34.421368 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458b5b02-54be-48a1-9f1b-3ef581796b84 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:34.436075 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:03:34.486264 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1184/2377] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 01:03:34 2022] POST /identity/v3/projects => generated 371 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:03:34.490448 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e0e20-fe5f-4988-83a9-73f96d1ee66b admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:34.503423 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e0e20-fe5f-4988-83a9-73f96d1ee66b admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:34.598974 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af712a-ae96-483a-a4f7-f4e57286bf53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:34.600045 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af712a-ae96-483a-a4f7-f4e57286bf53 admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:34.600581 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af712a-ae96-483a-a4f7-f4e57286bf53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:34.601084 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af712a-ae96-483a-a4f7-f4e57286bf53 admin admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:34.601951 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01af712a-ae96-483a-a4f7-f4e57286bf53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:34.604304 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01af712a-ae96-483a-a4f7-f4e57286bf53 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:34.634268 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1194/2378] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 01:03:34 2022] POST /identity/v3/users => generated 286 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:03:34.638956 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458b5b02-54be-48a1-9f1b-3ef581796b84 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:34.661117 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458b5b02-54be-48a1-9f1b-3ef581796b84 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:34.670074 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3304104-2832-46e3-94ed-8e3f73dbfa06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:34.671437 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3304104-2832-46e3-94ed-8e3f73dbfa06 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:34.673180 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3304104-2832-46e3-94ed-8e3f73dbfa06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:34.673595 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3304104-2832-46e3-94ed-8e3f73dbfa06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:34.674407 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3304104-2832-46e3-94ed-8e3f73dbfa06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:34.676585 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3304104-2832-46e3-94ed-8e3f73dbfa06 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:34.691354 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1185/2379] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:03:34.695043 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af712a-ae96-483a-a4f7-f4e57286bf53 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:34.710421 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af712a-ae96-483a-a4f7-f4e57286bf53 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:34.717189 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d062f8-3c7e-406f-83a9-9950db49d358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:34.718090 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d062f8-3c7e-406f-83a9-9950db49d358 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:34.718647 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d062f8-3c7e-406f-83a9-9950db49d358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:34.719310 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d062f8-3c7e-406f-83a9-9950db49d358 admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:34.720271 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d062f8-3c7e-406f-83a9-9950db49d358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:34.722753 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d062f8-3c7e-406f-83a9-9950db49d358 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:34.741553 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1195/2380] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:03:34.742447 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3304104-2832-46e3-94ed-8e3f73dbfa06 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:34.756421 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3304104-2832-46e3-94ed-8e3f73dbfa06 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:34.768245 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c67937-0c8e-43d3-9158-beec3382eb3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:34.769247 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c67937-0c8e-43d3-9158-beec3382eb3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:34.770013 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c67937-0c8e-43d3-9158-beec3382eb3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:34.770720 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c67937-0c8e-43d3-9158-beec3382eb3a admin admin] PATH_INFO: `/v3/projects/029c6135ed6d4ad183d3a5eb25d0e96a/users/d7b95b9d9a5a40ff884d2fd99c7a0593/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:34.806462 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c67937-0c8e-43d3-9158-beec3382eb3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=029c6135ed6d4ad183d3a5eb25d0e96a, user_id=d7b95b9d9a5a40ff884d2fd99c7a0593, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:34.810514 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c67937-0c8e-43d3-9158-beec3382eb3a admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:34.848501 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1186/2381] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 01:03:34 2022] PUT /identity/v3/projects/029c6135ed6d4ad183d3a5eb25d0e96a/users/d7b95b9d9a5a40ff884d2fd99c7a0593/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:03:34.859315 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab47e69-2b5f-4e6f-9885-8ea6e51da852 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:34.859875 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab47e69-2b5f-4e6f-9885-8ea6e51da852 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:34.860318 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab47e69-2b5f-4e6f-9885-8ea6e51da852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:34.915171 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-fab47e69-2b5f-4e6f-9885-8ea6e51da852 None None] MFA Rules not processed for user `d7b95b9d9a5a40ff884d2fd99c7a0593`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:03:34.916920 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-fab47e69-2b5f-4e6f-9885-8ea6e51da852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:35.024024 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1196/2382] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:03:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:03:35.037654 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c67937-0c8e-43d3-9158-beec3382eb3a admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:35.041183 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-85c67937-0c8e-43d3-9158-beec3382eb3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:35.152886 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c67937-0c8e-43d3-9158-beec3382eb3a admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:35.161185 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bea0a60-3164-4381-b180-9d2192118648 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:35.161947 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea0a60-3164-4381-b180-9d2192118648 service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:35.162723 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea0a60-3164-4381-b180-9d2192118648 service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:35.162723 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea0a60-3164-4381-b180-9d2192118648 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:35.176316 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bea0a60-3164-4381-b180-9d2192118648 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:35.178819 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bea0a60-3164-4381-b180-9d2192118648 service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:35.197606 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1187/2383] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:03:35 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:03:36.986324 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381a314-2e5e-4d48-8d1f-27b5f7f74c11 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:36.986854 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381a314-2e5e-4d48-8d1f-27b5f7f74c11 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:36.986975 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381a314-2e5e-4d48-8d1f-27b5f7f74c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:37.036140 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-3381a314-2e5e-4d48-8d1f-27b5f7f74c11 None None] MFA Rules not processed for user `1f6108050e934edf922491f983d9c9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:03:37.038940 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-3381a314-2e5e-4d48-8d1f-27b5f7f74c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:37.062205 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:03:37.135921 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1197/2384] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:03:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:03:37.216593 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bea0a60-3164-4381-b180-9d2192118648 service neutron] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:37.218765 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-2bea0a60-3164-4381-b180-9d2192118648 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:37.373420 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bea0a60-3164-4381-b180-9d2192118648 service neutron] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:37.379890 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3bc027-e932-4caa-a957-b8d55118dd99 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22053bd9632346aab63814f740415f69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:37.380582 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3bc027-e932-4caa-a957-b8d55118dd99 service glance] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:37.380885 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3bc027-e932-4caa-a957-b8d55118dd99 service glance] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:37.381133 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3bc027-e932-4caa-a957-b8d55118dd99 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:37.385174 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-9a3bc027-e932-4caa-a957-b8d55118dd99 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:37.553753 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:03:37.562653 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3bc027-e932-4caa-a957-b8d55118dd99 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:37.565171 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3bc027-e932-4caa-a957-b8d55118dd99 service glance] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:37.598207 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1188/2385] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:03:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:03:38.789879 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381a314-2e5e-4d48-8d1f-27b5f7f74c11 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:38.849343 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381a314-2e5e-4d48-8d1f-27b5f7f74c11 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:38.860160 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2369ec-870b-4f23-aad7-aef057e18b26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:38.863192 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2369ec-870b-4f23-aad7-aef057e18b26 service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:38.866044 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2369ec-870b-4f23-aad7-aef057e18b26 service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:38.866895 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2369ec-870b-4f23-aad7-aef057e18b26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:38.882799 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-5c2369ec-870b-4f23-aad7-aef057e18b26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:38.929119 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2369ec-870b-4f23-aad7-aef057e18b26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:38.931302 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2369ec-870b-4f23-aad7-aef057e18b26 service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:38.958414 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1198/2386] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:03:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:03:41.270817 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3bc027-e932-4caa-a957-b8d55118dd99 service glance] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:41.281162 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-9a3bc027-e932-4caa-a957-b8d55118dd99 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:41.411520 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3bc027-e932-4caa-a957-b8d55118dd99 service glance] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:41.417929 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2c9aab-0921-423e-8785-66f58b431ebd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4fc1d11f5641b0b5f301b234282aa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:41.419323 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c9aab-0921-423e-8785-66f58b431ebd service placement] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:41.419723 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c9aab-0921-423e-8785-66f58b431ebd service placement] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:41.420230 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c9aab-0921-423e-8785-66f58b431ebd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:41.423360 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-0e2c9aab-0921-423e-8785-66f58b431ebd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:41.441675 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2369ec-870b-4f23-aad7-aef057e18b26 service neutron] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:41.443578 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-5c2369ec-870b-4f23-aad7-aef057e18b26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:41.455125 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2c9aab-0921-423e-8785-66f58b431ebd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:41.464302 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2c9aab-0921-423e-8785-66f58b431ebd service placement] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:41.485848 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1189/2387] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:03:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:03:41.620898 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2369ec-870b-4f23-aad7-aef057e18b26 service neutron] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:41.630300 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdda3b3-c7fe-4a6f-8498-ed8d556a9fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:41.633013 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdda3b3-c7fe-4a6f-8498-ed8d556a9fa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:41.636249 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdda3b3-c7fe-4a6f-8498-ed8d556a9fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:41.636713 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdda3b3-c7fe-4a6f-8498-ed8d556a9fa1 admin admin] PATH_INFO: `/v3/users/faca032d366e42d68d51303db29baca0` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:41.638364 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdda3b3-c7fe-4a6f-8498-ed8d556a9fa1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=faca032d366e42d68d51303db29baca0)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:41.641643 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fed4ad-06f9-43ca-ba62-eed9fd5cd42c None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:41.641813 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fed4ad-06f9-43ca-ba62-eed9fd5cd42c None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:41.642087 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fed4ad-06f9-43ca-ba62-eed9fd5cd42c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:41.644628 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdda3b3-c7fe-4a6f-8498-ed8d556a9fa1 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:41.675830 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-24fed4ad-06f9-43ca-ba62-eed9fd5cd42c None None] MFA Rules not processed for user `b44e7109127a468aa2574c23fc9807b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:03:41.679263 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-24fed4ad-06f9-43ca-ba62-eed9fd5cd42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:41.766184 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-2cdda3b3-c7fe-4a6f-8498-ed8d556a9fa1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'faca032d366e42d68d51303db29baca0'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:03:41.797788 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-2cdda3b3-c7fe-4a6f-8498-ed8d556a9fa1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'faca032d366e42d68d51303db29baca0'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:03:41.806096 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1190/2388] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:03:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:03:41.828933 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-2cdda3b3-c7fe-4a6f-8498-ed8d556a9fa1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'faca032d366e42d68d51303db29baca0'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:03:41.829919 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-2cdda3b3-c7fe-4a6f-8498-ed8d556a9fa1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'faca032d366e42d68d51303db29baca0'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:03:41.832020 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-2cdda3b3-c7fe-4a6f-8498-ed8d556a9fa1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'faca032d366e42d68d51303db29baca0'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:03:41.868843 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1199/2389] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 01:03:41 2022] DELETE /identity/v3/users/faca032d366e42d68d51303db29baca0 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:03:41.873569 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceeb076-d114-4fdf-ae05-8ebbffa40ac6 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:41.873966 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceeb076-d114-4fdf-ae05-8ebbffa40ac6 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:41.874401 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceeb076-d114-4fdf-ae05-8ebbffa40ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:41.896519 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-dceeb076-d114-4fdf-ae05-8ebbffa40ac6 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:03:41.898580 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-dceeb076-d114-4fdf-ae05-8ebbffa40ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:42.030570 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1191/2390] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:03:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:03:42.068246 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdda3b3-c7fe-4a6f-8498-ed8d556a9fa1 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:42.070452 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-2cdda3b3-c7fe-4a6f-8498-ed8d556a9fa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:42.086541 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceeb076-d114-4fdf-ae05-8ebbffa40ac6 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:42.088195 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-dceeb076-d114-4fdf-ae05-8ebbffa40ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:42.197277 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:03:42.198098 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:03:42.243906 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdda3b3-c7fe-4a6f-8498-ed8d556a9fa1 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:42.248684 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7870991-e67f-40bb-a61d-a90b08a54b30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:42.249691 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7870991-e67f-40bb-a61d-a90b08a54b30 service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:42.250210 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7870991-e67f-40bb-a61d-a90b08a54b30 service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:42.250640 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7870991-e67f-40bb-a61d-a90b08a54b30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:42.257193 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-b7870991-e67f-40bb-a61d-a90b08a54b30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:42.354829 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceeb076-d114-4fdf-ae05-8ebbffa40ac6 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:42.372612 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36322c6-2fb1-489b-a12d-4a9aad498b3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:42.374439 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36322c6-2fb1-489b-a12d-4a9aad498b3a service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:42.375251 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36322c6-2fb1-489b-a12d-4a9aad498b3a service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:42.376332 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36322c6-2fb1-489b-a12d-4a9aad498b3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:42.396491 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36322c6-2fb1-489b-a12d-4a9aad498b3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:42.398872 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36322c6-2fb1-489b-a12d-4a9aad498b3a service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:42.413750 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1192/2391] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:03:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:03:42.488886 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7870991-e67f-40bb-a61d-a90b08a54b30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:42.490534 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7870991-e67f-40bb-a61d-a90b08a54b30 service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:42.522681 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1200/2392] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:03:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:03:43.199902 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36322c6-2fb1-489b-a12d-4a9aad498b3a service neutron] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:43.201399 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-e36322c6-2fb1-489b-a12d-4a9aad498b3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:43.222566 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36322c6-2fb1-489b-a12d-4a9aad498b3a service neutron] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:43.239354 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d8b73f-f355-41ad-8bbf-c71eba93ceab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:43.240352 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8b73f-f355-41ad-8bbf-c71eba93ceab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:43.240811 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8b73f-f355-41ad-8bbf-c71eba93ceab admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:43.241418 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8b73f-f355-41ad-8bbf-c71eba93ceab admin admin] PATH_INFO: `/v3/projects/0930de881d984103a5efbc2ee3c8935a` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:43.242623 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d8b73f-f355-41ad-8bbf-c71eba93ceab admin admin] RBAC: Authorizing `identity:delete_project(project_id=0930de881d984103a5efbc2ee3c8935a)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:43.244994 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d8b73f-f355-41ad-8bbf-c71eba93ceab admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:43.412724 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-86d8b73f-f355-41ad-8bbf-c71eba93ceab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0930de881d984103a5efbc2ee3c8935a', 'request_id': 'req-86d8b73f-f355-41ad-8bbf-c71eba93ceab'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:03:43.437409 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-86d8b73f-f355-41ad-8bbf-c71eba93ceab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0930de881d984103a5efbc2ee3c8935a', 'request_id': 'req-86d8b73f-f355-41ad-8bbf-c71eba93ceab'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:03:43.453915 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-86d8b73f-f355-41ad-8bbf-c71eba93ceab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0930de881d984103a5efbc2ee3c8935a', 'request_id': 'req-86d8b73f-f355-41ad-8bbf-c71eba93ceab'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:03:43.506763 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-86d8b73f-f355-41ad-8bbf-c71eba93ceab admin admin] The token cache is being invalidate because project 0930de881d984103a5efbc2ee3c8935a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81808) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:03:43.507271 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-86d8b73f-f355-41ad-8bbf-c71eba93ceab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:03:43.510404 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-86d8b73f-f355-41ad-8bbf-c71eba93ceab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:03:43.512862 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1193/2393] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 01:03:43 2022] DELETE /identity/v3/projects/0930de881d984103a5efbc2ee3c8935a => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:03:43.518183 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0049573-5165-436c-a84b-73297e1f4877 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:43.520200 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0049573-5165-436c-a84b-73297e1f4877 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:43.520670 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0049573-5165-436c-a84b-73297e1f4877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:43.584010 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-b0049573-5165-436c-a84b-73297e1f4877 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:03:43.588653 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-b0049573-5165-436c-a84b-73297e1f4877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:43.768055 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1201/2394] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:03:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:03:43.777213 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af224a8-ab6b-4295-8c79-19c9a23c51ce None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:43.777970 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af224a8-ab6b-4295-8c79-19c9a23c51ce None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:43.778461 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af224a8-ab6b-4295-8c79-19c9a23c51ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:43.832819 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-6af224a8-ab6b-4295-8c79-19c9a23c51ce None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:03:43.837128 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-6af224a8-ab6b-4295-8c79-19c9a23c51ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:43.859096 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1194/2395] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:03:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:03:43.862976 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0049573-5165-436c-a84b-73297e1f4877 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:43.874916 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0049573-5165-436c-a84b-73297e1f4877 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:43.880971 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c416c85-2d5b-4c0f-8719-ac4e0bbc1dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:43.881855 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c416c85-2d5b-4c0f-8719-ac4e0bbc1dbf admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:43.882275 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c416c85-2d5b-4c0f-8719-ac4e0bbc1dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:43.882834 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c416c85-2d5b-4c0f-8719-ac4e0bbc1dbf admin admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:43.883876 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c416c85-2d5b-4c0f-8719-ac4e0bbc1dbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:03:43.884279 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c416c85-2d5b-4c0f-8719-ac4e0bbc1dbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:43.887701 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c416c85-2d5b-4c0f-8719-ac4e0bbc1dbf admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:43.908117 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1202/2396] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 01:03:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:03:43.908991 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af224a8-ab6b-4295-8c79-19c9a23c51ce None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:43.920799 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af224a8-ab6b-4295-8c79-19c9a23c51ce None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:43.928485 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8238a19c-bc0f-46b7-be91-c173940cfacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:43.929750 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8238a19c-bc0f-46b7-be91-c173940cfacc admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:43.930321 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8238a19c-bc0f-46b7-be91-c173940cfacc admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:43.930771 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8238a19c-bc0f-46b7-be91-c173940cfacc admin admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:43.932920 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8238a19c-bc0f-46b7-be91-c173940cfacc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:43.937357 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8238a19c-bc0f-46b7-be91-c173940cfacc admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:43.984747 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1195/2397] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 01:03:43 2022] POST /identity/v3/projects => generated 359 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:03:43.988679 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c416c85-2d5b-4c0f-8719-ac4e0bbc1dbf admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:44.000330 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c416c85-2d5b-4c0f-8719-ac4e0bbc1dbf admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:44.087802 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:03:44.107458 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ca3b6-404e-4dc3-83a0-6d55389857ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:44.107458 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ca3b6-404e-4dc3-83a0-6d55389857ee admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:44.107458 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ca3b6-404e-4dc3-83a0-6d55389857ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:44.108139 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ca3b6-404e-4dc3-83a0-6d55389857ee admin admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:44.108725 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76ca3b6-404e-4dc3-83a0-6d55389857ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:44.111217 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76ca3b6-404e-4dc3-83a0-6d55389857ee admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:44.142466 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1203/2398] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 01:03:43 2022] POST /identity/v3/users => generated 280 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:03:44.143630 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8238a19c-bc0f-46b7-be91-c173940cfacc admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:44.156177 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8238a19c-bc0f-46b7-be91-c173940cfacc admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:44.163553 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede3497-f262-4264-91f5-2b34a6af8634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:44.164760 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede3497-f262-4264-91f5-2b34a6af8634 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:44.165398 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede3497-f262-4264-91f5-2b34a6af8634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:44.165775 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede3497-f262-4264-91f5-2b34a6af8634 admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:44.167215 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eede3497-f262-4264-91f5-2b34a6af8634 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:44.168994 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eede3497-f262-4264-91f5-2b34a6af8634 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:44.191398 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1196/2399] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:03:44 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:03:44.193122 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ca3b6-404e-4dc3-83a0-6d55389857ee admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:44.210826 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ca3b6-404e-4dc3-83a0-6d55389857ee admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:44.216330 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f84f4-8e10-468d-b6c4-4bb6496b3200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:44.217262 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f84f4-8e10-468d-b6c4-4bb6496b3200 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:44.218660 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f84f4-8e10-468d-b6c4-4bb6496b3200 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:44.219130 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f84f4-8e10-468d-b6c4-4bb6496b3200 admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:44.220463 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f84f4-8e10-468d-b6c4-4bb6496b3200 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:44.222516 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f84f4-8e10-468d-b6c4-4bb6496b3200 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:44.241135 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede3497-f262-4264-91f5-2b34a6af8634 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:44.248988 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1204/2400] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:03:44 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:03:44.255482 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede3497-f262-4264-91f5-2b34a6af8634 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:44.263812 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8382fa3-6c27-478c-adec-15d2cf3a2509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:44.264668 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8382fa3-6c27-478c-adec-15d2cf3a2509 admin admin] REQUEST_METHOD: `PUT` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:44.265044 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8382fa3-6c27-478c-adec-15d2cf3a2509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:44.265558 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8382fa3-6c27-478c-adec-15d2cf3a2509 admin admin] PATH_INFO: `/v3/projects/0d0c7c62b51b4d88b7eabe361a82e4d2/users/660f29b1c52b49ada0af8fc5f940c2ae/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:44.285298 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8382fa3-6c27-478c-adec-15d2cf3a2509 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d0c7c62b51b4d88b7eabe361a82e4d2, user_id=660f29b1c52b49ada0af8fc5f940c2ae, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:44.290976 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8382fa3-6c27-478c-adec-15d2cf3a2509 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:44.332108 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1197/2401] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 01:03:44 2022] PUT /identity/v3/projects/0d0c7c62b51b4d88b7eabe361a82e4d2/users/660f29b1c52b49ada0af8fc5f940c2ae/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:03:44.333187 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75570cac-0eaf-43af-8a8f-e23278009e52 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:44.333461 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75570cac-0eaf-43af-8a8f-e23278009e52 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:44.333735 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75570cac-0eaf-43af-8a8f-e23278009e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:44.385362 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-75570cac-0eaf-43af-8a8f-e23278009e52 None None] MFA Rules not processed for user `660f29b1c52b49ada0af8fc5f940c2ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:03:44.388502 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-75570cac-0eaf-43af-8a8f-e23278009e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:44.504706 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1205/2402] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:03:44 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:03:44.513309 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8382fa3-6c27-478c-adec-15d2cf3a2509 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:44.515877 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-f8382fa3-6c27-478c-adec-15d2cf3a2509 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:44.605110 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8382fa3-6c27-478c-adec-15d2cf3a2509 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:44.610462 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1b60f3-e960-4d85-b592-ebe0f29e3f44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:44.611451 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b60f3-e960-4d85-b592-ebe0f29e3f44 service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:44.612020 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b60f3-e960-4d85-b592-ebe0f29e3f44 service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:44.612502 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b60f3-e960-4d85-b592-ebe0f29e3f44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:44.621119 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:03:44.629110 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1b60f3-e960-4d85-b592-ebe0f29e3f44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:44.632697 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1b60f3-e960-4d85-b592-ebe0f29e3f44 service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:44.645470 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1198/2403] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:03:44 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:03:49.738285 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75570cac-0eaf-43af-8a8f-e23278009e52 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:49.740023 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-75570cac-0eaf-43af-8a8f-e23278009e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:49.906468 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75570cac-0eaf-43af-8a8f-e23278009e52 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:49.920911 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e6136-3bc5-4d30-bfcb-bcdaa4a140f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:49.922043 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e6136-3bc5-4d30-bfcb-bcdaa4a140f9 service nova] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:49.922490 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e6136-3bc5-4d30-bfcb-bcdaa4a140f9 service nova] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:49.922910 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63e6136-3bc5-4d30-bfcb-bcdaa4a140f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:49.928567 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-d63e6136-3bc5-4d30-bfcb-bcdaa4a140f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:49.952694 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63e6136-3bc5-4d30-bfcb-bcdaa4a140f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:49.954627 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63e6136-3bc5-4d30-bfcb-bcdaa4a140f9 service nova] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:49.979033 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1206/2404] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:03:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:03:52.337033 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1b60f3-e960-4d85-b592-ebe0f29e3f44 service neutron] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:52.340582 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-3e1b60f3-e960-4d85-b592-ebe0f29e3f44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:52.373491 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1b60f3-e960-4d85-b592-ebe0f29e3f44 service neutron] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:52.384607 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274f3c0e-5c69-4f86-a003-a200bce2c4a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:52.385650 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f3c0e-5c69-4f86-a003-a200bce2c4a2 service nova] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:52.386135 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f3c0e-5c69-4f86-a003-a200bce2c4a2 service nova] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:52.386641 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f3c0e-5c69-4f86-a003-a200bce2c4a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:52.393136 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-274f3c0e-5c69-4f86-a003-a200bce2c4a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:52.421246 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274f3c0e-5c69-4f86-a003-a200bce2c4a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:52.423117 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274f3c0e-5c69-4f86-a003-a200bce2c4a2 service nova] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:52.463809 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1199/2405] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:03:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:03:59.775902 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e6136-3bc5-4d30-bfcb-bcdaa4a140f9 service nova] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:03:59.789589 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63e6136-3bc5-4d30-bfcb-bcdaa4a140f9 service nova] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:03:59.796667 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2353b031-427b-49df-b51e-d6927ca15817 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:03:59.797982 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353b031-427b-49df-b51e-d6927ca15817 service nova] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:03:59.798533 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353b031-427b-49df-b51e-d6927ca15817 service nova] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:03:59.799143 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353b031-427b-49df-b51e-d6927ca15817 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:03:59.801259 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-2353b031-427b-49df-b51e-d6927ca15817 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:03:59.820120 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2353b031-427b-49df-b51e-d6927ca15817 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:03:59.822071 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2353b031-427b-49df-b51e-d6927ca15817 service nova] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:03:59.843709 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1207/2406] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:03:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:04:02.437419 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=9 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:04:09.836172 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=80,keystone:INSERT=3 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:04:10.515399 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274f3c0e-5c69-4f86-a003-a200bce2c4a2 service nova] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:04:10.693029 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274f3c0e-5c69-4f86-a003-a200bce2c4a2 service nova] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:04:10.702954 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8c629-577d-48d9-a540-c49b9fdb900e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:04:10.703803 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8c629-577d-48d9-a540-c49b9fdb900e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:10.704145 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8c629-577d-48d9-a540-c49b9fdb900e admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:10.704473 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8c629-577d-48d9-a540-c49b9fdb900e admin admin] PATH_INFO: `/v3/users/660f29b1c52b49ada0af8fc5f940c2ae` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:10.705895 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd8c629-577d-48d9-a540-c49b9fdb900e admin admin] RBAC: Authorizing `identity:delete_user(user_id=660f29b1c52b49ada0af8fc5f940c2ae)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:04:10.708125 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd8c629-577d-48d9-a540-c49b9fdb900e admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:04:10.769257 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-4cd8c629-577d-48d9-a540-c49b9fdb900e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '660f29b1c52b49ada0af8fc5f940c2ae'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:04:10.783629 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-4cd8c629-577d-48d9-a540-c49b9fdb900e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '660f29b1c52b49ada0af8fc5f940c2ae'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:04:10.813974 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-4cd8c629-577d-48d9-a540-c49b9fdb900e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '660f29b1c52b49ada0af8fc5f940c2ae'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:04:10.815282 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-4cd8c629-577d-48d9-a540-c49b9fdb900e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '660f29b1c52b49ada0af8fc5f940c2ae'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:04:10.816225 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-4cd8c629-577d-48d9-a540-c49b9fdb900e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '660f29b1c52b49ada0af8fc5f940c2ae'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:04:10.844926 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1200/2407] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 01:04:10 2022] DELETE /identity/v3/users/660f29b1c52b49ada0af8fc5f940c2ae => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:04:10.845506 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417b9cd-dcba-4fad-bb91-c779e05d4ae8 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:10.846617 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417b9cd-dcba-4fad-bb91-c779e05d4ae8 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:10.847049 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417b9cd-dcba-4fad-bb91-c779e05d4ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:10.892511 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-5417b9cd-dcba-4fad-bb91-c779e05d4ae8 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:04:10.893745 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-5417b9cd-dcba-4fad-bb91-c779e05d4ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:10.973881 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1208/2408] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:04:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:04:10.995944 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8c629-577d-48d9-a540-c49b9fdb900e admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:04:10.997421 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-4cd8c629-577d-48d9-a540-c49b9fdb900e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:11.096245 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8c629-577d-48d9-a540-c49b9fdb900e admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:04:11.104198 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae836ad7-da91-4f3b-8c93-b0eb3453c15a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:04:11.116383 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae836ad7-da91-4f3b-8c93-b0eb3453c15a service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:11.116931 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae836ad7-da91-4f3b-8c93-b0eb3453c15a service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:11.117983 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae836ad7-da91-4f3b-8c93-b0eb3453c15a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:11.137242 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae836ad7-da91-4f3b-8c93-b0eb3453c15a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:04:11.139728 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae836ad7-da91-4f3b-8c93-b0eb3453c15a service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:04:11.155847 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1201/2409] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:04:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:04:11.360928 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5417b9cd-dcba-4fad-bb91-c779e05d4ae8 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:04:11.362412 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-5417b9cd-dcba-4fad-bb91-c779e05d4ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:11.377563 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5417b9cd-dcba-4fad-bb91-c779e05d4ae8 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:04:11.385486 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb948f34-ee29-4480-a142-2c222db47866 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:04:11.386988 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb948f34-ee29-4480-a142-2c222db47866 service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:11.387723 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb948f34-ee29-4480-a142-2c222db47866 service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:11.388218 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb948f34-ee29-4480-a142-2c222db47866 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:11.391859 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-eb948f34-ee29-4480-a142-2c222db47866 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:11.503577 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb948f34-ee29-4480-a142-2c222db47866 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:04:11.505306 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb948f34-ee29-4480-a142-2c222db47866 service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:04:11.551042 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1209/2410] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:04:11 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:04:12.003321 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae836ad7-da91-4f3b-8c93-b0eb3453c15a service neutron] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:04:12.006016 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-ae836ad7-da91-4f3b-8c93-b0eb3453c15a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:12.022928 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae836ad7-da91-4f3b-8c93-b0eb3453c15a service neutron] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:04:12.056544 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a574b87b-c49a-4206-b02a-a8fa3c586646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:04:12.057205 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574b87b-c49a-4206-b02a-a8fa3c586646 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:12.057489 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574b87b-c49a-4206-b02a-a8fa3c586646 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:12.057761 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574b87b-c49a-4206-b02a-a8fa3c586646 admin admin] PATH_INFO: `/v3/projects/0d0c7c62b51b4d88b7eabe361a82e4d2` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:12.066256 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a574b87b-c49a-4206-b02a-a8fa3c586646 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d0c7c62b51b4d88b7eabe361a82e4d2)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:04:12.068848 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a574b87b-c49a-4206-b02a-a8fa3c586646 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:04:12.092533 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:04:12.134893 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-a574b87b-c49a-4206-b02a-a8fa3c586646 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d0c7c62b51b4d88b7eabe361a82e4d2', 'request_id': 'req-a574b87b-c49a-4206-b02a-a8fa3c586646'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:04:12.144502 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-a574b87b-c49a-4206-b02a-a8fa3c586646 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d0c7c62b51b4d88b7eabe361a82e4d2', 'request_id': 'req-a574b87b-c49a-4206-b02a-a8fa3c586646'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:04:12.156710 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-a574b87b-c49a-4206-b02a-a8fa3c586646 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d0c7c62b51b4d88b7eabe361a82e4d2', 'request_id': 'req-a574b87b-c49a-4206-b02a-a8fa3c586646'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:04:12.178810 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-a574b87b-c49a-4206-b02a-a8fa3c586646 admin admin] The token cache is being invalidate because project 0d0c7c62b51b4d88b7eabe361a82e4d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81808) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:04:12.179434 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-a574b87b-c49a-4206-b02a-a8fa3c586646 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:04:12.181399 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-a574b87b-c49a-4206-b02a-a8fa3c586646 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:04:12.195906 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1202/2411] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 01:04:12 2022] DELETE /identity/v3/projects/0d0c7c62b51b4d88b7eabe361a82e4d2 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:04:21.527077 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=57 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:04:21.821640 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb948f34-ee29-4480-a142-2c222db47866 service neutron] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:04:21.825076 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-eb948f34-ee29-4480-a142-2c222db47866 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:21.843900 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb948f34-ee29-4480-a142-2c222db47866 service neutron] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:04:21.965165 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8efced-e932-4527-9e3f-a8ac89c3eeb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:04:21.965858 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8efced-e932-4527-9e3f-a8ac89c3eeb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:21.966273 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8efced-e932-4527-9e3f-a8ac89c3eeb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:21.966618 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8efced-e932-4527-9e3f-a8ac89c3eeb3 admin admin] PATH_INFO: `/v3/users/37479b87fd534345b891edd7c358e64a` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:21.968074 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8efced-e932-4527-9e3f-a8ac89c3eeb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37479b87fd534345b891edd7c358e64a)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:04:21.970966 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8efced-e932-4527-9e3f-a8ac89c3eeb3 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:04:22.077831 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-8f8efced-e932-4527-9e3f-a8ac89c3eeb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37479b87fd534345b891edd7c358e64a'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:04:22.095199 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-8f8efced-e932-4527-9e3f-a8ac89c3eeb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37479b87fd534345b891edd7c358e64a'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:04:22.106990 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-8f8efced-e932-4527-9e3f-a8ac89c3eeb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37479b87fd534345b891edd7c358e64a'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:04:22.108175 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-8f8efced-e932-4527-9e3f-a8ac89c3eeb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37479b87fd534345b891edd7c358e64a'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:04:22.109356 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-8f8efced-e932-4527-9e3f-a8ac89c3eeb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37479b87fd534345b891edd7c358e64a'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:04:22.134026 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1210/2412] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 01:04:21 2022] DELETE /identity/v3/users/37479b87fd534345b891edd7c358e64a => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:04:22.135704 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea4eafb-ec93-4025-b14d-27cb004ced07 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:22.136179 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea4eafb-ec93-4025-b14d-27cb004ced07 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:22.136351 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea4eafb-ec93-4025-b14d-27cb004ced07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:22.162955 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-7ea4eafb-ec93-4025-b14d-27cb004ced07 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:04:22.164224 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-7ea4eafb-ec93-4025-b14d-27cb004ced07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:22.259720 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1203/2413] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:04:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:04:22.268253 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8efced-e932-4527-9e3f-a8ac89c3eeb3 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:04:22.270229 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-8f8efced-e932-4527-9e3f-a8ac89c3eeb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:22.358555 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8efced-e932-4527-9e3f-a8ac89c3eeb3 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:04:22.364882 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd22abc8-0f27-4699-ba1c-1136b33cd31a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:04:22.365938 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22abc8-0f27-4699-ba1c-1136b33cd31a service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:22.366436 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22abc8-0f27-4699-ba1c-1136b33cd31a service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:22.366892 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22abc8-0f27-4699-ba1c-1136b33cd31a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:22.380346 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd22abc8-0f27-4699-ba1c-1136b33cd31a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:04:22.382144 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd22abc8-0f27-4699-ba1c-1136b33cd31a service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:04:22.393999 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1211/2414] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:04:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:04:22.591627 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea4eafb-ec93-4025-b14d-27cb004ced07 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:04:22.593341 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-7ea4eafb-ec93-4025-b14d-27cb004ced07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:22.607268 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea4eafb-ec93-4025-b14d-27cb004ced07 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:04:22.611867 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdddd58-0fa1-42dc-ba2c-2bb047f29ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:04:22.612502 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdddd58-0fa1-42dc-ba2c-2bb047f29ffa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:22.612797 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdddd58-0fa1-42dc-ba2c-2bb047f29ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:22.613041 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdddd58-0fa1-42dc-ba2c-2bb047f29ffa admin admin] PATH_INFO: `/v3/projects/bda29dd33df447d3a9bdc53de16db54d` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:22.614555 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdddd58-0fa1-42dc-ba2c-2bb047f29ffa admin admin] RBAC: Authorizing `identity:delete_project(project_id=bda29dd33df447d3a9bdc53de16db54d)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:04:22.616504 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdddd58-0fa1-42dc-ba2c-2bb047f29ffa admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:04:22.671802 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-abdddd58-0fa1-42dc-ba2c-2bb047f29ffa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bda29dd33df447d3a9bdc53de16db54d', 'request_id': 'req-abdddd58-0fa1-42dc-ba2c-2bb047f29ffa'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:04:22.678311 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-abdddd58-0fa1-42dc-ba2c-2bb047f29ffa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bda29dd33df447d3a9bdc53de16db54d', 'request_id': 'req-abdddd58-0fa1-42dc-ba2c-2bb047f29ffa'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:04:22.689609 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-abdddd58-0fa1-42dc-ba2c-2bb047f29ffa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bda29dd33df447d3a9bdc53de16db54d', 'request_id': 'req-abdddd58-0fa1-42dc-ba2c-2bb047f29ffa'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:04:22.701919 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-abdddd58-0fa1-42dc-ba2c-2bb047f29ffa admin admin] The token cache is being invalidate because project bda29dd33df447d3a9bdc53de16db54d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81808) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:04:22.702299 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-abdddd58-0fa1-42dc-ba2c-2bb047f29ffa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:04:22.703176 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-abdddd58-0fa1-42dc-ba2c-2bb047f29ffa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:04:22.708308 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1204/2415] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 01:04:22 2022] DELETE /identity/v3/projects/bda29dd33df447d3a9bdc53de16db54d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:04:22.710058 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40194d-77e6-4da3-834a-31594236dcb5 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:22.710518 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40194d-77e6-4da3-834a-31594236dcb5 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:22.710614 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40194d-77e6-4da3-834a-31594236dcb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:22.764624 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-ec40194d-77e6-4da3-834a-31594236dcb5 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:04:22.766278 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-ec40194d-77e6-4da3-834a-31594236dcb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:22.792929 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:04:22.853770 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1212/2416] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:04:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:04:22.862792 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cdca67-16ef-4517-a056-f91d397451c5 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:22.863164 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cdca67-16ef-4517-a056-f91d397451c5 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:22.863499 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cdca67-16ef-4517-a056-f91d397451c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:22.889927 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-39cdca67-16ef-4517-a056-f91d397451c5 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:04:22.891940 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-39cdca67-16ef-4517-a056-f91d397451c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:22.906973 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1205/2417] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:04:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:04:22.908601 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec40194d-77e6-4da3-834a-31594236dcb5 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:04:22.919446 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec40194d-77e6-4da3-834a-31594236dcb5 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:04:22.924706 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620201eb-9da6-432c-a576-093a5f444152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:04:22.925550 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620201eb-9da6-432c-a576-093a5f444152 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:22.925921 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620201eb-9da6-432c-a576-093a5f444152 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:22.926302 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620201eb-9da6-432c-a576-093a5f444152 admin admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:22.927095 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620201eb-9da6-432c-a576-093a5f444152 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:04:22.927484 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620201eb-9da6-432c-a576-093a5f444152 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:04:22.929345 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620201eb-9da6-432c-a576-093a5f444152 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:04:22.945566 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1213/2418] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 01:04:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:04:22.951638 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cdca67-16ef-4517-a056-f91d397451c5 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:04:22.962080 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cdca67-16ef-4517-a056-f91d397451c5 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:04:22.966958 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb08eaa1-2273-4e41-8ad1-a6e0fd9435de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:04:22.967755 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb08eaa1-2273-4e41-8ad1-a6e0fd9435de admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:22.968047 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb08eaa1-2273-4e41-8ad1-a6e0fd9435de admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:22.968382 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb08eaa1-2273-4e41-8ad1-a6e0fd9435de admin admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:22.969195 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb08eaa1-2273-4e41-8ad1-a6e0fd9435de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:04:22.971208 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb08eaa1-2273-4e41-8ad1-a6e0fd9435de admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:04:23.001306 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:04:23.013364 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1206/2419] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 01:04:22 2022] POST /identity/v3/projects => generated 359 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:04:23.014359 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620201eb-9da6-432c-a576-093a5f444152 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:04:23.028955 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620201eb-9da6-432c-a576-093a5f444152 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:04:23.094593 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a2b98-77a6-43b5-9b2c-d565b22e6aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:04:23.095207 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a2b98-77a6-43b5-9b2c-d565b22e6aa4 admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:23.095485 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a2b98-77a6-43b5-9b2c-d565b22e6aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:23.095868 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a2b98-77a6-43b5-9b2c-d565b22e6aa4 admin admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:23.096641 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42a2b98-77a6-43b5-9b2c-d565b22e6aa4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:04:23.098564 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42a2b98-77a6-43b5-9b2c-d565b22e6aa4 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:04:23.126342 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1214/2420] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 01:04:23 2022] POST /identity/v3/users => generated 280 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:04:23.130393 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb08eaa1-2273-4e41-8ad1-a6e0fd9435de admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:04:23.143324 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb08eaa1-2273-4e41-8ad1-a6e0fd9435de admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:04:23.148841 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5571d020-b249-440e-aaf0-22fab859e48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:04:23.149495 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5571d020-b249-440e-aaf0-22fab859e48d admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:23.149780 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5571d020-b249-440e-aaf0-22fab859e48d admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:23.150048 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5571d020-b249-440e-aaf0-22fab859e48d admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:23.150762 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5571d020-b249-440e-aaf0-22fab859e48d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:04:23.152425 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5571d020-b249-440e-aaf0-22fab859e48d admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:04:23.163879 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1207/2421] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:04:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:04:23.167536 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a2b98-77a6-43b5-9b2c-d565b22e6aa4 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:04:23.178376 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a2b98-77a6-43b5-9b2c-d565b22e6aa4 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:04:23.183342 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f0e2f-ed89-46f3-a7ba-8d4736f3b864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:04:23.184011 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f0e2f-ed89-46f3-a7ba-8d4736f3b864 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:23.184519 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f0e2f-ed89-46f3-a7ba-8d4736f3b864 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:23.184863 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f0e2f-ed89-46f3-a7ba-8d4736f3b864 admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:23.185654 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9f0e2f-ed89-46f3-a7ba-8d4736f3b864 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:04:23.187361 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9f0e2f-ed89-46f3-a7ba-8d4736f3b864 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:04:23.204148 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1215/2422] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:04:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:04:23.208369 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5571d020-b249-440e-aaf0-22fab859e48d admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:04:23.218679 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5571d020-b249-440e-aaf0-22fab859e48d admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:04:23.244471 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a7c85-3272-4f89-8036-d224e513599a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:04:23.245348 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a7c85-3272-4f89-8036-d224e513599a admin admin] REQUEST_METHOD: `PUT` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:23.245771 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a7c85-3272-4f89-8036-d224e513599a admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:23.246334 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a7c85-3272-4f89-8036-d224e513599a admin admin] PATH_INFO: `/v3/projects/c4044331a15a4ecab644ac46e8c9d94e/users/b1d52d57be1d44e5b2bbf5af445e7db8/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:23.276356 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a7c85-3272-4f89-8036-d224e513599a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4044331a15a4ecab644ac46e8c9d94e, user_id=b1d52d57be1d44e5b2bbf5af445e7db8, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:04:23.279486 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a7c85-3272-4f89-8036-d224e513599a admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:04:23.297309 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1208/2423] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 01:04:23 2022] PUT /identity/v3/projects/c4044331a15a4ecab644ac46e8c9d94e/users/b1d52d57be1d44e5b2bbf5af445e7db8/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:04:23.310138 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3eacee-1919-42cf-944c-b6e5eda6a43a None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:23.310660 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3eacee-1919-42cf-944c-b6e5eda6a43a None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:23.311036 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3eacee-1919-42cf-944c-b6e5eda6a43a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:23.360048 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-3c3eacee-1919-42cf-944c-b6e5eda6a43a None None] MFA Rules not processed for user `b1d52d57be1d44e5b2bbf5af445e7db8`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:04:23.361451 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-3c3eacee-1919-42cf-944c-b6e5eda6a43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:23.504793 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1216/2424] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:04:23 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:04:23.574972 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a7c85-3272-4f89-8036-d224e513599a admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:04:23.577267 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-b10a7c85-3272-4f89-8036-d224e513599a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:23.670413 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a7c85-3272-4f89-8036-d224e513599a admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:04:23.677675 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9904671-991c-4364-9ebf-147a05dba451 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:04:23.679831 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9904671-991c-4364-9ebf-147a05dba451 service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:23.680121 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9904671-991c-4364-9ebf-147a05dba451 service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:23.680450 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9904671-991c-4364-9ebf-147a05dba451 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:23.693468 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9904671-991c-4364-9ebf-147a05dba451 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:04:23.697066 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9904671-991c-4364-9ebf-147a05dba451 service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:04:23.710944 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1209/2425] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:04:23 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:04:33.502925 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:04:33.706062 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=41,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:04:39.749553 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3eacee-1919-42cf-944c-b6e5eda6a43a None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:04:39.848591 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3eacee-1919-42cf-944c-b6e5eda6a43a None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:04:39.855535 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea500801-f803-4c33-961d-f0409caa5f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:04:39.857085 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea500801-f803-4c33-961d-f0409caa5f06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:39.857555 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea500801-f803-4c33-961d-f0409caa5f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:39.858127 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea500801-f803-4c33-961d-f0409caa5f06 admin admin] PATH_INFO: `/v3/users/b1d52d57be1d44e5b2bbf5af445e7db8` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:39.859506 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea500801-f803-4c33-961d-f0409caa5f06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1d52d57be1d44e5b2bbf5af445e7db8)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:04:39.862500 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea500801-f803-4c33-961d-f0409caa5f06 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:04:39.931124 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-ea500801-f803-4c33-961d-f0409caa5f06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1d52d57be1d44e5b2bbf5af445e7db8'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:04:39.952421 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-ea500801-f803-4c33-961d-f0409caa5f06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1d52d57be1d44e5b2bbf5af445e7db8'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:04:39.962220 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-ea500801-f803-4c33-961d-f0409caa5f06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1d52d57be1d44e5b2bbf5af445e7db8'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:04:39.962838 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-ea500801-f803-4c33-961d-f0409caa5f06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1d52d57be1d44e5b2bbf5af445e7db8'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:04:39.963791 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-ea500801-f803-4c33-961d-f0409caa5f06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1d52d57be1d44e5b2bbf5af445e7db8'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:04:39.986922 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1217/2426] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 01:04:39 2022] DELETE /identity/v3/users/b1d52d57be1d44e5b2bbf5af445e7db8 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:04:39.992465 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3bc555-c95b-48d8-9c7c-a119bacdc38e None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:39.992969 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3bc555-c95b-48d8-9c7c-a119bacdc38e None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:39.993870 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3bc555-c95b-48d8-9c7c-a119bacdc38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:40.015948 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-ee3bc555-c95b-48d8-9c7c-a119bacdc38e None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:04:40.017545 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-ee3bc555-c95b-48d8-9c7c-a119bacdc38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:40.110190 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1210/2427] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:04:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:04:40.122768 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea500801-f803-4c33-961d-f0409caa5f06 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:04:40.125309 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-ea500801-f803-4c33-961d-f0409caa5f06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:40.206338 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea500801-f803-4c33-961d-f0409caa5f06 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:04:40.212680 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fe26b5-bc0f-480c-ba53-9321039ceb61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:04:40.215136 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe26b5-bc0f-480c-ba53-9321039ceb61 service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:40.215420 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe26b5-bc0f-480c-ba53-9321039ceb61 service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:40.215746 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe26b5-bc0f-480c-ba53-9321039ceb61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:40.228132 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fe26b5-bc0f-480c-ba53-9321039ceb61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:04:40.229792 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fe26b5-bc0f-480c-ba53-9321039ceb61 service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:04:40.243278 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1218/2428] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:04:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:04:40.506881 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3bc555-c95b-48d8-9c7c-a119bacdc38e None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:04:40.509053 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-ee3bc555-c95b-48d8-9c7c-a119bacdc38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:40.537390 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3bc555-c95b-48d8-9c7c-a119bacdc38e None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:04:40.546958 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c56156-ee99-4fa6-8e5f-646b46bd085f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:04:40.548869 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c56156-ee99-4fa6-8e5f-646b46bd085f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:40.549153 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c56156-ee99-4fa6-8e5f-646b46bd085f admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:40.549423 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c56156-ee99-4fa6-8e5f-646b46bd085f admin admin] PATH_INFO: `/v3/projects/c4044331a15a4ecab644ac46e8c9d94e` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:40.550838 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c56156-ee99-4fa6-8e5f-646b46bd085f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4044331a15a4ecab644ac46e8c9d94e)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:04:40.554290 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c56156-ee99-4fa6-8e5f-646b46bd085f admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:04:40.631921 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-d3c56156-ee99-4fa6-8e5f-646b46bd085f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4044331a15a4ecab644ac46e8c9d94e', 'request_id': 'req-d3c56156-ee99-4fa6-8e5f-646b46bd085f'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:04:40.644577 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-d3c56156-ee99-4fa6-8e5f-646b46bd085f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4044331a15a4ecab644ac46e8c9d94e', 'request_id': 'req-d3c56156-ee99-4fa6-8e5f-646b46bd085f'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:04:40.656607 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-d3c56156-ee99-4fa6-8e5f-646b46bd085f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4044331a15a4ecab644ac46e8c9d94e', 'request_id': 'req-d3c56156-ee99-4fa6-8e5f-646b46bd085f'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:04:40.687894 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-d3c56156-ee99-4fa6-8e5f-646b46bd085f admin admin] The token cache is being invalidate because project c4044331a15a4ecab644ac46e8c9d94e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81808) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:04:40.688303 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-d3c56156-ee99-4fa6-8e5f-646b46bd085f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:04:40.689163 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-d3c56156-ee99-4fa6-8e5f-646b46bd085f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:04:40.694965 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1211/2429] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 01:04:40 2022] DELETE /identity/v3/projects/c4044331a15a4ecab644ac46e8c9d94e => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:04:40.696838 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0bc15-5d01-478d-beaf-cd3823ecf356 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:40.697202 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0bc15-5d01-478d-beaf-cd3823ecf356 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:40.697563 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0bc15-5d01-478d-beaf-cd3823ecf356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:40.761089 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-d1a0bc15-5d01-478d-beaf-cd3823ecf356 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:04:40.762768 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-d1a0bc15-5d01-478d-beaf-cd3823ecf356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:40.789285 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:04:40.880587 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1219/2430] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:04:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:04:40.888337 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2260ef-3582-4401-818c-31a13937bbf3 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:40.888845 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2260ef-3582-4401-818c-31a13937bbf3 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:40.889193 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2260ef-3582-4401-818c-31a13937bbf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:40.920740 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-3b2260ef-3582-4401-818c-31a13937bbf3 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:04:40.922007 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-3b2260ef-3582-4401-818c-31a13937bbf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:40.938602 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1212/2431] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:04:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:04:40.940700 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a0bc15-5d01-478d-beaf-cd3823ecf356 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:04:40.953744 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a0bc15-5d01-478d-beaf-cd3823ecf356 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:04:40.959934 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40178432-1ed1-4463-ad6f-06dbe6da9a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:04:40.960891 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40178432-1ed1-4463-ad6f-06dbe6da9a2f admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:40.961236 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40178432-1ed1-4463-ad6f-06dbe6da9a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:40.961516 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40178432-1ed1-4463-ad6f-06dbe6da9a2f admin admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:40.962354 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40178432-1ed1-4463-ad6f-06dbe6da9a2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:04:40.962733 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40178432-1ed1-4463-ad6f-06dbe6da9a2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:04:40.964520 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40178432-1ed1-4463-ad6f-06dbe6da9a2f admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:04:40.983151 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1220/2432] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 01:04:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:04:40.987433 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2260ef-3582-4401-818c-31a13937bbf3 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:04:40.997934 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2260ef-3582-4401-818c-31a13937bbf3 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:04:41.004575 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d1143-3211-4741-ba41-3abc81445f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:04:41.005679 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d1143-3211-4741-ba41-3abc81445f47 admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:41.006032 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d1143-3211-4741-ba41-3abc81445f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:41.006572 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d1143-3211-4741-ba41-3abc81445f47 admin admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:41.007444 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873d1143-3211-4741-ba41-3abc81445f47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:04:41.009896 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873d1143-3211-4741-ba41-3abc81445f47 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:04:41.046160 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1213/2433] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 01:04:40 2022] POST /identity/v3/projects => generated 383 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:04:41.050947 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40178432-1ed1-4463-ad6f-06dbe6da9a2f admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:04:41.062122 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40178432-1ed1-4463-ad6f-06dbe6da9a2f admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:04:41.292615 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f63c51-701a-41d7-993a-589c11fe5d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:04:41.293733 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f63c51-701a-41d7-993a-589c11fe5d7c admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:41.294169 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f63c51-701a-41d7-993a-589c11fe5d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:41.294598 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f63c51-701a-41d7-993a-589c11fe5d7c admin admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:41.295414 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f63c51-701a-41d7-993a-589c11fe5d7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:04:41.297819 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f63c51-701a-41d7-993a-589c11fe5d7c admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:04:41.333170 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1221/2434] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 01:04:41 2022] POST /identity/v3/users => generated 292 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:04:41.337326 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d1143-3211-4741-ba41-3abc81445f47 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:04:41.357522 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d1143-3211-4741-ba41-3abc81445f47 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:04:41.366148 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ac76dc-ad91-42da-b5f5-b1822d9833cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:04:41.366997 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac76dc-ad91-42da-b5f5-b1822d9833cf admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:41.367452 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac76dc-ad91-42da-b5f5-b1822d9833cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:41.367704 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac76dc-ad91-42da-b5f5-b1822d9833cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:41.368419 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ac76dc-ad91-42da-b5f5-b1822d9833cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:04:41.384709 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ac76dc-ad91-42da-b5f5-b1822d9833cf admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:04:41.405646 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1214/2435] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:04:41.409760 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f63c51-701a-41d7-993a-589c11fe5d7c admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:04:41.436485 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f63c51-701a-41d7-993a-589c11fe5d7c admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:04:41.444136 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c993bb-40f7-45ea-be90-0ca8d82b02ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:04:41.444887 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c993bb-40f7-45ea-be90-0ca8d82b02ee admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:41.445380 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c993bb-40f7-45ea-be90-0ca8d82b02ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:41.445724 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c993bb-40f7-45ea-be90-0ca8d82b02ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:41.446462 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c993bb-40f7-45ea-be90-0ca8d82b02ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:04:41.448563 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c993bb-40f7-45ea-be90-0ca8d82b02ee admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:04:41.461293 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1222/2436] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:04:41.467103 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ac76dc-ad91-42da-b5f5-b1822d9833cf admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:04:41.490462 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ac76dc-ad91-42da-b5f5-b1822d9833cf admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:04:41.502539 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f7d02-4c65-4dc9-8ec5-3d80b0e505a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:04:41.503744 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f7d02-4c65-4dc9-8ec5-3d80b0e505a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:41.504434 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f7d02-4c65-4dc9-8ec5-3d80b0e505a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:41.504876 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f7d02-4c65-4dc9-8ec5-3d80b0e505a2 admin admin] PATH_INFO: `/v3/projects/35b42d480c764b8aa9bcac1fdca90bad/users/28e344e6d9144d9aa47a41109a68eb77/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:41.529883 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1f7d02-4c65-4dc9-8ec5-3d80b0e505a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35b42d480c764b8aa9bcac1fdca90bad, user_id=28e344e6d9144d9aa47a41109a68eb77, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:04:41.538635 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1f7d02-4c65-4dc9-8ec5-3d80b0e505a2 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:04:41.561860 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1215/2437] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 01:04:41 2022] PUT /identity/v3/projects/35b42d480c764b8aa9bcac1fdca90bad/users/28e344e6d9144d9aa47a41109a68eb77/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:04:41.575016 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d246cd-944b-489f-a91d-8ef61040f629 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:41.575294 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d246cd-944b-489f-a91d-8ef61040f629 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:41.575568 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d246cd-944b-489f-a91d-8ef61040f629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:41.608513 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-d2d246cd-944b-489f-a91d-8ef61040f629 None None] MFA Rules not processed for user `28e344e6d9144d9aa47a41109a68eb77`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:04:41.609757 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-d2d246cd-944b-489f-a91d-8ef61040f629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:41.733937 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1223/2438] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:04:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:04:41.752488 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f7d02-4c65-4dc9-8ec5-3d80b0e505a2 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:04:41.756478 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-8b1f7d02-4c65-4dc9-8ec5-3d80b0e505a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:41.826052 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:04:41.923941 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f7d02-4c65-4dc9-8ec5-3d80b0e505a2 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:04:41.942982 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0727c-e179-4228-bf00-61cb23c7989f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:04:41.946678 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0727c-e179-4228-bf00-61cb23c7989f service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:41.947070 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0727c-e179-4228-bf00-61cb23c7989f service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:41.948120 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0727c-e179-4228-bf00-61cb23c7989f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:41.967507 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba0727c-e179-4228-bf00-61cb23c7989f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:04:41.969497 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba0727c-e179-4228-bf00-61cb23c7989f service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:04:41.984657 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1216/2439] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:04:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:04:51.734568 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:04:51.978168 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=17 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:04:55.844884 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d246cd-944b-489f-a91d-8ef61040f629 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:04:55.985171 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d246cd-944b-489f-a91d-8ef61040f629 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:04:55.991273 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fcb17b-2418-4c94-b4b8-7b528992cc59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:04:55.992945 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fcb17b-2418-4c94-b4b8-7b528992cc59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:55.993335 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fcb17b-2418-4c94-b4b8-7b528992cc59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:55.993839 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fcb17b-2418-4c94-b4b8-7b528992cc59 admin admin] PATH_INFO: `/v3/users/28e344e6d9144d9aa47a41109a68eb77` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:55.995182 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fcb17b-2418-4c94-b4b8-7b528992cc59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28e344e6d9144d9aa47a41109a68eb77)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:04:55.997794 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fcb17b-2418-4c94-b4b8-7b528992cc59 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:04:56.101665 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-d7fcb17b-2418-4c94-b4b8-7b528992cc59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28e344e6d9144d9aa47a41109a68eb77'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:04:56.130793 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-d7fcb17b-2418-4c94-b4b8-7b528992cc59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28e344e6d9144d9aa47a41109a68eb77'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:04:56.149904 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-d7fcb17b-2418-4c94-b4b8-7b528992cc59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28e344e6d9144d9aa47a41109a68eb77'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:04:56.151245 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-d7fcb17b-2418-4c94-b4b8-7b528992cc59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28e344e6d9144d9aa47a41109a68eb77'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:04:56.151909 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-d7fcb17b-2418-4c94-b4b8-7b528992cc59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28e344e6d9144d9aa47a41109a68eb77'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:04:56.184420 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb1c1c-5481-4dc3-aeef-cd94c4cd0870 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:56.185027 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1224/2440] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 01:04:55 2022] DELETE /identity/v3/users/28e344e6d9144d9aa47a41109a68eb77 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:04:56.185800 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb1c1c-5481-4dc3-aeef-cd94c4cd0870 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:56.186293 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb1c1c-5481-4dc3-aeef-cd94c4cd0870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:56.216009 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-a5cb1c1c-5481-4dc3-aeef-cd94c4cd0870 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:04:56.217831 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-a5cb1c1c-5481-4dc3-aeef-cd94c4cd0870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:56.343679 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1217/2441] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:04:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:04:56.361703 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fcb17b-2418-4c94-b4b8-7b528992cc59 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:04:56.363265 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-d7fcb17b-2418-4c94-b4b8-7b528992cc59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:56.518549 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fcb17b-2418-4c94-b4b8-7b528992cc59 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:04:56.524641 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1880b497-cf1c-42ec-b38d-60989ee484e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:04:56.525463 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880b497-cf1c-42ec-b38d-60989ee484e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:56.525851 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880b497-cf1c-42ec-b38d-60989ee484e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:56.526718 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880b497-cf1c-42ec-b38d-60989ee484e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:56.537976 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1880b497-cf1c-42ec-b38d-60989ee484e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:04:56.539876 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1880b497-cf1c-42ec-b38d-60989ee484e1 service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:04:56.553196 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1225/2442] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:04:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:04:57.091371 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb1c1c-5481-4dc3-aeef-cd94c4cd0870 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:04:57.092807 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-a5cb1c1c-5481-4dc3-aeef-cd94c4cd0870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:57.110109 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb1c1c-5481-4dc3-aeef-cd94c4cd0870 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:04:57.122099 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facea828-f5f2-4606-a607-e943ec1d1ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:04:57.122812 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facea828-f5f2-4606-a607-e943ec1d1ee5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:57.123249 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facea828-f5f2-4606-a607-e943ec1d1ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:57.123528 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facea828-f5f2-4606-a607-e943ec1d1ee5 admin admin] PATH_INFO: `/v3/projects/35b42d480c764b8aa9bcac1fdca90bad` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:57.127163 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facea828-f5f2-4606-a607-e943ec1d1ee5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35b42d480c764b8aa9bcac1fdca90bad)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:04:57.132110 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facea828-f5f2-4606-a607-e943ec1d1ee5 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:04:57.220146 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-facea828-f5f2-4606-a607-e943ec1d1ee5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35b42d480c764b8aa9bcac1fdca90bad', 'request_id': 'req-facea828-f5f2-4606-a607-e943ec1d1ee5'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:04:57.227091 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-facea828-f5f2-4606-a607-e943ec1d1ee5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35b42d480c764b8aa9bcac1fdca90bad', 'request_id': 'req-facea828-f5f2-4606-a607-e943ec1d1ee5'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:04:57.239239 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-facea828-f5f2-4606-a607-e943ec1d1ee5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35b42d480c764b8aa9bcac1fdca90bad', 'request_id': 'req-facea828-f5f2-4606-a607-e943ec1d1ee5'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:04:57.255598 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-facea828-f5f2-4606-a607-e943ec1d1ee5 admin admin] The token cache is being invalidate because project 35b42d480c764b8aa9bcac1fdca90bad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81808) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:04:57.256414 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-facea828-f5f2-4606-a607-e943ec1d1ee5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:04:57.257628 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-facea828-f5f2-4606-a607-e943ec1d1ee5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:04:57.265296 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1218/2443] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 01:04:57 2022] DELETE /identity/v3/projects/35b42d480c764b8aa9bcac1fdca90bad => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:04:57.266594 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83283e9-e2e1-460e-a955-2c02c949f038 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:57.267247 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83283e9-e2e1-460e-a955-2c02c949f038 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:57.267247 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83283e9-e2e1-460e-a955-2c02c949f038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:57.309081 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-c83283e9-e2e1-460e-a955-2c02c949f038 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:04:57.310511 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-c83283e9-e2e1-460e-a955-2c02c949f038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:57.335074 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:04:57.415961 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1226/2444] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:04:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:04:57.425067 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ece2f-161d-43ef-a56c-0c62ccd756bc None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:57.425672 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ece2f-161d-43ef-a56c-0c62ccd756bc None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:57.426113 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ece2f-161d-43ef-a56c-0c62ccd756bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:57.453384 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-446ece2f-161d-43ef-a56c-0c62ccd756bc None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:04:57.454877 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-446ece2f-161d-43ef-a56c-0c62ccd756bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:57.468436 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1219/2445] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:04:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:04:57.468827 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83283e9-e2e1-460e-a955-2c02c949f038 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:04:57.484114 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83283e9-e2e1-460e-a955-2c02c949f038 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:04:57.492810 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411bbac2-7fe7-490d-872b-661233cb4517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:04:57.494064 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411bbac2-7fe7-490d-872b-661233cb4517 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:57.494584 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411bbac2-7fe7-490d-872b-661233cb4517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:57.494783 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411bbac2-7fe7-490d-872b-661233cb4517 admin admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:57.495722 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411bbac2-7fe7-490d-872b-661233cb4517 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:04:57.496473 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411bbac2-7fe7-490d-872b-661233cb4517 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:04:57.498798 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411bbac2-7fe7-490d-872b-661233cb4517 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:04:57.517516 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1227/2446] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 01:04:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:04:57.521952 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446ece2f-161d-43ef-a56c-0c62ccd756bc None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:04:57.535116 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446ece2f-161d-43ef-a56c-0c62ccd756bc None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:04:57.546864 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af96cb-d87b-4310-bef8-fba263a483af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:04:57.548084 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af96cb-d87b-4310-bef8-fba263a483af admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:57.548565 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af96cb-d87b-4310-bef8-fba263a483af admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:57.549541 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af96cb-d87b-4310-bef8-fba263a483af admin admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:57.550831 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8af96cb-d87b-4310-bef8-fba263a483af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:04:57.553553 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8af96cb-d87b-4310-bef8-fba263a483af admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:04:57.611905 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1220/2447] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 01:04:57 2022] POST /identity/v3/projects => generated 351 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:04:57.615804 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411bbac2-7fe7-490d-872b-661233cb4517 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:04:57.629715 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411bbac2-7fe7-490d-872b-661233cb4517 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:04:57.773758 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c638a67f-fd96-4296-bbd5-03155f0cd3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:04:57.779906 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c638a67f-fd96-4296-bbd5-03155f0cd3bf admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:57.780419 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c638a67f-fd96-4296-bbd5-03155f0cd3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:57.780637 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c638a67f-fd96-4296-bbd5-03155f0cd3bf admin admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:57.781363 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c638a67f-fd96-4296-bbd5-03155f0cd3bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:04:57.788204 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c638a67f-fd96-4296-bbd5-03155f0cd3bf admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:04:57.856144 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1228/2448] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 01:04:57 2022] POST /identity/v3/users => generated 276 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:04:57.860377 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af96cb-d87b-4310-bef8-fba263a483af admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:04:57.881298 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af96cb-d87b-4310-bef8-fba263a483af admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:04:57.888399 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9377e3-9e64-4908-9ce7-8555f592375f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:04:57.893081 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9377e3-9e64-4908-9ce7-8555f592375f admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:57.893381 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9377e3-9e64-4908-9ce7-8555f592375f admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:57.893667 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9377e3-9e64-4908-9ce7-8555f592375f admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:57.894724 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9377e3-9e64-4908-9ce7-8555f592375f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:04:57.899138 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9377e3-9e64-4908-9ce7-8555f592375f admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:04:57.921209 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1221/2449] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:04:57 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:04:57.925751 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c638a67f-fd96-4296-bbd5-03155f0cd3bf admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:04:57.945985 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c638a67f-fd96-4296-bbd5-03155f0cd3bf admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:04:57.961289 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9e6a8d-5404-4811-b7a6-7dfa1d3c0e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:04:57.962577 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e6a8d-5404-4811-b7a6-7dfa1d3c0e3a admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:57.963052 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e6a8d-5404-4811-b7a6-7dfa1d3c0e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:57.963546 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e6a8d-5404-4811-b7a6-7dfa1d3c0e3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:57.965227 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9e6a8d-5404-4811-b7a6-7dfa1d3c0e3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:04:57.969266 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9e6a8d-5404-4811-b7a6-7dfa1d3c0e3a admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:04:57.990545 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1229/2450] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:04:57 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:04:57.998087 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9377e3-9e64-4908-9ce7-8555f592375f admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:04:58.034529 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9377e3-9e64-4908-9ce7-8555f592375f admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:04:58.051999 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1041790c-d61a-4b82-9ae8-8bdf43f8d5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:04:58.053136 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1041790c-d61a-4b82-9ae8-8bdf43f8d5c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:58.053435 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1041790c-d61a-4b82-9ae8-8bdf43f8d5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:58.053714 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1041790c-d61a-4b82-9ae8-8bdf43f8d5c7 admin admin] PATH_INFO: `/v3/projects/d1cf525bf0024fde9b0cb9e37d3336fc/users/306917b3bc7d4c78aa5955cfb6ece5fb/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:58.109082 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1041790c-d61a-4b82-9ae8-8bdf43f8d5c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1cf525bf0024fde9b0cb9e37d3336fc, user_id=306917b3bc7d4c78aa5955cfb6ece5fb, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:04:58.113405 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1041790c-d61a-4b82-9ae8-8bdf43f8d5c7 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:04:58.168113 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1222/2451] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 01:04:57 2022] PUT /identity/v3/projects/d1cf525bf0024fde9b0cb9e37d3336fc/users/306917b3bc7d4c78aa5955cfb6ece5fb/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:04:58.170569 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c8d45a-c448-4617-9819-3ae0497c8894 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:58.170857 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c8d45a-c448-4617-9819-3ae0497c8894 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:58.171123 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c8d45a-c448-4617-9819-3ae0497c8894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:58.220508 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-38c8d45a-c448-4617-9819-3ae0497c8894 None None] MFA Rules not processed for user `306917b3bc7d4c78aa5955cfb6ece5fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:04:58.226081 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-38c8d45a-c448-4617-9819-3ae0497c8894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:58.388221 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1230/2452] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:04:58 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:04:58.473298 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1041790c-d61a-4b82-9ae8-8bdf43f8d5c7 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:04:58.476113 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-1041790c-d61a-4b82-9ae8-8bdf43f8d5c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:04:58.527930 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:04:58.609944 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1041790c-d61a-4b82-9ae8-8bdf43f8d5c7 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:04:58.618047 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ec7a31-e0c1-45be-8eca-5dd72ff718ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:04:58.619009 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec7a31-e0c1-45be-8eca-5dd72ff718ee service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:04:58.619495 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec7a31-e0c1-45be-8eca-5dd72ff718ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:04:58.619970 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec7a31-e0c1-45be-8eca-5dd72ff718ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:04:58.647696 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ec7a31-e0c1-45be-8eca-5dd72ff718ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:04:58.650632 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ec7a31-e0c1-45be-8eca-5dd72ff718ee service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:04:58.666387 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1223/2453] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:04:58 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:05:03.504217 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c8d45a-c448-4617-9819-3ae0497c8894 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:03.549271 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:05:03.685962 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c8d45a-c448-4617-9819-3ae0497c8894 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:03.697408 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca2507-1628-4fcc-ae02-b75ee502b8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:03.700765 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca2507-1628-4fcc-ae02-b75ee502b8b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:03.701144 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca2507-1628-4fcc-ae02-b75ee502b8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:03.701646 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca2507-1628-4fcc-ae02-b75ee502b8b0 admin admin] PATH_INFO: `/v3/users/306917b3bc7d4c78aa5955cfb6ece5fb` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:03.702967 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cca2507-1628-4fcc-ae02-b75ee502b8b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=306917b3bc7d4c78aa5955cfb6ece5fb)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:03.706099 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cca2507-1628-4fcc-ae02-b75ee502b8b0 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:03.804658 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-8cca2507-1628-4fcc-ae02-b75ee502b8b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '306917b3bc7d4c78aa5955cfb6ece5fb'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:05:03.823041 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-8cca2507-1628-4fcc-ae02-b75ee502b8b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '306917b3bc7d4c78aa5955cfb6ece5fb'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:05:03.835205 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-8cca2507-1628-4fcc-ae02-b75ee502b8b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '306917b3bc7d4c78aa5955cfb6ece5fb'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:05:03.836604 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-8cca2507-1628-4fcc-ae02-b75ee502b8b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '306917b3bc7d4c78aa5955cfb6ece5fb'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:05:03.837238 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-8cca2507-1628-4fcc-ae02-b75ee502b8b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '306917b3bc7d4c78aa5955cfb6ece5fb'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:05:03.855748 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1231/2454] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 01:05:03 2022] DELETE /identity/v3/users/306917b3bc7d4c78aa5955cfb6ece5fb => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:05:03.859554 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22bcd82-cef6-45a1-b04e-91f1a9e1b482 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:03.860146 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22bcd82-cef6-45a1-b04e-91f1a9e1b482 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:03.860146 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22bcd82-cef6-45a1-b04e-91f1a9e1b482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:03.884703 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-d22bcd82-cef6-45a1-b04e-91f1a9e1b482 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:05:03.886185 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-d22bcd82-cef6-45a1-b04e-91f1a9e1b482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:04.046271 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1224/2455] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:05:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:05:04.096306 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca2507-1628-4fcc-ae02-b75ee502b8b0 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:04.097874 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-8cca2507-1628-4fcc-ae02-b75ee502b8b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:04.254868 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca2507-1628-4fcc-ae02-b75ee502b8b0 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:04.271499 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb1ce15-7102-4533-adec-ddda5f7a1646 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:04.272446 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb1ce15-7102-4533-adec-ddda5f7a1646 service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:04.272880 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb1ce15-7102-4533-adec-ddda5f7a1646 service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:04.273319 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb1ce15-7102-4533-adec-ddda5f7a1646 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:04.301592 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb1ce15-7102-4533-adec-ddda5f7a1646 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:04.303877 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb1ce15-7102-4533-adec-ddda5f7a1646 service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:04.339630 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1232/2456] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:05:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:05:04.964876 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22bcd82-cef6-45a1-b04e-91f1a9e1b482 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:04.967230 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-d22bcd82-cef6-45a1-b04e-91f1a9e1b482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:04.999426 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22bcd82-cef6-45a1-b04e-91f1a9e1b482 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:05.013024 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4834a9dc-016c-4cfb-845f-2c21fe3c7595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:05.014882 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4834a9dc-016c-4cfb-845f-2c21fe3c7595 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:05.016794 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4834a9dc-016c-4cfb-845f-2c21fe3c7595 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:05.017231 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4834a9dc-016c-4cfb-845f-2c21fe3c7595 admin admin] PATH_INFO: `/v3/projects/d1cf525bf0024fde9b0cb9e37d3336fc` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:05.021235 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4834a9dc-016c-4cfb-845f-2c21fe3c7595 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1cf525bf0024fde9b0cb9e37d3336fc)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:05.027361 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4834a9dc-016c-4cfb-845f-2c21fe3c7595 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:05.149832 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-4834a9dc-016c-4cfb-845f-2c21fe3c7595 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1cf525bf0024fde9b0cb9e37d3336fc', 'request_id': 'req-4834a9dc-016c-4cfb-845f-2c21fe3c7595'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:05:05.163470 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-4834a9dc-016c-4cfb-845f-2c21fe3c7595 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1cf525bf0024fde9b0cb9e37d3336fc', 'request_id': 'req-4834a9dc-016c-4cfb-845f-2c21fe3c7595'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:05:05.179313 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-4834a9dc-016c-4cfb-845f-2c21fe3c7595 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1cf525bf0024fde9b0cb9e37d3336fc', 'request_id': 'req-4834a9dc-016c-4cfb-845f-2c21fe3c7595'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:05:05.197233 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-4834a9dc-016c-4cfb-845f-2c21fe3c7595 admin admin] The token cache is being invalidate because project d1cf525bf0024fde9b0cb9e37d3336fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81808) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:05:05.198209 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-4834a9dc-016c-4cfb-845f-2c21fe3c7595 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:05:05.200429 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-4834a9dc-016c-4cfb-845f-2c21fe3c7595 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:05:05.203460 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1225/2457] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 01:05:04 2022] DELETE /identity/v3/projects/d1cf525bf0024fde9b0cb9e37d3336fc => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:05:14.328185 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:05:15.192383 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:05:16.026037 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df3da3-069e-4df3-b568-7c287ee57b02 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:16.027932 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df3da3-069e-4df3-b568-7c287ee57b02 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:16.028445 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df3da3-069e-4df3-b568-7c287ee57b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:16.063166 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-83df3da3-069e-4df3-b568-7c287ee57b02 None None] MFA Rules not processed for user `1f6108050e934edf922491f983d9c9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:05:16.065321 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-83df3da3-069e-4df3-b568-7c287ee57b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:16.192499 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1233/2458] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:05:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:05:16.758014 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4834a9dc-016c-4cfb-845f-2c21fe3c7595 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:16.760320 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-4834a9dc-016c-4cfb-845f-2c21fe3c7595 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:16.832979 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4834a9dc-016c-4cfb-845f-2c21fe3c7595 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:16.837712 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04610b70-7554-4e3a-ac4b-795cab1aca8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:16.838462 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04610b70-7554-4e3a-ac4b-795cab1aca8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:16.838815 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04610b70-7554-4e3a-ac4b-795cab1aca8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:16.839096 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04610b70-7554-4e3a-ac4b-795cab1aca8c admin admin] PATH_INFO: `/v3/users/d7b95b9d9a5a40ff884d2fd99c7a0593` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:16.840294 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04610b70-7554-4e3a-ac4b-795cab1aca8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7b95b9d9a5a40ff884d2fd99c7a0593)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:16.842235 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04610b70-7554-4e3a-ac4b-795cab1aca8c admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:16.899644 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-04610b70-7554-4e3a-ac4b-795cab1aca8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7b95b9d9a5a40ff884d2fd99c7a0593'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:05:16.910071 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-04610b70-7554-4e3a-ac4b-795cab1aca8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7b95b9d9a5a40ff884d2fd99c7a0593'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:05:16.923679 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-04610b70-7554-4e3a-ac4b-795cab1aca8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7b95b9d9a5a40ff884d2fd99c7a0593'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:05:16.924478 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-04610b70-7554-4e3a-ac4b-795cab1aca8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7b95b9d9a5a40ff884d2fd99c7a0593'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:05:16.925172 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-04610b70-7554-4e3a-ac4b-795cab1aca8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7b95b9d9a5a40ff884d2fd99c7a0593'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:05:16.940898 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1226/2459] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 01:05:16 2022] DELETE /identity/v3/users/d7b95b9d9a5a40ff884d2fd99c7a0593 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:05:16.945435 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f32482-5024-4984-9edf-11d10ac3e823 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:16.945712 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f32482-5024-4984-9edf-11d10ac3e823 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:16.946042 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f32482-5024-4984-9edf-11d10ac3e823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:16.967991 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-09f32482-5024-4984-9edf-11d10ac3e823 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:05:16.969559 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-09f32482-5024-4984-9edf-11d10ac3e823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:17.044263 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1234/2460] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:05:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:05:17.055318 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04610b70-7554-4e3a-ac4b-795cab1aca8c admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:17.057187 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-04610b70-7554-4e3a-ac4b-795cab1aca8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:17.141208 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04610b70-7554-4e3a-ac4b-795cab1aca8c admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:17.145202 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc43eb08-2837-4f56-9727-6ca6b6c23524 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:17.145949 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43eb08-2837-4f56-9727-6ca6b6c23524 service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:17.146319 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43eb08-2837-4f56-9727-6ca6b6c23524 service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:17.146689 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc43eb08-2837-4f56-9727-6ca6b6c23524 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:17.157107 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc43eb08-2837-4f56-9727-6ca6b6c23524 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:17.158615 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc43eb08-2837-4f56-9727-6ca6b6c23524 service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:17.169687 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1227/2461] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:05:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:05:17.180415 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f32482-5024-4984-9edf-11d10ac3e823 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:17.181856 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-09f32482-5024-4984-9edf-11d10ac3e823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:17.194138 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f32482-5024-4984-9edf-11d10ac3e823 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:17.198674 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d161deab-7c80-4d65-9930-832336462133 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:17.199331 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d161deab-7c80-4d65-9930-832336462133 service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:17.199645 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d161deab-7c80-4d65-9930-832336462133 service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:17.200148 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d161deab-7c80-4d65-9930-832336462133 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:17.202322 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-d161deab-7c80-4d65-9930-832336462133 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:17.213316 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d161deab-7c80-4d65-9930-832336462133 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:17.215051 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d161deab-7c80-4d65-9930-832336462133 service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:17.224880 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1235/2462] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:05:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:05:17.378566 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc43eb08-2837-4f56-9727-6ca6b6c23524 service neutron] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:17.382142 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-bc43eb08-2837-4f56-9727-6ca6b6c23524 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:17.402212 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc43eb08-2837-4f56-9727-6ca6b6c23524 service neutron] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:17.413267 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09cb21d-dbc1-4848-816a-755128abc5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:17.414053 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09cb21d-dbc1-4848-816a-755128abc5e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:17.414424 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09cb21d-dbc1-4848-816a-755128abc5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:17.414791 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09cb21d-dbc1-4848-816a-755128abc5e2 admin admin] PATH_INFO: `/v3/projects/029c6135ed6d4ad183d3a5eb25d0e96a` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:17.416039 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09cb21d-dbc1-4848-816a-755128abc5e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=029c6135ed6d4ad183d3a5eb25d0e96a)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:17.418031 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09cb21d-dbc1-4848-816a-755128abc5e2 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:17.438386 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:05:17.479319 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-a09cb21d-dbc1-4848-816a-755128abc5e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '029c6135ed6d4ad183d3a5eb25d0e96a', 'request_id': 'req-a09cb21d-dbc1-4848-816a-755128abc5e2'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:05:17.488000 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-a09cb21d-dbc1-4848-816a-755128abc5e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '029c6135ed6d4ad183d3a5eb25d0e96a', 'request_id': 'req-a09cb21d-dbc1-4848-816a-755128abc5e2'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:05:17.499326 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-a09cb21d-dbc1-4848-816a-755128abc5e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '029c6135ed6d4ad183d3a5eb25d0e96a', 'request_id': 'req-a09cb21d-dbc1-4848-816a-755128abc5e2'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:05:17.519232 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-a09cb21d-dbc1-4848-816a-755128abc5e2 admin admin] The token cache is being invalidate because project 029c6135ed6d4ad183d3a5eb25d0e96a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81808) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:05:17.519532 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-a09cb21d-dbc1-4848-816a-755128abc5e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:05:17.520307 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-a09cb21d-dbc1-4848-816a-755128abc5e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:05:17.525272 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1228/2463] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 01:05:17 2022] DELETE /identity/v3/projects/029c6135ed6d4ad183d3a5eb25d0e96a => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:05:17.528025 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5fd33-11d0-40d3-9812-4f43b60e60b1 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:17.528800 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5fd33-11d0-40d3-9812-4f43b60e60b1 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:17.529340 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5fd33-11d0-40d3-9812-4f43b60e60b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:17.551800 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-9cb5fd33-11d0-40d3-9812-4f43b60e60b1 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:05:17.553471 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-9cb5fd33-11d0-40d3-9812-4f43b60e60b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:17.637091 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1236/2464] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:05:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:05:17.645003 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27026fdc-0132-4f04-a858-3c25e6f17eb1 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:17.645286 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27026fdc-0132-4f04-a858-3c25e6f17eb1 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:17.645584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27026fdc-0132-4f04-a858-3c25e6f17eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:17.668816 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-27026fdc-0132-4f04-a858-3c25e6f17eb1 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:05:17.670052 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-27026fdc-0132-4f04-a858-3c25e6f17eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:17.678839 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1229/2465] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:05:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:05:17.682894 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb5fd33-11d0-40d3-9812-4f43b60e60b1 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:17.693112 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb5fd33-11d0-40d3-9812-4f43b60e60b1 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:17.699274 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31224a14-f961-43b5-9d47-ff9ea3e845b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:17.700435 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31224a14-f961-43b5-9d47-ff9ea3e845b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:17.700786 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31224a14-f961-43b5-9d47-ff9ea3e845b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:17.701127 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31224a14-f961-43b5-9d47-ff9ea3e845b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:17.701904 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31224a14-f961-43b5-9d47-ff9ea3e845b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:05:17.702475 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31224a14-f961-43b5-9d47-ff9ea3e845b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:17.704877 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31224a14-f961-43b5-9d47-ff9ea3e845b9 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:17.718452 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1237/2466] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 01:05:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:05:17.722671 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27026fdc-0132-4f04-a858-3c25e6f17eb1 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:17.735714 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27026fdc-0132-4f04-a858-3c25e6f17eb1 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:17.784251 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c3f88-45c5-4da3-b2c7-ce55bdabc821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:17.787474 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c3f88-45c5-4da3-b2c7-ce55bdabc821 admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:17.787942 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c3f88-45c5-4da3-b2c7-ce55bdabc821 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:17.789432 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c3f88-45c5-4da3-b2c7-ce55bdabc821 admin admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:17.790235 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c3f88-45c5-4da3-b2c7-ce55bdabc821 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:17.798617 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c3f88-45c5-4da3-b2c7-ce55bdabc821 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:17.839034 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1230/2467] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 01:05:17 2022] POST /identity/v3/projects => generated 375 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:05:17.849545 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31224a14-f961-43b5-9d47-ff9ea3e845b9 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:17.884499 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31224a14-f961-43b5-9d47-ff9ea3e845b9 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:17.926383 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=100 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:05:17.989195 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7fe262-f3f2-431a-b6cc-d7f1e4455911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:17.990595 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fe262-f3f2-431a-b6cc-d7f1e4455911 admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:17.990939 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fe262-f3f2-431a-b6cc-d7f1e4455911 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:17.991332 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7fe262-f3f2-431a-b6cc-d7f1e4455911 admin admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:17.992118 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7fe262-f3f2-431a-b6cc-d7f1e4455911 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:17.994112 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7fe262-f3f2-431a-b6cc-d7f1e4455911 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:18.024016 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1238/2468] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 01:05:17 2022] POST /identity/v3/users => generated 288 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:05:18.030431 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c3f88-45c5-4da3-b2c7-ce55bdabc821 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:18.041791 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c3f88-45c5-4da3-b2c7-ce55bdabc821 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:18.049053 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb480e4-17c7-4fea-93fd-b961aa2ae5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:18.050534 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb480e4-17c7-4fea-93fd-b961aa2ae5e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:18.050917 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb480e4-17c7-4fea-93fd-b961aa2ae5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:18.051286 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb480e4-17c7-4fea-93fd-b961aa2ae5e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:18.052355 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb480e4-17c7-4fea-93fd-b961aa2ae5e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:18.054697 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb480e4-17c7-4fea-93fd-b961aa2ae5e2 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:18.067883 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1231/2469] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:05:18.072038 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7fe262-f3f2-431a-b6cc-d7f1e4455911 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:18.083344 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7fe262-f3f2-431a-b6cc-d7f1e4455911 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:18.106102 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d40d793-122e-4d82-b824-d2a1f178ab16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:18.109284 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40d793-122e-4d82-b824-d2a1f178ab16 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:18.109481 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40d793-122e-4d82-b824-d2a1f178ab16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:18.110299 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d40d793-122e-4d82-b824-d2a1f178ab16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:18.111570 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d40d793-122e-4d82-b824-d2a1f178ab16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:18.113302 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d40d793-122e-4d82-b824-d2a1f178ab16 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:18.143229 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb480e4-17c7-4fea-93fd-b961aa2ae5e2 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:18.146082 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1239/2470] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:05:18.164239 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb480e4-17c7-4fea-93fd-b961aa2ae5e2 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:18.171909 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1358d89a-20c3-4b2a-9fb1-53843a83ddf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:18.172829 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358d89a-20c3-4b2a-9fb1-53843a83ddf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:18.173324 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358d89a-20c3-4b2a-9fb1-53843a83ddf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:18.173693 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358d89a-20c3-4b2a-9fb1-53843a83ddf2 admin admin] PATH_INFO: `/v3/projects/736e4d3faf764b61aaa7159a7a6eb072/users/28de5d35bccb42c7b0c72f00626c83be/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:18.204511 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1358d89a-20c3-4b2a-9fb1-53843a83ddf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=736e4d3faf764b61aaa7159a7a6eb072, user_id=28de5d35bccb42c7b0c72f00626c83be, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:18.210009 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1358d89a-20c3-4b2a-9fb1-53843a83ddf2 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:18.235795 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1232/2471] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 01:05:18 2022] PUT /identity/v3/projects/736e4d3faf764b61aaa7159a7a6eb072/users/28de5d35bccb42c7b0c72f00626c83be/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:05:18.303650 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc4ed79-cef3-465e-920a-8daecb65ef2e None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:18.304003 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc4ed79-cef3-465e-920a-8daecb65ef2e None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:18.304449 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc4ed79-cef3-465e-920a-8daecb65ef2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:18.365742 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-9dc4ed79-cef3-465e-920a-8daecb65ef2e None None] MFA Rules not processed for user `28de5d35bccb42c7b0c72f00626c83be`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:05:18.368506 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-9dc4ed79-cef3-465e-920a-8daecb65ef2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:18.469662 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1240/2472] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:05:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:05:18.475725 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1358d89a-20c3-4b2a-9fb1-53843a83ddf2 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:18.477595 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-1358d89a-20c3-4b2a-9fb1-53843a83ddf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:18.550212 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1358d89a-20c3-4b2a-9fb1-53843a83ddf2 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:18.554534 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec367ee-3d7a-4c02-9f99-eedb0ecfa3f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:18.555245 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec367ee-3d7a-4c02-9f99-eedb0ecfa3f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:18.555696 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec367ee-3d7a-4c02-9f99-eedb0ecfa3f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:18.556013 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec367ee-3d7a-4c02-9f99-eedb0ecfa3f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:18.566991 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec367ee-3d7a-4c02-9f99-eedb0ecfa3f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:18.568715 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec367ee-3d7a-4c02-9f99-eedb0ecfa3f9 service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:18.579993 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1233/2473] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:05:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:05:19.076350 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc4ed79-cef3-465e-920a-8daecb65ef2e None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:19.147880 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc4ed79-cef3-465e-920a-8daecb65ef2e None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:19.152880 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be80a153-e133-496d-ae54-a4cf77fac4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:19.153555 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80a153-e133-496d-ae54-a4cf77fac4bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:19.154018 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80a153-e133-496d-ae54-a4cf77fac4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:19.154488 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80a153-e133-496d-ae54-a4cf77fac4bc admin admin] PATH_INFO: `/v3/users/28de5d35bccb42c7b0c72f00626c83be` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:19.155626 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be80a153-e133-496d-ae54-a4cf77fac4bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=28de5d35bccb42c7b0c72f00626c83be)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:19.157728 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be80a153-e133-496d-ae54-a4cf77fac4bc admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:19.203760 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:05:19.230038 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-be80a153-e133-496d-ae54-a4cf77fac4bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28de5d35bccb42c7b0c72f00626c83be'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:05:19.249982 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-be80a153-e133-496d-ae54-a4cf77fac4bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28de5d35bccb42c7b0c72f00626c83be'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:05:19.261215 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-be80a153-e133-496d-ae54-a4cf77fac4bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28de5d35bccb42c7b0c72f00626c83be'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:05:19.262294 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-be80a153-e133-496d-ae54-a4cf77fac4bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28de5d35bccb42c7b0c72f00626c83be'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:05:19.263149 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-be80a153-e133-496d-ae54-a4cf77fac4bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28de5d35bccb42c7b0c72f00626c83be'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:05:19.279182 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1241/2474] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 01:05:19 2022] DELETE /identity/v3/users/28de5d35bccb42c7b0c72f00626c83be => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:05:19.283900 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc039abb-f0dd-4abf-92e6-b92c14eef78b None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:19.284796 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc039abb-f0dd-4abf-92e6-b92c14eef78b None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:19.286459 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc039abb-f0dd-4abf-92e6-b92c14eef78b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:19.317376 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-cc039abb-f0dd-4abf-92e6-b92c14eef78b None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:05:19.318958 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-cc039abb-f0dd-4abf-92e6-b92c14eef78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:19.375518 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:05:19.402851 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1234/2475] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:05:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:05:19.413789 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be80a153-e133-496d-ae54-a4cf77fac4bc admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:19.415380 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-be80a153-e133-496d-ae54-a4cf77fac4bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:19.475454 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be80a153-e133-496d-ae54-a4cf77fac4bc admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:19.481637 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf5364d-8a0e-43bb-84ac-aabcde77abd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:19.482276 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf5364d-8a0e-43bb-84ac-aabcde77abd7 service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:19.482917 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf5364d-8a0e-43bb-84ac-aabcde77abd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:19.482917 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf5364d-8a0e-43bb-84ac-aabcde77abd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:19.493101 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf5364d-8a0e-43bb-84ac-aabcde77abd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:19.494645 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf5364d-8a0e-43bb-84ac-aabcde77abd7 service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:19.505439 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1242/2476] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:05:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:05:20.144563 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc039abb-f0dd-4abf-92e6-b92c14eef78b None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:20.146090 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-cc039abb-f0dd-4abf-92e6-b92c14eef78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:20.162752 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc039abb-f0dd-4abf-92e6-b92c14eef78b None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:20.169890 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fae8a5-ebc9-469c-9668-56b12675ee62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:20.170755 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fae8a5-ebc9-469c-9668-56b12675ee62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:20.171097 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fae8a5-ebc9-469c-9668-56b12675ee62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:20.171538 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fae8a5-ebc9-469c-9668-56b12675ee62 admin admin] PATH_INFO: `/v3/projects/736e4d3faf764b61aaa7159a7a6eb072` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:20.174442 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fae8a5-ebc9-469c-9668-56b12675ee62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=736e4d3faf764b61aaa7159a7a6eb072)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:20.176631 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fae8a5-ebc9-469c-9668-56b12675ee62 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:20.273860 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-54fae8a5-ebc9-469c-9668-56b12675ee62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '736e4d3faf764b61aaa7159a7a6eb072', 'request_id': 'req-54fae8a5-ebc9-469c-9668-56b12675ee62'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:05:20.283610 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-54fae8a5-ebc9-469c-9668-56b12675ee62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '736e4d3faf764b61aaa7159a7a6eb072', 'request_id': 'req-54fae8a5-ebc9-469c-9668-56b12675ee62'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:05:20.305068 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-54fae8a5-ebc9-469c-9668-56b12675ee62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '736e4d3faf764b61aaa7159a7a6eb072', 'request_id': 'req-54fae8a5-ebc9-469c-9668-56b12675ee62'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:05:20.328527 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-54fae8a5-ebc9-469c-9668-56b12675ee62 admin admin] The token cache is being invalidate because project 736e4d3faf764b61aaa7159a7a6eb072 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81808) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:05:20.328822 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-54fae8a5-ebc9-469c-9668-56b12675ee62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:05:20.329514 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-54fae8a5-ebc9-469c-9668-56b12675ee62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:05:20.332294 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1235/2477] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 01:05:20 2022] DELETE /identity/v3/projects/736e4d3faf764b61aaa7159a7a6eb072 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:05:20.337922 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457d3f0-e28a-46ff-9d53-088599d3ab56 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:20.339013 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457d3f0-e28a-46ff-9d53-088599d3ab56 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:20.339292 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6457d3f0-e28a-46ff-9d53-088599d3ab56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:20.372491 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-6457d3f0-e28a-46ff-9d53-088599d3ab56 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:05:20.374231 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-6457d3f0-e28a-46ff-9d53-088599d3ab56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:20.469206 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1243/2478] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:05:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:05:20.470342 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac7d146-5d3e-4211-99fd-9f45f80b7c15 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:20.470675 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac7d146-5d3e-4211-99fd-9f45f80b7c15 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:20.470929 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac7d146-5d3e-4211-99fd-9f45f80b7c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:20.502137 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-8ac7d146-5d3e-4211-99fd-9f45f80b7c15 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:05:20.510569 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-8ac7d146-5d3e-4211-99fd-9f45f80b7c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:20.520326 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1236/2479] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:05:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:05:20.524637 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6457d3f0-e28a-46ff-9d53-088599d3ab56 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:20.537972 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6457d3f0-e28a-46ff-9d53-088599d3ab56 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:20.549319 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d523b65-5b4d-4320-b7b5-6caff39b0bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:20.550005 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d523b65-5b4d-4320-b7b5-6caff39b0bec admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:20.550282 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d523b65-5b4d-4320-b7b5-6caff39b0bec admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:20.550551 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d523b65-5b4d-4320-b7b5-6caff39b0bec admin admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:20.551225 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d523b65-5b4d-4320-b7b5-6caff39b0bec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:05:20.551524 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d523b65-5b4d-4320-b7b5-6caff39b0bec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:20.553833 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d523b65-5b4d-4320-b7b5-6caff39b0bec admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:20.589471 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1244/2480] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 01:05:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:05:20.590939 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac7d146-5d3e-4211-99fd-9f45f80b7c15 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:20.601215 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac7d146-5d3e-4211-99fd-9f45f80b7c15 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:20.606756 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49739f4f-e5fe-4669-ac86-c267c4a6776e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:20.607687 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49739f4f-e5fe-4669-ac86-c267c4a6776e admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:20.608134 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49739f4f-e5fe-4669-ac86-c267c4a6776e admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:20.608692 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49739f4f-e5fe-4669-ac86-c267c4a6776e admin admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:20.609487 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49739f4f-e5fe-4669-ac86-c267c4a6776e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:20.612819 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49739f4f-e5fe-4669-ac86-c267c4a6776e admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:20.658132 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d523b65-5b4d-4320-b7b5-6caff39b0bec admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:20.658473 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1237/2481] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 01:05:20 2022] POST /identity/v3/projects => generated 391 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:05:20.672696 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d523b65-5b4d-4320-b7b5-6caff39b0bec admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:20.727096 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:05:20.774821 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca3ad9-7878-4ccd-a066-89e10b63a3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:20.775532 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca3ad9-7878-4ccd-a066-89e10b63a3b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:20.776004 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca3ad9-7878-4ccd-a066-89e10b63a3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:20.776385 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca3ad9-7878-4ccd-a066-89e10b63a3b1 admin admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:20.777290 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bca3ad9-7878-4ccd-a066-89e10b63a3b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:20.780358 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bca3ad9-7878-4ccd-a066-89e10b63a3b1 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:20.812957 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49739f4f-e5fe-4669-ac86-c267c4a6776e admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:20.824117 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1245/2482] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 01:05:20 2022] POST /identity/v3/users => generated 296 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:05:20.827835 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49739f4f-e5fe-4669-ac86-c267c4a6776e admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:20.836907 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce5aab-7ec9-49fb-b314-290322892e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:20.837878 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce5aab-7ec9-49fb-b314-290322892e73 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:20.838369 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce5aab-7ec9-49fb-b314-290322892e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:20.838819 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce5aab-7ec9-49fb-b314-290322892e73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:20.839656 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dce5aab-7ec9-49fb-b314-290322892e73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:20.841789 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dce5aab-7ec9-49fb-b314-290322892e73 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:20.861305 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1238/2483] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:05:20 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:05:20.865317 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca3ad9-7878-4ccd-a066-89e10b63a3b1 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:20.880763 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca3ad9-7878-4ccd-a066-89e10b63a3b1 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:20.890025 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccf99ff-4d07-4296-9d2c-f463f3adab62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:20.891023 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf99ff-4d07-4296-9d2c-f463f3adab62 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:20.891625 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf99ff-4d07-4296-9d2c-f463f3adab62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:20.892222 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf99ff-4d07-4296-9d2c-f463f3adab62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:20.893083 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccf99ff-4d07-4296-9d2c-f463f3adab62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:20.896245 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccf99ff-4d07-4296-9d2c-f463f3adab62 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:20.915639 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce5aab-7ec9-49fb-b314-290322892e73 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:20.926787 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1246/2484] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:05:20 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:05:20.928267 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce5aab-7ec9-49fb-b314-290322892e73 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:20.934644 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2894755-07f9-46f2-b1f1-711c13726c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:20.936637 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2894755-07f9-46f2-b1f1-711c13726c5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:20.936994 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2894755-07f9-46f2-b1f1-711c13726c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:20.937500 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2894755-07f9-46f2-b1f1-711c13726c5e admin admin] PATH_INFO: `/v3/projects/956a7bc5b9c44750ba2219a677e24568/users/439810303e27476f9765876f956f4bc7/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:20.973789 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2894755-07f9-46f2-b1f1-711c13726c5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=956a7bc5b9c44750ba2219a677e24568, user_id=439810303e27476f9765876f956f4bc7, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:20.992056 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2894755-07f9-46f2-b1f1-711c13726c5e admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:21.015950 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1239/2485] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 01:05:20 2022] PUT /identity/v3/projects/956a7bc5b9c44750ba2219a677e24568/users/439810303e27476f9765876f956f4bc7/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:05:21.027562 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79a920-a23b-48e3-8fcc-4c11d01574dc None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:21.027991 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79a920-a23b-48e3-8fcc-4c11d01574dc None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:21.028361 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d79a920-a23b-48e3-8fcc-4c11d01574dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:21.065275 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-3d79a920-a23b-48e3-8fcc-4c11d01574dc None None] MFA Rules not processed for user `439810303e27476f9765876f956f4bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:05:21.067375 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-3d79a920-a23b-48e3-8fcc-4c11d01574dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:21.167252 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1247/2486] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:05:21 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:05:21.169389 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2894755-07f9-46f2-b1f1-711c13726c5e admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:21.300701 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2894755-07f9-46f2-b1f1-711c13726c5e admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:21.305857 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854be88f-5745-430a-9815-93ced983879e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:21.307115 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854be88f-5745-430a-9815-93ced983879e admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:21.307543 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854be88f-5745-430a-9815-93ced983879e admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:21.307984 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854be88f-5745-430a-9815-93ced983879e admin admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:21.308769 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854be88f-5745-430a-9815-93ced983879e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:21.312107 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854be88f-5745-430a-9815-93ced983879e admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:21.323925 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:05:21.355183 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1240/2487] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 01:05:21 2022] POST /identity/v3/projects => generated 391 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:05:21.360025 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d79a920-a23b-48e3-8fcc-4c11d01574dc None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:21.376023 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d79a920-a23b-48e3-8fcc-4c11d01574dc None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:21.438349 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f46238e-0e88-432a-8727-00489c4d3348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:21.439771 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f46238e-0e88-432a-8727-00489c4d3348 admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:21.440251 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f46238e-0e88-432a-8727-00489c4d3348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:21.440716 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f46238e-0e88-432a-8727-00489c4d3348 admin admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:21.441512 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f46238e-0e88-432a-8727-00489c4d3348 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:21.443693 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f46238e-0e88-432a-8727-00489c4d3348 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:21.472974 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1248/2488] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 01:05:21 2022] POST /identity/v3/users => generated 302 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:05:21.477406 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854be88f-5745-430a-9815-93ced983879e admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:21.488149 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854be88f-5745-430a-9815-93ced983879e admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:21.493947 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06aeb0f-2ac0-4f9f-8907-04c64d47d8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:21.494817 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06aeb0f-2ac0-4f9f-8907-04c64d47d8d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:21.495253 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06aeb0f-2ac0-4f9f-8907-04c64d47d8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:21.495704 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06aeb0f-2ac0-4f9f-8907-04c64d47d8d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:21.496865 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06aeb0f-2ac0-4f9f-8907-04c64d47d8d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:21.498824 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06aeb0f-2ac0-4f9f-8907-04c64d47d8d1 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:21.510154 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1241/2489] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:05:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:05:21.514593 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f46238e-0e88-432a-8727-00489c4d3348 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:21.525961 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f46238e-0e88-432a-8727-00489c4d3348 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:21.531077 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23daff8-2d77-4dd3-9d8a-212edc13de5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:21.531804 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23daff8-2d77-4dd3-9d8a-212edc13de5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:21.532146 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23daff8-2d77-4dd3-9d8a-212edc13de5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:21.532486 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23daff8-2d77-4dd3-9d8a-212edc13de5b admin admin] PATH_INFO: `/v3/projects/859e7cc4a2a94992842a1c74e01a439b/users/c5721f72184f4d40a30ae1d8e2f2a1ec/roles/2e4889bb71f9434392c0baba59f2534e` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:21.550319 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23daff8-2d77-4dd3-9d8a-212edc13de5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=859e7cc4a2a94992842a1c74e01a439b, user_id=c5721f72184f4d40a30ae1d8e2f2a1ec, role_id=2e4889bb71f9434392c0baba59f2534e)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:21.553028 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23daff8-2d77-4dd3-9d8a-212edc13de5b admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:21.567557 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1249/2490] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 01:05:21 2022] PUT /identity/v3/projects/859e7cc4a2a94992842a1c74e01a439b/users/c5721f72184f4d40a30ae1d8e2f2a1ec/roles/2e4889bb71f9434392c0baba59f2534e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:05:21.571605 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06aeb0f-2ac0-4f9f-8907-04c64d47d8d1 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:21.583346 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06aeb0f-2ac0-4f9f-8907-04c64d47d8d1 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:21.662833 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03990a99-42b6-4cad-9d61-62786162ea79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:21.663798 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03990a99-42b6-4cad-9d61-62786162ea79 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:21.664240 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03990a99-42b6-4cad-9d61-62786162ea79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:21.664634 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03990a99-42b6-4cad-9d61-62786162ea79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:21.665671 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03990a99-42b6-4cad-9d61-62786162ea79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:21.668723 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03990a99-42b6-4cad-9d61-62786162ea79 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:21.685739 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1242/2491] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:05:21 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:05:21.690215 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23daff8-2d77-4dd3-9d8a-212edc13de5b admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:21.706954 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23daff8-2d77-4dd3-9d8a-212edc13de5b admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:21.712784 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059fad51-976c-468a-864f-2ab34dea72c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:21.713713 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059fad51-976c-468a-864f-2ab34dea72c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:21.713940 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059fad51-976c-468a-864f-2ab34dea72c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:21.714194 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059fad51-976c-468a-864f-2ab34dea72c4 admin admin] PATH_INFO: `/v3/projects/859e7cc4a2a94992842a1c74e01a439b/users/c5721f72184f4d40a30ae1d8e2f2a1ec/roles/2e4889bb71f9434392c0baba59f2534e` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:21.721341 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059fad51-976c-468a-864f-2ab34dea72c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=859e7cc4a2a94992842a1c74e01a439b, user_id=c5721f72184f4d40a30ae1d8e2f2a1ec, role_id=2e4889bb71f9434392c0baba59f2534e)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:21.728839 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059fad51-976c-468a-864f-2ab34dea72c4 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:21.740482 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:05:21.750344 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1250/2492] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 01:05:21 2022] PUT /identity/v3/projects/859e7cc4a2a94992842a1c74e01a439b/users/c5721f72184f4d40a30ae1d8e2f2a1ec/roles/2e4889bb71f9434392c0baba59f2534e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:05:21.761956 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5bac6-f6d9-4876-8ca2-b85c173b60e9 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:21.762551 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5bac6-f6d9-4876-8ca2-b85c173b60e9 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:21.762827 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee5bac6-f6d9-4876-8ca2-b85c173b60e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:21.802017 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-4ee5bac6-f6d9-4876-8ca2-b85c173b60e9 None None] MFA Rules not processed for user `c5721f72184f4d40a30ae1d8e2f2a1ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:05:21.803524 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-4ee5bac6-f6d9-4876-8ca2-b85c173b60e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:21.885609 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1243/2493] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:05:21 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:05:21.901646 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059fad51-976c-468a-864f-2ab34dea72c4 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:21.903456 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-059fad51-976c-468a-864f-2ab34dea72c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:21.984279 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059fad51-976c-468a-864f-2ab34dea72c4 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:21.991140 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee4a12-cfe5-4fc2-a2a8-76c7aa5b81d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:21.991797 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee4a12-cfe5-4fc2-a2a8-76c7aa5b81d7 service nova] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:21.992078 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee4a12-cfe5-4fc2-a2a8-76c7aa5b81d7 service nova] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:21.997729 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee4a12-cfe5-4fc2-a2a8-76c7aa5b81d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:22.057063 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ee4a12-cfe5-4fc2-a2a8-76c7aa5b81d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:22.058667 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ee4a12-cfe5-4fc2-a2a8-76c7aa5b81d7 service nova] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:22.069362 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1251/2494] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:05:21 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:05:26.198094 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee5bac6-f6d9-4876-8ca2-b85c173b60e9 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:26.199931 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-4ee5bac6-f6d9-4876-8ca2-b85c173b60e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:26.291279 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee5bac6-f6d9-4876-8ca2-b85c173b60e9 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:26.300221 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6020f26-523a-43d0-9f05-76379124c6e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:26.300880 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6020f26-523a-43d0-9f05-76379124c6e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:26.301163 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6020f26-523a-43d0-9f05-76379124c6e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:26.301434 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6020f26-523a-43d0-9f05-76379124c6e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:26.318850 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6020f26-523a-43d0-9f05-76379124c6e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:26.321176 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6020f26-523a-43d0-9f05-76379124c6e8 service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:26.344533 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1244/2495] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:05:26 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:05:29.216656 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee4a12-cfe5-4fc2-a2a8-76c7aa5b81d7 service nova] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:29.218246 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-b7ee4a12-cfe5-4fc2-a2a8-76c7aa5b81d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:29.357028 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee4a12-cfe5-4fc2-a2a8-76c7aa5b81d7 service nova] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:29.366759 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfdda66-3c3f-4e4f-8c3d-66a7f2fb539e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:29.367616 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfdda66-3c3f-4e4f-8c3d-66a7f2fb539e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:29.367954 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfdda66-3c3f-4e4f-8c3d-66a7f2fb539e admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:29.368258 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfdda66-3c3f-4e4f-8c3d-66a7f2fb539e admin admin] PATH_INFO: `/v3/users/b05f6aeb21534f4f84acbabe5a40c12c` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:29.369503 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfdda66-3c3f-4e4f-8c3d-66a7f2fb539e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b05f6aeb21534f4f84acbabe5a40c12c)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:29.371599 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfdda66-3c3f-4e4f-8c3d-66a7f2fb539e admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:29.425525 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:05:29.442952 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-9cfdda66-3c3f-4e4f-8c3d-66a7f2fb539e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b05f6aeb21534f4f84acbabe5a40c12c'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:05:29.457321 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-9cfdda66-3c3f-4e4f-8c3d-66a7f2fb539e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b05f6aeb21534f4f84acbabe5a40c12c'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:05:29.467472 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-9cfdda66-3c3f-4e4f-8c3d-66a7f2fb539e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b05f6aeb21534f4f84acbabe5a40c12c'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:05:29.468470 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-9cfdda66-3c3f-4e4f-8c3d-66a7f2fb539e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b05f6aeb21534f4f84acbabe5a40c12c'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:05:29.469620 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-9cfdda66-3c3f-4e4f-8c3d-66a7f2fb539e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b05f6aeb21534f4f84acbabe5a40c12c'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:05:29.484260 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1252/2496] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 01:05:29 2022] DELETE /identity/v3/users/b05f6aeb21534f4f84acbabe5a40c12c => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:05:29.488680 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67490a67-bfdc-4828-9f43-29a7dd8b43cf None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:29.489179 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67490a67-bfdc-4828-9f43-29a7dd8b43cf None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:29.489300 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67490a67-bfdc-4828-9f43-29a7dd8b43cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:29.496566 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:05:29.511089 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-67490a67-bfdc-4828-9f43-29a7dd8b43cf None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:05:29.512396 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-67490a67-bfdc-4828-9f43-29a7dd8b43cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:29.575684 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1245/2497] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:05:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:05:29.585828 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfdda66-3c3f-4e4f-8c3d-66a7f2fb539e admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:29.587761 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-9cfdda66-3c3f-4e4f-8c3d-66a7f2fb539e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:29.654570 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfdda66-3c3f-4e4f-8c3d-66a7f2fb539e admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:29.658596 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c56698e-5515-4411-9b7c-fd6a21f6c4ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:29.659293 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56698e-5515-4411-9b7c-fd6a21f6c4ab service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:29.659618 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56698e-5515-4411-9b7c-fd6a21f6c4ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:29.659919 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56698e-5515-4411-9b7c-fd6a21f6c4ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:29.670134 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c56698e-5515-4411-9b7c-fd6a21f6c4ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:29.671595 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c56698e-5515-4411-9b7c-fd6a21f6c4ab service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:29.682085 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1253/2498] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:05:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:05:29.902071 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67490a67-bfdc-4828-9f43-29a7dd8b43cf None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:05:29.904756 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-67490a67-bfdc-4828-9f43-29a7dd8b43cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:29.923538 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67490a67-bfdc-4828-9f43-29a7dd8b43cf None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:05:29.928859 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d95040-73fa-41e0-b32f-45c72cb21600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:05:29.929743 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d95040-73fa-41e0-b32f-45c72cb21600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:29.930211 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d95040-73fa-41e0-b32f-45c72cb21600 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:29.930646 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d95040-73fa-41e0-b32f-45c72cb21600 admin admin] PATH_INFO: `/v3/projects/6758ef1f37c34364b9cee76a0abe18e4` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:29.932023 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d95040-73fa-41e0-b32f-45c72cb21600 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6758ef1f37c34364b9cee76a0abe18e4)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:05:29.940063 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d95040-73fa-41e0-b32f-45c72cb21600 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:05:30.013145 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-09d95040-73fa-41e0-b32f-45c72cb21600 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6758ef1f37c34364b9cee76a0abe18e4', 'request_id': 'req-09d95040-73fa-41e0-b32f-45c72cb21600'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:05:30.025149 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-09d95040-73fa-41e0-b32f-45c72cb21600 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6758ef1f37c34364b9cee76a0abe18e4', 'request_id': 'req-09d95040-73fa-41e0-b32f-45c72cb21600'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:05:30.039917 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-09d95040-73fa-41e0-b32f-45c72cb21600 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6758ef1f37c34364b9cee76a0abe18e4', 'request_id': 'req-09d95040-73fa-41e0-b32f-45c72cb21600'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:05:30.057271 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-09d95040-73fa-41e0-b32f-45c72cb21600 admin admin] The token cache is being invalidate because project 6758ef1f37c34364b9cee76a0abe18e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81808) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:05:30.057618 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-09d95040-73fa-41e0-b32f-45c72cb21600 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:05:30.058552 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-09d95040-73fa-41e0-b32f-45c72cb21600 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:05:30.060116 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1246/2499] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 01:05:29 2022] DELETE /identity/v3/projects/6758ef1f37c34364b9cee76a0abe18e4 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:05:30.677998 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5ff78-6aac-4df8-8664-6e962f125841 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:05:30.677998 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5ff78-6aac-4df8-8664-6e962f125841 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:05:30.677998 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5ff78-6aac-4df8-8664-6e962f125841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:05:30.745011 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-02c5ff78-6aac-4df8-8664-6e962f125841 None None] MFA Rules not processed for user `439810303e27476f9765876f956f4bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:05:30.746264 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-02c5ff78-6aac-4df8-8664-6e962f125841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:05:30.870088 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1254/2500] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:05:30 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:05:40.051889 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=53,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:05:40.857126 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=66,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:06:22.664693 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450ad4a-7a34-4b0b-8452-9640da8e4138 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:06:22.665326 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450ad4a-7a34-4b0b-8452-9640da8e4138 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:06:22.665326 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450ad4a-7a34-4b0b-8452-9640da8e4138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:06:22.699696 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-9450ad4a-7a34-4b0b-8452-9640da8e4138 None None] MFA Rules not processed for user `b44e7109127a468aa2574c23fc9807b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:06:22.701084 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-9450ad4a-7a34-4b0b-8452-9640da8e4138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:06:22.837480 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1247/2501] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:06:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:06:23.615624 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c46220-3ded-4917-9dfe-35f3f280ee10 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:06:23.616159 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c46220-3ded-4917-9dfe-35f3f280ee10 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:06:23.616251 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c46220-3ded-4917-9dfe-35f3f280ee10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:06:23.639014 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-d1c46220-3ded-4917-9dfe-35f3f280ee10 None None] MFA Rules not processed for user `1f6108050e934edf922491f983d9c9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:06:23.640271 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-d1c46220-3ded-4917-9dfe-35f3f280ee10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:06:23.706405 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1255/2502] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:06:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:06:24.757601 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9450ad4a-7a34-4b0b-8452-9640da8e4138 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:06:24.759105 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-9450ad4a-7a34-4b0b-8452-9640da8e4138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:06:24.899349 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9450ad4a-7a34-4b0b-8452-9640da8e4138 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:06:24.905144 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa29b87-9522-41ca-8ef4-8bc0ee3a8191 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4fc1d11f5641b0b5f301b234282aa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:06:24.905779 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa29b87-9522-41ca-8ef4-8bc0ee3a8191 service placement] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:06:24.906057 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa29b87-9522-41ca-8ef4-8bc0ee3a8191 service placement] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:06:24.906328 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa29b87-9522-41ca-8ef4-8bc0ee3a8191 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:06:24.909301 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-8fa29b87-9522-41ca-8ef4-8bc0ee3a8191 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:06:24.921109 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa29b87-9522-41ca-8ef4-8bc0ee3a8191 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:06:24.922768 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa29b87-9522-41ca-8ef4-8bc0ee3a8191 service placement] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:06:24.933763 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1248/2503] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:06:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:06:33.699710 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=25 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:06:34.928918 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=88 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:07:04.171560 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c46220-3ded-4917-9dfe-35f3f280ee10 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:07:04.173819 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-d1c46220-3ded-4917-9dfe-35f3f280ee10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:07:04.294715 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c46220-3ded-4917-9dfe-35f3f280ee10 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:07:04.303474 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c3efc4-071e-4116-bbcb-2bd32ff9f1d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:07:04.304414 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c3efc4-071e-4116-bbcb-2bd32ff9f1d1 service nova] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:07:04.304801 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c3efc4-071e-4116-bbcb-2bd32ff9f1d1 service nova] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:07:04.305089 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c3efc4-071e-4116-bbcb-2bd32ff9f1d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:07:04.308119 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-e2c3efc4-071e-4116-bbcb-2bd32ff9f1d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:07:04.319868 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c3efc4-071e-4116-bbcb-2bd32ff9f1d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:07:04.321993 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c3efc4-071e-4116-bbcb-2bd32ff9f1d1 service nova] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:07:04.331517 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1256/2504] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:07:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:07:14.327438 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=46 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:07:15.424042 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa29b87-9522-41ca-8ef4-8bc0ee3a8191 service placement] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:07:15.426138 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-8fa29b87-9522-41ca-8ef4-8bc0ee3a8191 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:07:15.515427 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa29b87-9522-41ca-8ef4-8bc0ee3a8191 service placement] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:07:15.522314 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f426c758-e312-41d4-95de-d7a1c0dc97ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:07:15.523252 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426c758-e312-41d4-95de-d7a1c0dc97ea service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:07:15.523689 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426c758-e312-41d4-95de-d7a1c0dc97ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:07:15.524125 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426c758-e312-41d4-95de-d7a1c0dc97ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:07:15.526725 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-f426c758-e312-41d4-95de-d7a1c0dc97ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:07:15.601574 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f426c758-e312-41d4-95de-d7a1c0dc97ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:07:15.602975 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f426c758-e312-41d4-95de-d7a1c0dc97ea service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:07:15.612795 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1249/2505] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:07:15 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:07:23.250169 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a51556-46a9-433d-a4dd-b9388d0fa1b5 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:07:23.250744 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a51556-46a9-433d-a4dd-b9388d0fa1b5 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:07:23.250744 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a51556-46a9-433d-a4dd-b9388d0fa1b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:07:23.269976 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-24a51556-46a9-433d-a4dd-b9388d0fa1b5 None None] MFA Rules not processed for user `1f6108050e934edf922491f983d9c9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:07:23.271204 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-24a51556-46a9-433d-a4dd-b9388d0fa1b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:07:23.278303 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1257/2506] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:07:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:07:25.608355 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=59 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:07:27.363802 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f426c758-e312-41d4-95de-d7a1c0dc97ea service neutron] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:07:27.365167 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-f426c758-e312-41d4-95de-d7a1c0dc97ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:07:27.466679 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f426c758-e312-41d4-95de-d7a1c0dc97ea service neutron] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:07:27.471997 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f69c1e-ac07-4a72-8f44-29dbdecaabf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:07:27.472659 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f69c1e-ac07-4a72-8f44-29dbdecaabf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:07:27.472939 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f69c1e-ac07-4a72-8f44-29dbdecaabf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:07:27.473209 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f69c1e-ac07-4a72-8f44-29dbdecaabf6 admin admin] PATH_INFO: `/v3/users/439810303e27476f9765876f956f4bc7` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:07:27.474482 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f69c1e-ac07-4a72-8f44-29dbdecaabf6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=439810303e27476f9765876f956f4bc7)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:07:27.476569 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f69c1e-ac07-4a72-8f44-29dbdecaabf6 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:07:27.533613 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-e9f69c1e-ac07-4a72-8f44-29dbdecaabf6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '439810303e27476f9765876f956f4bc7'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:07:27.542849 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-e9f69c1e-ac07-4a72-8f44-29dbdecaabf6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '439810303e27476f9765876f956f4bc7'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:07:27.558659 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-e9f69c1e-ac07-4a72-8f44-29dbdecaabf6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '439810303e27476f9765876f956f4bc7'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:07:27.559384 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-e9f69c1e-ac07-4a72-8f44-29dbdecaabf6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '439810303e27476f9765876f956f4bc7'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:07:27.560114 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-e9f69c1e-ac07-4a72-8f44-29dbdecaabf6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '439810303e27476f9765876f956f4bc7'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:07:27.574100 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1250/2507] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 01:07:27 2022] DELETE /identity/v3/users/439810303e27476f9765876f956f4bc7 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:07:27.579002 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb12d84-7c9f-4f9a-a7b5-230049e34de3 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:07:27.579487 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb12d84-7c9f-4f9a-a7b5-230049e34de3 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:07:27.580467 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb12d84-7c9f-4f9a-a7b5-230049e34de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:07:27.609028 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-ebb12d84-7c9f-4f9a-a7b5-230049e34de3 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:07:27.610620 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-ebb12d84-7c9f-4f9a-a7b5-230049e34de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:07:27.685663 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1258/2508] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:07:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:07:27.698515 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f69c1e-ac07-4a72-8f44-29dbdecaabf6 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:07:27.700219 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-e9f69c1e-ac07-4a72-8f44-29dbdecaabf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:07:27.764211 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f69c1e-ac07-4a72-8f44-29dbdecaabf6 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:07:27.767968 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd6940-1118-40cb-8b94-f457055e9b88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:07:27.768627 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd6940-1118-40cb-8b94-f457055e9b88 service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:07:27.768853 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd6940-1118-40cb-8b94-f457055e9b88 service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:07:27.769124 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd6940-1118-40cb-8b94-f457055e9b88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:07:27.775281 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:07:27.780014 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedd6940-1118-40cb-8b94-f457055e9b88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:07:27.781505 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedd6940-1118-40cb-8b94-f457055e9b88 service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:07:27.792348 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1251/2509] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:07:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:07:27.986290 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb12d84-7c9f-4f9a-a7b5-230049e34de3 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:07:27.987890 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-ebb12d84-7c9f-4f9a-a7b5-230049e34de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:07:28.017662 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb12d84-7c9f-4f9a-a7b5-230049e34de3 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:07:28.022550 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0016252e-9766-4818-bf3b-f1dd80a836cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:07:28.023194 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0016252e-9766-4818-bf3b-f1dd80a836cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:07:28.023467 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0016252e-9766-4818-bf3b-f1dd80a836cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:07:28.023759 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0016252e-9766-4818-bf3b-f1dd80a836cb admin admin] PATH_INFO: `/v3/projects/956a7bc5b9c44750ba2219a677e24568` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:07:28.024889 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0016252e-9766-4818-bf3b-f1dd80a836cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=956a7bc5b9c44750ba2219a677e24568)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:07:28.027141 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0016252e-9766-4818-bf3b-f1dd80a836cb admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:07:28.076390 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-0016252e-9766-4818-bf3b-f1dd80a836cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '956a7bc5b9c44750ba2219a677e24568', 'request_id': 'req-0016252e-9766-4818-bf3b-f1dd80a836cb'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:07:28.082785 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-0016252e-9766-4818-bf3b-f1dd80a836cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '956a7bc5b9c44750ba2219a677e24568', 'request_id': 'req-0016252e-9766-4818-bf3b-f1dd80a836cb'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:07:28.092374 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-0016252e-9766-4818-bf3b-f1dd80a836cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '956a7bc5b9c44750ba2219a677e24568', 'request_id': 'req-0016252e-9766-4818-bf3b-f1dd80a836cb'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:07:28.103802 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-0016252e-9766-4818-bf3b-f1dd80a836cb admin admin] The token cache is being invalidate because project 956a7bc5b9c44750ba2219a677e24568 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81807) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:07:28.104094 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-0016252e-9766-4818-bf3b-f1dd80a836cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:07:28.104753 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-0016252e-9766-4818-bf3b-f1dd80a836cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:07:28.106557 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1259/2510] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 01:07:27 2022] DELETE /identity/v3/projects/956a7bc5b9c44750ba2219a677e24568 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:07:28.110751 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd6940-1118-40cb-8b94-f457055e9b88 service neutron] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:07:28.124589 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd6940-1118-40cb-8b94-f457055e9b88 service neutron] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:07:28.185018 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3515c9-a39e-43c4-986f-82824417c3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:07:28.185627 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3515c9-a39e-43c4-986f-82824417c3cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:07:28.185994 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3515c9-a39e-43c4-986f-82824417c3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:07:28.186266 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3515c9-a39e-43c4-986f-82824417c3cf admin admin] PATH_INFO: `/v3/users/c5721f72184f4d40a30ae1d8e2f2a1ec` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:07:28.187441 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3515c9-a39e-43c4-986f-82824417c3cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5721f72184f4d40a30ae1d8e2f2a1ec)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:07:28.189383 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3515c9-a39e-43c4-986f-82824417c3cf admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:07:28.239898 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-1c3515c9-a39e-43c4-986f-82824417c3cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5721f72184f4d40a30ae1d8e2f2a1ec'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:07:28.258818 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-1c3515c9-a39e-43c4-986f-82824417c3cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5721f72184f4d40a30ae1d8e2f2a1ec'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:07:28.272084 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-1c3515c9-a39e-43c4-986f-82824417c3cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5721f72184f4d40a30ae1d8e2f2a1ec'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:07:28.272876 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-1c3515c9-a39e-43c4-986f-82824417c3cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5721f72184f4d40a30ae1d8e2f2a1ec'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:07:28.273559 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-1c3515c9-a39e-43c4-986f-82824417c3cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5721f72184f4d40a30ae1d8e2f2a1ec'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:07:28.286147 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1252/2511] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 01:07:28 2022] DELETE /identity/v3/users/c5721f72184f4d40a30ae1d8e2f2a1ec => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:07:28.579643 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0016252e-9766-4818-bf3b-f1dd80a836cb admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:07:28.581252 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-0016252e-9766-4818-bf3b-f1dd80a836cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:07:28.594474 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0016252e-9766-4818-bf3b-f1dd80a836cb admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:07:28.652756 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a577201-261b-4a8f-a1f7-b00ac0f62493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:07:28.653397 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a577201-261b-4a8f-a1f7-b00ac0f62493 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:07:28.653677 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a577201-261b-4a8f-a1f7-b00ac0f62493 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:07:28.653954 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a577201-261b-4a8f-a1f7-b00ac0f62493 admin admin] PATH_INFO: `/v3/projects/859e7cc4a2a94992842a1c74e01a439b` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:07:28.655099 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a577201-261b-4a8f-a1f7-b00ac0f62493 admin admin] RBAC: Authorizing `identity:delete_project(project_id=859e7cc4a2a94992842a1c74e01a439b)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:07:28.657064 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a577201-261b-4a8f-a1f7-b00ac0f62493 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:07:28.668831 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:07:28.710849 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-1a577201-261b-4a8f-a1f7-b00ac0f62493 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '859e7cc4a2a94992842a1c74e01a439b', 'request_id': 'req-1a577201-261b-4a8f-a1f7-b00ac0f62493'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:07:28.717241 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-1a577201-261b-4a8f-a1f7-b00ac0f62493 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '859e7cc4a2a94992842a1c74e01a439b', 'request_id': 'req-1a577201-261b-4a8f-a1f7-b00ac0f62493'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:07:28.727359 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-1a577201-261b-4a8f-a1f7-b00ac0f62493 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '859e7cc4a2a94992842a1c74e01a439b', 'request_id': 'req-1a577201-261b-4a8f-a1f7-b00ac0f62493'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:07:28.738943 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-1a577201-261b-4a8f-a1f7-b00ac0f62493 admin admin] The token cache is being invalidate because project 859e7cc4a2a94992842a1c74e01a439b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81807) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:07:28.739232 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-1a577201-261b-4a8f-a1f7-b00ac0f62493 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:07:28.739922 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-1a577201-261b-4a8f-a1f7-b00ac0f62493 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:07:28.741440 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1260/2512] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 01:07:28 2022] DELETE /identity/v3/projects/859e7cc4a2a94992842a1c74e01a439b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:07:38.282605 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=56,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:07:38.735674 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=19,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:08:25.022209 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b12f0-844f-44d5-9e5f-156878bb9ae7 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:08:25.022835 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b12f0-844f-44d5-9e5f-156878bb9ae7 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:08:25.022835 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b12f0-844f-44d5-9e5f-156878bb9ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:08:25.043079 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-134b12f0-844f-44d5-9e5f-156878bb9ae7 None None] MFA Rules not processed for user `1f6108050e934edf922491f983d9c9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:08:25.044453 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-134b12f0-844f-44d5-9e5f-156878bb9ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:08:25.105103 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1253/2513] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:08:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:08:25.742767 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36894e5-6f1e-4ff2-8800-2e4e8d18ef2f None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:08:25.743340 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36894e5-6f1e-4ff2-8800-2e4e8d18ef2f None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:08:25.743340 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36894e5-6f1e-4ff2-8800-2e4e8d18ef2f None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:08:25.744723 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1261/2514] 10.222.0.49 () {54 vars in 921 bytes} [Sun Aug 28 01:08:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:08:25.750778 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc81cb58-d070-4a42-a7b8-ee9c37d8e8b5 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:08:25.751067 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc81cb58-d070-4a42-a7b8-ee9c37d8e8b5 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:08:25.751344 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc81cb58-d070-4a42-a7b8-ee9c37d8e8b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:08:25.815798 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-dc81cb58-d070-4a42-a7b8-ee9c37d8e8b5 None None] MFA Rules not processed for user `3dc0655c8156457a8fcb006c9fe85eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:08:25.817110 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-dc81cb58-d070-4a42-a7b8-ee9c37d8e8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:08:25.891481 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1254/2515] 10.222.0.49 () {58 vars in 1018 bytes} [Sun Aug 28 01:08:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:08:25.905456 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36894e5-6f1e-4ff2-8800-2e4e8d18ef2f None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:08:25.907462 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-d36894e5-6f1e-4ff2-8800-2e4e8d18ef2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:08:25.984292 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36894e5-6f1e-4ff2-8800-2e4e8d18ef2f None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:08:25.989793 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b1953-8745-4609-85fa-600fe43166bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:08:25.990566 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b1953-8745-4609-85fa-600fe43166bb service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:08:25.990909 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b1953-8745-4609-85fa-600fe43166bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:08:25.991334 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b1953-8745-4609-85fa-600fe43166bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:08:26.002171 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175b1953-8745-4609-85fa-600fe43166bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:08:26.003639 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175b1953-8745-4609-85fa-600fe43166bb service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:08:26.014842 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1262/2516] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:08:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:08:27.191017 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc81cb58-d070-4a42-a7b8-ee9c37d8e8b5 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:08:27.192735 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-dc81cb58-d070-4a42-a7b8-ee9c37d8e8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:08:27.205643 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc81cb58-d070-4a42-a7b8-ee9c37d8e8b5 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:08:27.209255 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac4b4f-9e18-4446-909a-6d13294d6eda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:08:27.209892 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac4b4f-9e18-4446-909a-6d13294d6eda service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:08:27.210164 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac4b4f-9e18-4446-909a-6d13294d6eda service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:08:27.210431 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac4b4f-9e18-4446-909a-6d13294d6eda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:08:27.212263 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-13ac4b4f-9e18-4446-909a-6d13294d6eda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:08:27.222409 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ac4b4f-9e18-4446-909a-6d13294d6eda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:08:27.224074 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ac4b4f-9e18-4446-909a-6d13294d6eda service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:08:27.233087 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1255/2517] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:08:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:08:27.881613 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b1953-8745-4609-85fa-600fe43166bb service neutron] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:08:27.883750 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-175b1953-8745-4609-85fa-600fe43166bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:08:27.996283 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b1953-8745-4609-85fa-600fe43166bb service neutron] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:08:28.001817 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d42ef7d-ef64-46a5-9e55-e04c5f89e784 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95355adb5a6a4a69a31904247eac6d69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:08:28.001817 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42ef7d-ef64-46a5-9e55-e04c5f89e784 service cinder] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:08:28.001817 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42ef7d-ef64-46a5-9e55-e04c5f89e784 service cinder] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:08:28.002419 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42ef7d-ef64-46a5-9e55-e04c5f89e784 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:08:28.005287 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-8d42ef7d-ef64-46a5-9e55-e04c5f89e784 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:08:28.085893 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d42ef7d-ef64-46a5-9e55-e04c5f89e784 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:08:28.088072 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d42ef7d-ef64-46a5-9e55-e04c5f89e784 service cinder] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:08:28.099344 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1263/2518] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:08:27 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:08:37.229263 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=76 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:08:38.095722 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=83 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:08:39.424145 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac4b4f-9e18-4446-909a-6d13294d6eda service neutron] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:08:39.433349 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac4b4f-9e18-4446-909a-6d13294d6eda service neutron] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:08:39.437942 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef12bae-f34a-4c36-8837-337da618cca5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:08:39.438597 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef12bae-f34a-4c36-8837-337da618cca5 service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:08:39.438861 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef12bae-f34a-4c36-8837-337da618cca5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:08:39.439129 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef12bae-f34a-4c36-8837-337da618cca5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:08:39.441307 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-3ef12bae-f34a-4c36-8837-337da618cca5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:08:39.456552 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef12bae-f34a-4c36-8837-337da618cca5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:08:39.457996 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef12bae-f34a-4c36-8837-337da618cca5 service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:08:39.469322 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1256/2519] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:08:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:08:39.603825 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148013c-eb6c-4468-8f6a-cb23fefef508 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:08:39.604435 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148013c-eb6c-4468-8f6a-cb23fefef508 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:08:39.604435 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148013c-eb6c-4468-8f6a-cb23fefef508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:08:39.624150 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-7148013c-eb6c-4468-8f6a-cb23fefef508 None None] MFA Rules not processed for user `b44e7109127a468aa2574c23fc9807b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:08:39.625349 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-7148013c-eb6c-4468-8f6a-cb23fefef508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:08:39.633143 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1264/2520] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:08:39 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:08:43.092976 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef12bae-f34a-4c36-8837-337da618cca5 service neutron] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:08:43.122208 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef12bae-f34a-4c36-8837-337da618cca5 service neutron] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:08:43.133567 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc2469-6f1d-4f0f-a68e-13973091731e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:08:43.134211 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc2469-6f1d-4f0f-a68e-13973091731e service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:08:43.134492 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc2469-6f1d-4f0f-a68e-13973091731e service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:08:43.134776 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc2469-6f1d-4f0f-a68e-13973091731e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:08:43.141999 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-a0dc2469-6f1d-4f0f-a68e-13973091731e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:08:43.177042 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dc2469-6f1d-4f0f-a68e-13973091731e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:08:43.179160 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dc2469-6f1d-4f0f-a68e-13973091731e service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:08:43.209784 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1257/2521] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:08:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:08:44.303437 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cbe80a-fcda-4199-b58b-5107e4845862 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:08:44.303961 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cbe80a-fcda-4199-b58b-5107e4845862 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:08:44.304085 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cbe80a-fcda-4199-b58b-5107e4845862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:08:44.323580 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-23cbe80a-fcda-4199-b58b-5107e4845862 None None] MFA Rules not processed for user `1f6108050e934edf922491f983d9c9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:08:44.324919 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-23cbe80a-fcda-4199-b58b-5107e4845862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:08:44.332511 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1265/2522] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:08:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:08:45.338570 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc2469-6f1d-4f0f-a68e-13973091731e service neutron] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:08:45.340374 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-a0dc2469-6f1d-4f0f-a68e-13973091731e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:08:45.416094 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc2469-6f1d-4f0f-a68e-13973091731e service neutron] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:08:45.421405 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57abfb-c87c-49f6-b886-ab20af1a5c63 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4fc1d11f5641b0b5f301b234282aa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:08:45.422125 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57abfb-c87c-49f6-b886-ab20af1a5c63 service placement] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:08:45.422403 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57abfb-c87c-49f6-b886-ab20af1a5c63 service placement] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:08:45.422697 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57abfb-c87c-49f6-b886-ab20af1a5c63 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:08:45.424481 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-de57abfb-c87c-49f6-b886-ab20af1a5c63 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:08:45.436515 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de57abfb-c87c-49f6-b886-ab20af1a5c63 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:08:45.438414 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de57abfb-c87c-49f6-b886-ab20af1a5c63 service placement] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:08:45.449363 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1258/2523] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:08:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:08:54.318090 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=6 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:08:55.444425 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=44 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:09:02.501334 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cbe80a-fcda-4199-b58b-5107e4845862 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:09:02.503058 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-23cbe80a-fcda-4199-b58b-5107e4845862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:09:02.521309 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cbe80a-fcda-4199-b58b-5107e4845862 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:09:02.541580 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f5d99-adfc-4a16-99c5-bea16ca45350 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:09:02.544599 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f5d99-adfc-4a16-99c5-bea16ca45350 service nova] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:09:02.545223 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f5d99-adfc-4a16-99c5-bea16ca45350 service nova] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:09:02.545703 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f5d99-adfc-4a16-99c5-bea16ca45350 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:09:02.549222 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-565f5d99-adfc-4a16-99c5-bea16ca45350 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:09:02.587431 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565f5d99-adfc-4a16-99c5-bea16ca45350 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:09:02.592644 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565f5d99-adfc-4a16-99c5-bea16ca45350 service nova] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:09:02.623323 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1266/2524] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:09:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:09:06.522537 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57abfb-c87c-49f6-b886-ab20af1a5c63 service placement] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:09:06.524163 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-de57abfb-c87c-49f6-b886-ab20af1a5c63 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:09:06.537770 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57abfb-c87c-49f6-b886-ab20af1a5c63 service placement] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:09:06.543653 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492bcd69-accc-471b-929a-6c6b4a064708 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4fc1d11f5641b0b5f301b234282aa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:09:06.544324 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492bcd69-accc-471b-929a-6c6b4a064708 service placement] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:09:06.544602 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492bcd69-accc-471b-929a-6c6b4a064708 service placement] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:09:06.544871 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492bcd69-accc-471b-929a-6c6b4a064708 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:09:06.546969 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-492bcd69-accc-471b-929a-6c6b4a064708 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:09:06.559643 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492bcd69-accc-471b-929a-6c6b4a064708 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:09:06.561274 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492bcd69-accc-471b-929a-6c6b4a064708 service placement] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:09:06.580537 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1259/2525] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:09:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:09:12.606170 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=6 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:09:13.278829 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07cca58-5cf4-4f68-a997-8fd65f63b820 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:09:13.279089 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07cca58-5cf4-4f68-a997-8fd65f63b820 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:09:13.279305 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07cca58-5cf4-4f68-a997-8fd65f63b820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:09:13.305414 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-e07cca58-5cf4-4f68-a997-8fd65f63b820 None None] MFA Rules not processed for user `1f6108050e934edf922491f983d9c9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:09:13.306635 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-e07cca58-5cf4-4f68-a997-8fd65f63b820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:09:13.313606 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1267/2526] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:09:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:09:16.569437 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=6 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:09:16.721757 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492bcd69-accc-471b-929a-6c6b4a064708 service placement] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:09:16.747238 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492bcd69-accc-471b-929a-6c6b4a064708 service placement] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:09:16.754683 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0905d2ab-17e4-410f-b35d-fc71ee34df49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:09:16.755325 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0905d2ab-17e4-410f-b35d-fc71ee34df49 service nova] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:09:16.755896 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0905d2ab-17e4-410f-b35d-fc71ee34df49 service nova] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:09:16.756364 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0905d2ab-17e4-410f-b35d-fc71ee34df49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:09:16.759398 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-0905d2ab-17e4-410f-b35d-fc71ee34df49 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:09:16.774259 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0905d2ab-17e4-410f-b35d-fc71ee34df49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:09:16.776316 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0905d2ab-17e4-410f-b35d-fc71ee34df49 service nova] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:09:16.789861 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1260/2527] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:09:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:09:21.023044 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07cca58-5cf4-4f68-a997-8fd65f63b820 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:09:21.025179 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-e07cca58-5cf4-4f68-a997-8fd65f63b820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:09:21.044089 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07cca58-5cf4-4f68-a997-8fd65f63b820 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:09:21.054702 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008aef47-11f8-4d00-9f7f-e96b674581e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:09:21.055584 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008aef47-11f8-4d00-9f7f-e96b674581e8 service nova] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:09:21.056140 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008aef47-11f8-4d00-9f7f-e96b674581e8 service nova] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:09:21.056362 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008aef47-11f8-4d00-9f7f-e96b674581e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:09:21.058210 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-008aef47-11f8-4d00-9f7f-e96b674581e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:09:21.072364 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008aef47-11f8-4d00-9f7f-e96b674581e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:09:21.073997 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008aef47-11f8-4d00-9f7f-e96b674581e8 service nova] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:09:21.086752 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1268/2528] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:09:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:09:26.785379 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=6 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:09:31.081444 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=9 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:10:12.493579 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0905d2ab-17e4-410f-b35d-fc71ee34df49 service nova] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:10:12.507776 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0905d2ab-17e4-410f-b35d-fc71ee34df49 service nova] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:10:12.515398 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf764d8-cbdf-49f3-aa6d-3b11a6f0e4d9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4fc1d11f5641b0b5f301b234282aa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:10:12.516066 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf764d8-cbdf-49f3-aa6d-3b11a6f0e4d9 service placement] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:10:12.520777 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf764d8-cbdf-49f3-aa6d-3b11a6f0e4d9 service placement] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:10:12.520777 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf764d8-cbdf-49f3-aa6d-3b11a6f0e4d9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:10:12.522458 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-fbf764d8-cbdf-49f3-aa6d-3b11a6f0e4d9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:10:12.536236 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf764d8-cbdf-49f3-aa6d-3b11a6f0e4d9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:10:12.538331 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf764d8-cbdf-49f3-aa6d-3b11a6f0e4d9 service placement] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:10:12.552544 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1261/2529] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:10:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:10:19.315650 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf4b291-cd6e-4623-b802-225344de7d5e None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:10:19.316266 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf4b291-cd6e-4623-b802-225344de7d5e None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:10:19.316266 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf4b291-cd6e-4623-b802-225344de7d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:10:19.349379 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-4bf4b291-cd6e-4623-b802-225344de7d5e None None] MFA Rules not processed for user `1f6108050e934edf922491f983d9c9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:10:19.351119 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-4bf4b291-cd6e-4623-b802-225344de7d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:10:19.369004 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1269/2530] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:10:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:10:19.709967 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf764d8-cbdf-49f3-aa6d-3b11a6f0e4d9 service placement] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:10:19.720455 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf764d8-cbdf-49f3-aa6d-3b11a6f0e4d9 service placement] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:10:19.724119 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec14c1-0b07-43fb-8d50-0bf56989dc39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:10:19.724735 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec14c1-0b07-43fb-8d50-0bf56989dc39 service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:10:19.725047 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec14c1-0b07-43fb-8d50-0bf56989dc39 service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:10:19.725288 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec14c1-0b07-43fb-8d50-0bf56989dc39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:10:19.727088 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-b5ec14c1-0b07-43fb-8d50-0bf56989dc39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:10:19.737553 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ec14c1-0b07-43fb-8d50-0bf56989dc39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:10:19.738995 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ec14c1-0b07-43fb-8d50-0bf56989dc39 service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:10:19.747754 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1262/2531] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:10:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:10:29.331304 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=3 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:10:29.743735 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=12 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:10:59.861385 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf4b291-cd6e-4623-b802-225344de7d5e None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:10:59.872548 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf4b291-cd6e-4623-b802-225344de7d5e None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:10:59.876174 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aebf7d-9b16-4375-8ced-55f649f33357 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:10:59.876784 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aebf7d-9b16-4375-8ced-55f649f33357 service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:10:59.877056 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aebf7d-9b16-4375-8ced-55f649f33357 service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:10:59.877318 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aebf7d-9b16-4375-8ced-55f649f33357 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:10:59.879070 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-e8aebf7d-9b16-4375-8ced-55f649f33357 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:10:59.945055 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aebf7d-9b16-4375-8ced-55f649f33357 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:10:59.946590 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aebf7d-9b16-4375-8ced-55f649f33357 service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:10:59.957036 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1270/2532] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:10:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:11:06.102144 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec14c1-0b07-43fb-8d50-0bf56989dc39 service neutron] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:11:06.103793 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-b5ec14c1-0b07-43fb-8d50-0bf56989dc39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:11:06.119823 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec14c1-0b07-43fb-8d50-0bf56989dc39 service neutron] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:11:06.124997 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8419e800-be6f-4637-b960-a802f45dc62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:11:06.125728 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419e800-be6f-4637-b960-a802f45dc62d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:11:06.126007 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419e800-be6f-4637-b960-a802f45dc62d admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:11:06.126310 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8419e800-be6f-4637-b960-a802f45dc62d admin admin] PATH_INFO: `/v3/users/b44e7109127a468aa2574c23fc9807b2` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:11:06.127453 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8419e800-be6f-4637-b960-a802f45dc62d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b44e7109127a468aa2574c23fc9807b2)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:11:06.129431 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8419e800-be6f-4637-b960-a802f45dc62d admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:11:06.180536 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-8419e800-be6f-4637-b960-a802f45dc62d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b44e7109127a468aa2574c23fc9807b2'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:11:06.191864 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-8419e800-be6f-4637-b960-a802f45dc62d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b44e7109127a468aa2574c23fc9807b2'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:11:06.206382 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-8419e800-be6f-4637-b960-a802f45dc62d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b44e7109127a468aa2574c23fc9807b2'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:11:06.207060 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-8419e800-be6f-4637-b960-a802f45dc62d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b44e7109127a468aa2574c23fc9807b2'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:11:06.207804 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-8419e800-be6f-4637-b960-a802f45dc62d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b44e7109127a468aa2574c23fc9807b2'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:11:06.221758 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1263/2533] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 01:11:06 2022] DELETE /identity/v3/users/b44e7109127a468aa2574c23fc9807b2 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:11:06.429686 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aebf7d-9b16-4375-8ced-55f649f33357 service neutron] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:11:06.440067 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aebf7d-9b16-4375-8ced-55f649f33357 service neutron] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:11:06.500424 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccab8f13-6c5f-44f6-a8b2-d05f384778d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:11:06.501062 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccab8f13-6c5f-44f6-a8b2-d05f384778d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:11:06.501345 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccab8f13-6c5f-44f6-a8b2-d05f384778d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:11:06.501618 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccab8f13-6c5f-44f6-a8b2-d05f384778d3 admin admin] PATH_INFO: `/v3/projects/83e9d430d57a409d921420b1211ebb8b` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:11:06.502752 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccab8f13-6c5f-44f6-a8b2-d05f384778d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83e9d430d57a409d921420b1211ebb8b)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:11:06.504721 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccab8f13-6c5f-44f6-a8b2-d05f384778d3 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:11:06.560583 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-ccab8f13-6c5f-44f6-a8b2-d05f384778d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83e9d430d57a409d921420b1211ebb8b', 'request_id': 'req-ccab8f13-6c5f-44f6-a8b2-d05f384778d3'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:11:06.566952 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-ccab8f13-6c5f-44f6-a8b2-d05f384778d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83e9d430d57a409d921420b1211ebb8b', 'request_id': 'req-ccab8f13-6c5f-44f6-a8b2-d05f384778d3'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:11:06.576508 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-ccab8f13-6c5f-44f6-a8b2-d05f384778d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83e9d430d57a409d921420b1211ebb8b', 'request_id': 'req-ccab8f13-6c5f-44f6-a8b2-d05f384778d3'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:11:06.587819 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-ccab8f13-6c5f-44f6-a8b2-d05f384778d3 admin admin] The token cache is being invalidate because project 83e9d430d57a409d921420b1211ebb8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81807) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:11:06.588108 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-ccab8f13-6c5f-44f6-a8b2-d05f384778d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:11:06.588781 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-ccab8f13-6c5f-44f6-a8b2-d05f384778d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:11:06.590367 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1271/2534] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 01:11:06 2022] DELETE /identity/v3/projects/83e9d430d57a409d921420b1211ebb8b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:11:06.594530 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8419e800-be6f-4637-b960-a802f45dc62d admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:11:06.596007 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-8419e800-be6f-4637-b960-a802f45dc62d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:11:06.609728 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8419e800-be6f-4637-b960-a802f45dc62d admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:11:06.675967 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da3258-a824-43e1-ac7b-8e69de73dc95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:11:06.676600 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da3258-a824-43e1-ac7b-8e69de73dc95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:11:06.676889 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da3258-a824-43e1-ac7b-8e69de73dc95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:11:06.677152 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da3258-a824-43e1-ac7b-8e69de73dc95 admin admin] PATH_INFO: `/v3/users/25f4c98243da409b94a51085b05eac24` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:11:06.678325 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7da3258-a824-43e1-ac7b-8e69de73dc95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25f4c98243da409b94a51085b05eac24)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:11:06.680648 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7da3258-a824-43e1-ac7b-8e69de73dc95 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:11:06.737283 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-d7da3258-a824-43e1-ac7b-8e69de73dc95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25f4c98243da409b94a51085b05eac24'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:11:06.747817 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-d7da3258-a824-43e1-ac7b-8e69de73dc95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25f4c98243da409b94a51085b05eac24'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:11:06.763760 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-d7da3258-a824-43e1-ac7b-8e69de73dc95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25f4c98243da409b94a51085b05eac24'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:11:06.764433 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-d7da3258-a824-43e1-ac7b-8e69de73dc95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25f4c98243da409b94a51085b05eac24'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:11:06.765054 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-d7da3258-a824-43e1-ac7b-8e69de73dc95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25f4c98243da409b94a51085b05eac24'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:11:06.767032 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:11:06.779934 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1264/2535] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 01:11:06 2022] DELETE /identity/v3/users/25f4c98243da409b94a51085b05eac24 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:11:06.960178 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccab8f13-6c5f-44f6-a8b2-d05f384778d3 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:11:06.961648 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-ccab8f13-6c5f-44f6-a8b2-d05f384778d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:11:06.974716 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccab8f13-6c5f-44f6-a8b2-d05f384778d3 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:11:06.996495 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:11:07.037119 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c9ef3f-111b-48ce-a0c3-7fd6fa238572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:11:07.037119 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9ef3f-111b-48ce-a0c3-7fd6fa238572 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:11:07.037414 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9ef3f-111b-48ce-a0c3-7fd6fa238572 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:11:07.037656 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9ef3f-111b-48ce-a0c3-7fd6fa238572 admin admin] PATH_INFO: `/v3/projects/a7eb706f2e594a4b9d5f23c28a944e5c` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:11:07.039095 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c9ef3f-111b-48ce-a0c3-7fd6fa238572 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7eb706f2e594a4b9d5f23c28a944e5c)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:11:07.041145 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c9ef3f-111b-48ce-a0c3-7fd6fa238572 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:11:07.091379 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-44c9ef3f-111b-48ce-a0c3-7fd6fa238572 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7eb706f2e594a4b9d5f23c28a944e5c', 'request_id': 'req-44c9ef3f-111b-48ce-a0c3-7fd6fa238572'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:11:07.100229 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-44c9ef3f-111b-48ce-a0c3-7fd6fa238572 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7eb706f2e594a4b9d5f23c28a944e5c', 'request_id': 'req-44c9ef3f-111b-48ce-a0c3-7fd6fa238572'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:11:07.109459 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-44c9ef3f-111b-48ce-a0c3-7fd6fa238572 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7eb706f2e594a4b9d5f23c28a944e5c', 'request_id': 'req-44c9ef3f-111b-48ce-a0c3-7fd6fa238572'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:11:07.122171 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-44c9ef3f-111b-48ce-a0c3-7fd6fa238572 admin admin] The token cache is being invalidate because project a7eb706f2e594a4b9d5f23c28a944e5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81807) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:11:07.122488 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-44c9ef3f-111b-48ce-a0c3-7fd6fa238572 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:11:07.123420 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-44c9ef3f-111b-48ce-a0c3-7fd6fa238572 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:11:07.125703 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1272/2536] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 01:11:06 2022] DELETE /identity/v3/projects/a7eb706f2e594a4b9d5f23c28a944e5c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:11:16.779115 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=4 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:11:17.118376 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=40,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:08.450193 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da3258-a824-43e1-ac7b-8e69de73dc95 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:08.451944 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-d7da3258-a824-43e1-ac7b-8e69de73dc95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:08.530725 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da3258-a824-43e1-ac7b-8e69de73dc95 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:08.595884 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f0f0d-79b1-4797-8107-21dab05998f5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4fc1d11f5641b0b5f301b234282aa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:08.596540 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f0f0d-79b1-4797-8107-21dab05998f5 service placement] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:08.596822 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f0f0d-79b1-4797-8107-21dab05998f5 service placement] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:08.597098 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f0f0d-79b1-4797-8107-21dab05998f5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:08.598986 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-880f0f0d-79b1-4797-8107-21dab05998f5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:08.611712 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880f0f0d-79b1-4797-8107-21dab05998f5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:08.613413 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880f0f0d-79b1-4797-8107-21dab05998f5 service placement] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:08.624621 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1265/2537] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:12:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:12:18.619765 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=58 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:12:23.767420 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c9ef3f-111b-48ce-a0c3-7fd6fa238572 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:12:23.769024 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-44c9ef3f-111b-48ce-a0c3-7fd6fa238572 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:23.828908 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c9ef3f-111b-48ce-a0c3-7fd6fa238572 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:12:23.834144 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e35b85e-0ad2-41e7-ac51-3a91998ccea7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:12:23.835126 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35b85e-0ad2-41e7-ac51-3a91998ccea7 service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:12:23.835644 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35b85e-0ad2-41e7-ac51-3a91998ccea7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:12:23.836183 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35b85e-0ad2-41e7-ac51-3a91998ccea7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:12:23.839197 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-2e35b85e-0ad2-41e7-ac51-3a91998ccea7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:12:23.926023 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e35b85e-0ad2-41e7-ac51-3a91998ccea7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:12:23.927494 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e35b85e-0ad2-41e7-ac51-3a91998ccea7 service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:12:23.946273 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1273/2538] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:12:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:12:33.943362 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=61 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:17.347949 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f0f0d-79b1-4797-8107-21dab05998f5 service placement] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:17.357924 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f0f0d-79b1-4797-8107-21dab05998f5 service placement] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:17.361627 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc76e161-b2d5-46a2-a35a-5190d091e280 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:17.362241 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76e161-b2d5-46a2-a35a-5190d091e280 service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:17.362600 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76e161-b2d5-46a2-a35a-5190d091e280 service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:17.362873 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc76e161-b2d5-46a2-a35a-5190d091e280 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:17.364831 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-cc76e161-b2d5-46a2-a35a-5190d091e280 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:17.461722 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc76e161-b2d5-46a2-a35a-5190d091e280 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:17.463191 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc76e161-b2d5-46a2-a35a-5190d091e280 service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:17.484772 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1266/2539] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:13:17 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:13:21.526982 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67a29c-8945-456a-9bc3-d69864d3f002 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:21.527462 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67a29c-8945-456a-9bc3-d69864d3f002 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:21.527462 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67a29c-8945-456a-9bc3-d69864d3f002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:21.555940 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-df67a29c-8945-456a-9bc3-d69864d3f002 None None] MFA Rules not processed for user `1f6108050e934edf922491f983d9c9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:21.557155 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-df67a29c-8945-456a-9bc3-d69864d3f002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:21.564619 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1274/2540] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:13:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:27.482170 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=43 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:30.496585 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc76e161-b2d5-46a2-a35a-5190d091e280 service neutron] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:30.498303 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-cc76e161-b2d5-46a2-a35a-5190d091e280 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:30.510413 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc76e161-b2d5-46a2-a35a-5190d091e280 service neutron] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:30.515045 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8724da30-b0aa-4d62-931c-f88bfb81f23e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:30.515768 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724da30-b0aa-4d62-931c-f88bfb81f23e service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:30.515982 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724da30-b0aa-4d62-931c-f88bfb81f23e service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:30.516249 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724da30-b0aa-4d62-931c-f88bfb81f23e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:30.518036 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-8724da30-b0aa-4d62-931c-f88bfb81f23e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:30.528356 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8724da30-b0aa-4d62-931c-f88bfb81f23e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:30.529801 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8724da30-b0aa-4d62-931c-f88bfb81f23e service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:30.537711 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1267/2541] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:13:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:13:31.553384 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=6 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:35.250313 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf142c5-e760-45df-9179-430eae2d62cb None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:35.250876 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf142c5-e760-45df-9179-430eae2d62cb None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:35.250876 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf142c5-e760-45df-9179-430eae2d62cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:35.270433 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-fdf142c5-e760-45df-9179-430eae2d62cb None None] MFA Rules not processed for user `1f6108050e934edf922491f983d9c9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:13:35.271635 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-fdf142c5-e760-45df-9179-430eae2d62cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:35.279171 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1275/2542] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:13:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:13:35.611829 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8724da30-b0aa-4d62-931c-f88bfb81f23e service neutron] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:35.621225 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8724da30-b0aa-4d62-931c-f88bfb81f23e service neutron] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:35.625560 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0149890e-802e-415f-8e4b-d750a5acb4b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:35.626141 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149890e-802e-415f-8e4b-d750a5acb4b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:35.626420 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149890e-802e-415f-8e4b-d750a5acb4b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:35.626689 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149890e-802e-415f-8e4b-d750a5acb4b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:35.628602 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-0149890e-802e-415f-8e4b-d750a5acb4b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:35.638683 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0149890e-802e-415f-8e4b-d750a5acb4b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:35.640265 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0149890e-802e-415f-8e4b-d750a5acb4b8 service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:35.648444 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1268/2543] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:13:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:13:39.482025 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf142c5-e760-45df-9179-430eae2d62cb None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:39.494626 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf142c5-e760-45df-9179-430eae2d62cb None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:39.501073 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa57002-33bd-47d4-8148-baad93a4519c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:39.502101 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa57002-33bd-47d4-8148-baad93a4519c service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:39.502616 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa57002-33bd-47d4-8148-baad93a4519c service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:39.503076 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa57002-33bd-47d4-8148-baad93a4519c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:39.506088 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-8fa57002-33bd-47d4-8148-baad93a4519c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:39.593646 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa57002-33bd-47d4-8148-baad93a4519c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:39.595078 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa57002-33bd-47d4-8148-baad93a4519c service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:39.606692 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1276/2544] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:13:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:13:43.137823 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0149890e-802e-415f-8e4b-d750a5acb4b8 service neutron] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:13:43.147584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0149890e-802e-415f-8e4b-d750a5acb4b8 service neutron] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:13:43.152692 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe6514-e517-46bd-9a00-6210dc9f85af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:13:43.153524 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe6514-e517-46bd-9a00-6210dc9f85af service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:13:43.153804 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe6514-e517-46bd-9a00-6210dc9f85af service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:13:43.154100 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe6514-e517-46bd-9a00-6210dc9f85af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:13:43.156286 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-1dfe6514-e517-46bd-9a00-6210dc9f85af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:13:43.175890 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfe6514-e517-46bd-9a00-6210dc9f85af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:13:43.177929 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfe6514-e517-46bd-9a00-6210dc9f85af service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:13:43.195336 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1269/2545] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:13:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:13:49.601526 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=37 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:13:53.187366 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=18 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:21.224163 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa57002-33bd-47d4-8148-baad93a4519c service neutron] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:21.225882 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-8fa57002-33bd-47d4-8148-baad93a4519c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:21.240076 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa57002-33bd-47d4-8148-baad93a4519c service neutron] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:21.245987 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e67b5c-529b-4e09-8777-63e3874ab5ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:21.246600 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e67b5c-529b-4e09-8777-63e3874ab5ed service nova] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:21.246860 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e67b5c-529b-4e09-8777-63e3874ab5ed service nova] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:21.247131 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e67b5c-529b-4e09-8777-63e3874ab5ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:21.249034 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-84e67b5c-529b-4e09-8777-63e3874ab5ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:21.261608 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e67b5c-529b-4e09-8777-63e3874ab5ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:21.263348 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e67b5c-529b-4e09-8777-63e3874ab5ed service nova] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:21.275542 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1277/2546] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:14:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:14:25.099417 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe6514-e517-46bd-9a00-6210dc9f85af service neutron] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:25.111084 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe6514-e517-46bd-9a00-6210dc9f85af service neutron] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:25.118075 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ee575-1dac-4627-8bd7-9e302df69507 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:25.118820 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ee575-1dac-4627-8bd7-9e302df69507 service nova] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:25.119146 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ee575-1dac-4627-8bd7-9e302df69507 service nova] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:25.119490 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ee575-1dac-4627-8bd7-9e302df69507 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:25.121543 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-a20ee575-1dac-4627-8bd7-9e302df69507 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:25.137135 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20ee575-1dac-4627-8bd7-9e302df69507 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:25.139730 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20ee575-1dac-4627-8bd7-9e302df69507 service nova] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:25.152303 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1270/2547] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:14:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:14:31.269851 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=6 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:35.145746 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=6 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:14:40.519522 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e67b5c-529b-4e09-8777-63e3874ab5ed service nova] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:40.521345 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-84e67b5c-529b-4e09-8777-63e3874ab5ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:40.537677 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e67b5c-529b-4e09-8777-63e3874ab5ed service nova] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:40.543526 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc61d82b-ae57-41ce-b8ef-8a24b23cc677 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4fc1d11f5641b0b5f301b234282aa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:40.544206 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61d82b-ae57-41ce-b8ef-8a24b23cc677 service placement] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:40.544470 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61d82b-ae57-41ce-b8ef-8a24b23cc677 service placement] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:40.544742 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc61d82b-ae57-41ce-b8ef-8a24b23cc677 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:40.547259 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-bc61d82b-ae57-41ce-b8ef-8a24b23cc677 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:40.559946 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc61d82b-ae57-41ce-b8ef-8a24b23cc677 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:40.561750 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc61d82b-ae57-41ce-b8ef-8a24b23cc677 service placement] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:40.576046 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1278/2548] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:14:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:14:47.473020 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f708d76b-ed52-4f2a-b339-c188ff313074 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:47.473581 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f708d76b-ed52-4f2a-b339-c188ff313074 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:47.473991 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f708d76b-ed52-4f2a-b339-c188ff313074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:47.494446 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-f708d76b-ed52-4f2a-b339-c188ff313074 None None] MFA Rules not processed for user `1f6108050e934edf922491f983d9c9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:14:47.495707 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-f708d76b-ed52-4f2a-b339-c188ff313074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:47.503766 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1271/2549] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:14:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:14:48.204316 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc61d82b-ae57-41ce-b8ef-8a24b23cc677 service placement] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:48.215920 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc61d82b-ae57-41ce-b8ef-8a24b23cc677 service placement] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:48.224600 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53008d2a-e938-4a06-b2e0-7e2075d1de96 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4fc1d11f5641b0b5f301b234282aa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:48.225631 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53008d2a-e938-4a06-b2e0-7e2075d1de96 service placement] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:48.226014 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53008d2a-e938-4a06-b2e0-7e2075d1de96 service placement] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:48.226370 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53008d2a-e938-4a06-b2e0-7e2075d1de96 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:48.230453 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-53008d2a-e938-4a06-b2e0-7e2075d1de96 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:48.244433 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53008d2a-e938-4a06-b2e0-7e2075d1de96 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:48.246382 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53008d2a-e938-4a06-b2e0-7e2075d1de96 service placement] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:48.257296 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1279/2550] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:14:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:14:54.651354 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f708d76b-ed52-4f2a-b339-c188ff313074 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:14:54.652998 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-f708d76b-ed52-4f2a-b339-c188ff313074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:54.673190 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f708d76b-ed52-4f2a-b339-c188ff313074 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:14:54.683060 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40d900c-bc2f-4d18-9095-3f61b5c10402 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:14:54.684136 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d900c-bc2f-4d18-9095-3f61b5c10402 service nova] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:14:54.684605 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d900c-bc2f-4d18-9095-3f61b5c10402 service nova] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:14:54.685073 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d900c-bc2f-4d18-9095-3f61b5c10402 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:14:54.687990 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-b40d900c-bc2f-4d18-9095-3f61b5c10402 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:14:54.705799 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40d900c-bc2f-4d18-9095-3f61b5c10402 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:14:54.708312 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40d900c-bc2f-4d18-9095-3f61b5c10402 service nova] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:14:54.721768 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1272/2551] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:14:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:14:58.252701 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=12 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:04.717042 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=9 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:43.908116 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53008d2a-e938-4a06-b2e0-7e2075d1de96 service placement] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:43.919235 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53008d2a-e938-4a06-b2e0-7e2075d1de96 service placement] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:43.924887 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563e02a1-b6ef-4abd-9f16-85191194d1ff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4fc1d11f5641b0b5f301b234282aa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:43.925644 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e02a1-b6ef-4abd-9f16-85191194d1ff service placement] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:43.925924 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e02a1-b6ef-4abd-9f16-85191194d1ff service placement] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:43.926192 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563e02a1-b6ef-4abd-9f16-85191194d1ff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:43.928039 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-563e02a1-b6ef-4abd-9f16-85191194d1ff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:43.940565 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563e02a1-b6ef-4abd-9f16-85191194d1ff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:43.942225 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563e02a1-b6ef-4abd-9f16-85191194d1ff service placement] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:43.954032 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1280/2552] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:15:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:15:44.015859 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40d900c-bc2f-4d18-9095-3f61b5c10402 service nova] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:44.017781 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-b40d900c-bc2f-4d18-9095-3f61b5c10402 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:44.085841 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40d900c-bc2f-4d18-9095-3f61b5c10402 service nova] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:44.090559 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab25c38f-abb1-4843-8e2e-a1c79b8e2b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:44.091187 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25c38f-abb1-4843-8e2e-a1c79b8e2b80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:44.091460 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25c38f-abb1-4843-8e2e-a1c79b8e2b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:44.091759 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25c38f-abb1-4843-8e2e-a1c79b8e2b80 admin admin] PATH_INFO: `/v3/users/1f6108050e934edf922491f983d9c9f1` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:44.092866 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab25c38f-abb1-4843-8e2e-a1c79b8e2b80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f6108050e934edf922491f983d9c9f1)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:44.094770 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab25c38f-abb1-4843-8e2e-a1c79b8e2b80 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:44.152177 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-ab25c38f-abb1-4843-8e2e-a1c79b8e2b80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f6108050e934edf922491f983d9c9f1'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:44.163998 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-ab25c38f-abb1-4843-8e2e-a1c79b8e2b80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f6108050e934edf922491f983d9c9f1'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:44.188009 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-ab25c38f-abb1-4843-8e2e-a1c79b8e2b80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f6108050e934edf922491f983d9c9f1'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:44.189135 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-ab25c38f-abb1-4843-8e2e-a1c79b8e2b80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f6108050e934edf922491f983d9c9f1'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:44.190790 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-ab25c38f-abb1-4843-8e2e-a1c79b8e2b80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f6108050e934edf922491f983d9c9f1'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:44.215785 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1273/2553] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 01:15:44 2022] DELETE /identity/v3/users/1f6108050e934edf922491f983d9c9f1 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:15:44.218337 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b786f-7954-4256-8324-f89238b2951c None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:44.218651 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b786f-7954-4256-8324-f89238b2951c None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:44.219113 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b786f-7954-4256-8324-f89238b2951c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:44.242857 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-de9b786f-7954-4256-8324-f89238b2951c None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:15:44.244227 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-de9b786f-7954-4256-8324-f89238b2951c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:44.308427 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1281/2554] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:15:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:15:44.318900 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab25c38f-abb1-4843-8e2e-a1c79b8e2b80 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:44.320298 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-ab25c38f-abb1-4843-8e2e-a1c79b8e2b80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:44.383175 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab25c38f-abb1-4843-8e2e-a1c79b8e2b80 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:44.387005 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3129dbd6-486a-42f3-8726-f410e01aac02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:44.387627 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3129dbd6-486a-42f3-8726-f410e01aac02 service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:44.387942 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3129dbd6-486a-42f3-8726-f410e01aac02 service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:44.388212 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3129dbd6-486a-42f3-8726-f410e01aac02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:44.397632 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3129dbd6-486a-42f3-8726-f410e01aac02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:44.399085 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3129dbd6-486a-42f3-8726-f410e01aac02 service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:44.408838 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1274/2555] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:15:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:15:44.594448 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b786f-7954-4256-8324-f89238b2951c None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:44.596206 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-de9b786f-7954-4256-8324-f89238b2951c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:44.609901 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b786f-7954-4256-8324-f89238b2951c None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:44.615593 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4640a2-1540-43dd-baa7-659f6a819b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:44.616350 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4640a2-1540-43dd-baa7-659f6a819b9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:44.616623 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4640a2-1540-43dd-baa7-659f6a819b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:44.616886 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4640a2-1540-43dd-baa7-659f6a819b9f admin admin] PATH_INFO: `/v3/projects/7957ad0a214147ecb7f2858e4d3c3272` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:44.618021 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4640a2-1540-43dd-baa7-659f6a819b9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7957ad0a214147ecb7f2858e4d3c3272)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:44.620203 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4640a2-1540-43dd-baa7-659f6a819b9f admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:44.674241 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-1f4640a2-1540-43dd-baa7-659f6a819b9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7957ad0a214147ecb7f2858e4d3c3272', 'request_id': 'req-1f4640a2-1540-43dd-baa7-659f6a819b9f'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:44.680587 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-1f4640a2-1540-43dd-baa7-659f6a819b9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7957ad0a214147ecb7f2858e4d3c3272', 'request_id': 'req-1f4640a2-1540-43dd-baa7-659f6a819b9f'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:44.689481 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-1f4640a2-1540-43dd-baa7-659f6a819b9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7957ad0a214147ecb7f2858e4d3c3272', 'request_id': 'req-1f4640a2-1540-43dd-baa7-659f6a819b9f'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:44.700322 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-1f4640a2-1540-43dd-baa7-659f6a819b9f admin admin] The token cache is being invalidate because project 7957ad0a214147ecb7f2858e4d3c3272 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81807) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:15:44.700608 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-1f4640a2-1540-43dd-baa7-659f6a819b9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:44.701287 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-1f4640a2-1540-43dd-baa7-659f6a819b9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:44.702818 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1282/2556] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 01:15:44 2022] DELETE /identity/v3/projects/7957ad0a214147ecb7f2858e4d3c3272 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:15:44.707174 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3129dbd6-486a-42f3-8726-f410e01aac02 service neutron] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:44.717377 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3129dbd6-486a-42f3-8726-f410e01aac02 service neutron] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:44.736025 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:44.777215 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba5012-67d9-4ed4-b651-2b422419784c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:44.777855 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba5012-67d9-4ed4-b651-2b422419784c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:44.778133 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba5012-67d9-4ed4-b651-2b422419784c admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:44.778412 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba5012-67d9-4ed4-b651-2b422419784c admin admin] PATH_INFO: `/v3/users/5de1b33cb7ff4cbbbd21f44adace0909` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:44.779548 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ba5012-67d9-4ed4-b651-2b422419784c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5de1b33cb7ff4cbbbd21f44adace0909)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:44.781520 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ba5012-67d9-4ed4-b651-2b422419784c admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:44.836576 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-46ba5012-67d9-4ed4-b651-2b422419784c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5de1b33cb7ff4cbbbd21f44adace0909'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:44.853335 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-46ba5012-67d9-4ed4-b651-2b422419784c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5de1b33cb7ff4cbbbd21f44adace0909'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:44.867930 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-46ba5012-67d9-4ed4-b651-2b422419784c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5de1b33cb7ff4cbbbd21f44adace0909'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:44.868667 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-46ba5012-67d9-4ed4-b651-2b422419784c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5de1b33cb7ff4cbbbd21f44adace0909'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:44.869313 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-46ba5012-67d9-4ed4-b651-2b422419784c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5de1b33cb7ff4cbbbd21f44adace0909'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:44.883967 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1275/2557] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 01:15:44 2022] DELETE /identity/v3/users/5de1b33cb7ff4cbbbd21f44adace0909 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:15:45.177010 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4640a2-1540-43dd-baa7-659f6a819b9f admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:45.178484 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-1f4640a2-1540-43dd-baa7-659f6a819b9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:45.192572 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4640a2-1540-43dd-baa7-659f6a819b9f admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:45.258732 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87cb5e7-7e6c-4b25-a714-16e14b15c7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:45.259279 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87cb5e7-7e6c-4b25-a714-16e14b15c7ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:45.259556 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87cb5e7-7e6c-4b25-a714-16e14b15c7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:45.259862 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87cb5e7-7e6c-4b25-a714-16e14b15c7ff admin admin] PATH_INFO: `/v3/projects/5e997656129a4ed2bc63b40a3f0fe70c` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:45.261176 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87cb5e7-7e6c-4b25-a714-16e14b15c7ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e997656129a4ed2bc63b40a3f0fe70c)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:45.263177 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87cb5e7-7e6c-4b25-a714-16e14b15c7ff admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:45.275158 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:45.314408 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-d87cb5e7-7e6c-4b25-a714-16e14b15c7ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e997656129a4ed2bc63b40a3f0fe70c', 'request_id': 'req-d87cb5e7-7e6c-4b25-a714-16e14b15c7ff'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:45.325909 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-d87cb5e7-7e6c-4b25-a714-16e14b15c7ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e997656129a4ed2bc63b40a3f0fe70c', 'request_id': 'req-d87cb5e7-7e6c-4b25-a714-16e14b15c7ff'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:45.337967 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-d87cb5e7-7e6c-4b25-a714-16e14b15c7ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e997656129a4ed2bc63b40a3f0fe70c', 'request_id': 'req-d87cb5e7-7e6c-4b25-a714-16e14b15c7ff'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:45.351074 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-d87cb5e7-7e6c-4b25-a714-16e14b15c7ff admin admin] The token cache is being invalidate because project 5e997656129a4ed2bc63b40a3f0fe70c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81807) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:15:45.351366 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-d87cb5e7-7e6c-4b25-a714-16e14b15c7ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:45.352146 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-d87cb5e7-7e6c-4b25-a714-16e14b15c7ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:15:45.353729 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1283/2558] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 01:15:45 2022] DELETE /identity/v3/projects/5e997656129a4ed2bc63b40a3f0fe70c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:15:45.359699 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786e7fb-3e16-4361-b4e5-e435e3e92fcb None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:45.360438 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786e7fb-3e16-4361-b4e5-e435e3e92fcb None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:45.360438 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3786e7fb-3e16-4361-b4e5-e435e3e92fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:45.401186 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-3786e7fb-3e16-4361-b4e5-e435e3e92fcb None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:15:45.402383 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-3786e7fb-3e16-4361-b4e5-e435e3e92fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:45.460681 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1276/2559] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:15:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:15:45.472529 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bcb711-5a78-4a93-8a7b-22e3ca83fb08 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:45.472818 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bcb711-5a78-4a93-8a7b-22e3ca83fb08 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:45.473090 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bcb711-5a78-4a93-8a7b-22e3ca83fb08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:45.493875 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-42bcb711-5a78-4a93-8a7b-22e3ca83fb08 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:15:45.495099 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-42bcb711-5a78-4a93-8a7b-22e3ca83fb08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:45.505501 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1284/2560] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:15:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:15:45.511359 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3786e7fb-3e16-4361-b4e5-e435e3e92fcb None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:45.521665 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3786e7fb-3e16-4361-b4e5-e435e3e92fcb None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:45.529595 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada83b0-f252-4e19-b091-12357a374f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:45.530483 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada83b0-f252-4e19-b091-12357a374f8d admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:45.530829 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada83b0-f252-4e19-b091-12357a374f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:45.531217 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada83b0-f252-4e19-b091-12357a374f8d admin admin] PATH_INFO: `/v3/domains` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:45.532267 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ada83b0-f252-4e19-b091-12357a374f8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:15:45.532628 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ada83b0-f252-4e19-b091-12357a374f8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:45.535122 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ada83b0-f252-4e19-b091-12357a374f8d admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:45.549127 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1277/2561] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 01:15:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:15:45.553950 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bcb711-5a78-4a93-8a7b-22e3ca83fb08 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:45.564004 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bcb711-5a78-4a93-8a7b-22e3ca83fb08 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:45.570248 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d564a25e-a261-46ad-8189-d83b9d427349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:45.570859 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d564a25e-a261-46ad-8189-d83b9d427349 admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:45.571134 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d564a25e-a261-46ad-8189-d83b9d427349 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:45.571397 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d564a25e-a261-46ad-8189-d83b9d427349 admin admin] PATH_INFO: `/v3/projects` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:45.572069 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d564a25e-a261-46ad-8189-d83b9d427349 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:45.574040 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d564a25e-a261-46ad-8189-d83b9d427349 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:45.619346 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1285/2562] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 01:15:45 2022] POST /identity/v3/projects => generated 377 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:15:45.623775 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada83b0-f252-4e19-b091-12357a374f8d admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:45.634558 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada83b0-f252-4e19-b091-12357a374f8d admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:45.644316 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:45.696958 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b54b1dc-ee5b-4fb6-bdef-e23c71e12961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:45.697574 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b54b1dc-ee5b-4fb6-bdef-e23c71e12961 admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:45.697850 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b54b1dc-ee5b-4fb6-bdef-e23c71e12961 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:45.698114 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b54b1dc-ee5b-4fb6-bdef-e23c71e12961 admin admin] PATH_INFO: `/v3/users` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:45.698787 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b54b1dc-ee5b-4fb6-bdef-e23c71e12961 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:45.700809 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b54b1dc-ee5b-4fb6-bdef-e23c71e12961 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:45.726293 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1278/2563] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 01:15:45 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:15:45.731752 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d564a25e-a261-46ad-8189-d83b9d427349 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:45.743908 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d564a25e-a261-46ad-8189-d83b9d427349 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:45.749506 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ab3282-da2f-4d9a-9828-cf72a0d346ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:45.750115 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab3282-da2f-4d9a-9828-cf72a0d346ed admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:45.750391 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab3282-da2f-4d9a-9828-cf72a0d346ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:45.750663 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab3282-da2f-4d9a-9828-cf72a0d346ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:45.751326 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ab3282-da2f-4d9a-9828-cf72a0d346ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:45.752997 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ab3282-da2f-4d9a-9828-cf72a0d346ed admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:45.763636 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1286/2564] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:15:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:15:45.767971 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b54b1dc-ee5b-4fb6-bdef-e23c71e12961 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:45.778542 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b54b1dc-ee5b-4fb6-bdef-e23c71e12961 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:45.783822 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e854bad1-4011-48c9-85f7-418220c5f657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:45.784428 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e854bad1-4011-48c9-85f7-418220c5f657 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:45.784734 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e854bad1-4011-48c9-85f7-418220c5f657 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:45.785002 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e854bad1-4011-48c9-85f7-418220c5f657 admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:45.785637 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e854bad1-4011-48c9-85f7-418220c5f657 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:45.787228 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e854bad1-4011-48c9-85f7-418220c5f657 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:45.798223 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1279/2565] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:15:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:15:45.803175 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ab3282-da2f-4d9a-9828-cf72a0d346ed admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:45.819777 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ab3282-da2f-4d9a-9828-cf72a0d346ed admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:45.830498 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54aeb69-47a8-47f4-8d82-cdf51adcca57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:45.831344 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54aeb69-47a8-47f4-8d82-cdf51adcca57 admin admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:45.831614 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54aeb69-47a8-47f4-8d82-cdf51adcca57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:45.831911 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54aeb69-47a8-47f4-8d82-cdf51adcca57 admin admin] PATH_INFO: `/v3/projects/6142bc4677d347f9af917b20338e1884/users/e85cbad7e1dc43cfbf22309f337585aa/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:45.853720 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54aeb69-47a8-47f4-8d82-cdf51adcca57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6142bc4677d347f9af917b20338e1884, user_id=e85cbad7e1dc43cfbf22309f337585aa, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:45.856420 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54aeb69-47a8-47f4-8d82-cdf51adcca57 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:45.872333 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1287/2566] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 01:15:45 2022] PUT /identity/v3/projects/6142bc4677d347f9af917b20338e1884/users/e85cbad7e1dc43cfbf22309f337585aa/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:15:45.877594 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78f303-243e-4bff-adff-a28970530802 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:45.877908 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78f303-243e-4bff-adff-a28970530802 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:45.878183 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78f303-243e-4bff-adff-a28970530802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:45.898811 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-ac78f303-243e-4bff-adff-a28970530802 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:15:45.900150 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-ac78f303-243e-4bff-adff-a28970530802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:45.972038 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1280/2567] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:15:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:15:45.982066 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54aeb69-47a8-47f4-8d82-cdf51adcca57 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:45.984011 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-f54aeb69-47a8-47f4-8d82-cdf51adcca57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:46.044222 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54aeb69-47a8-47f4-8d82-cdf51adcca57 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:46.048323 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28969a86-a702-471d-b648-5c1e57a6a334 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:46.048934 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28969a86-a702-471d-b648-5c1e57a6a334 service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:46.049198 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28969a86-a702-471d-b648-5c1e57a6a334 service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:46.049533 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28969a86-a702-471d-b648-5c1e57a6a334 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:46.059338 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28969a86-a702-471d-b648-5c1e57a6a334 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:46.060825 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28969a86-a702-471d-b648-5c1e57a6a334 service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:46.070884 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1288/2568] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:15:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:15:46.766518 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd6947-f223-453a-8421-bd9d9bf65fa6 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:46.767369 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd6947-f223-453a-8421-bd9d9bf65fa6 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:46.767369 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd6947-f223-453a-8421-bd9d9bf65fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:46.802858 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-b4bd6947-f223-453a-8421-bd9d9bf65fa6 None None] MFA Rules not processed for user `e85cbad7e1dc43cfbf22309f337585aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:15:46.804597 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-b4bd6947-f223-453a-8421-bd9d9bf65fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:46.875906 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1281/2569] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:15:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:15:46.881163 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28969a86-a702-471d-b648-5c1e57a6a334 service neutron] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:46.891535 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28969a86-a702-471d-b648-5c1e57a6a334 service neutron] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:46.899233 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0431f9b6-47ea-4d78-9adf-2b0689a2a249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:46.900443 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0431f9b6-47ea-4d78-9adf-2b0689a2a249 admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:46.901093 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0431f9b6-47ea-4d78-9adf-2b0689a2a249 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:46.901551 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0431f9b6-47ea-4d78-9adf-2b0689a2a249 admin admin] PATH_INFO: `/v3/projects` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:46.902760 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0431f9b6-47ea-4d78-9adf-2b0689a2a249 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:46.906508 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0431f9b6-47ea-4d78-9adf-2b0689a2a249 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:46.938747 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1289/2570] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 01:15:46 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:15:46.943486 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bd6947-f223-453a-8421-bd9d9bf65fa6 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:46.957066 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bd6947-f223-453a-8421-bd9d9bf65fa6 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:46.981319 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:47.024097 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950f8db2-70dc-487b-82bd-19c2412e4548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:47.024716 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f8db2-70dc-487b-82bd-19c2412e4548 admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:47.024993 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f8db2-70dc-487b-82bd-19c2412e4548 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:47.025267 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f8db2-70dc-487b-82bd-19c2412e4548 admin admin] PATH_INFO: `/v3/users` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:47.025917 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950f8db2-70dc-487b-82bd-19c2412e4548 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:47.027909 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950f8db2-70dc-487b-82bd-19c2412e4548 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:47.050417 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1282/2571] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 01:15:46 2022] POST /identity/v3/users => generated 295 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:15:47.054589 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0431f9b6-47ea-4d78-9adf-2b0689a2a249 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:47.065456 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0431f9b6-47ea-4d78-9adf-2b0689a2a249 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:47.071381 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcb4125-03dc-41aa-9513-6c59a567ce63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:47.072028 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb4125-03dc-41aa-9513-6c59a567ce63 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:47.072303 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb4125-03dc-41aa-9513-6c59a567ce63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:47.072561 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb4125-03dc-41aa-9513-6c59a567ce63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:47.073203 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcb4125-03dc-41aa-9513-6c59a567ce63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:47.074823 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcb4125-03dc-41aa-9513-6c59a567ce63 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:47.076941 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:47.092503 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1290/2572] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:15:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:15:47.093754 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950f8db2-70dc-487b-82bd-19c2412e4548 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:47.104745 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950f8db2-70dc-487b-82bd-19c2412e4548 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:47.114247 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a29bb-1c88-46db-b52f-c7edc3e5f266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:47.114936 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a29bb-1c88-46db-b52f-c7edc3e5f266 admin admin] REQUEST_METHOD: `PUT` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:47.115217 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a29bb-1c88-46db-b52f-c7edc3e5f266 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:47.115566 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a29bb-1c88-46db-b52f-c7edc3e5f266 admin admin] PATH_INFO: `/v3/projects/618f4f39f6bb42acb1ee0ca47cf9630a/users/5ca2ffe1659d4867881a0df3da35a6a3/roles/2e4889bb71f9434392c0baba59f2534e` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:47.134346 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670a29bb-1c88-46db-b52f-c7edc3e5f266 admin admin] RBAC: Authorizing `identity:create_grant(project_id=618f4f39f6bb42acb1ee0ca47cf9630a, user_id=5ca2ffe1659d4867881a0df3da35a6a3, role_id=2e4889bb71f9434392c0baba59f2534e)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:47.136984 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670a29bb-1c88-46db-b52f-c7edc3e5f266 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:47.154402 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1283/2573] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 01:15:47 2022] PUT /identity/v3/projects/618f4f39f6bb42acb1ee0ca47cf9630a/users/5ca2ffe1659d4867881a0df3da35a6a3/roles/2e4889bb71f9434392c0baba59f2534e => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:15:47.158512 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcb4125-03dc-41aa-9513-6c59a567ce63 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:47.169132 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcb4125-03dc-41aa-9513-6c59a567ce63 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:47.240177 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28af096-c5fc-4242-ba87-9c1292c7d98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:47.240776 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28af096-c5fc-4242-ba87-9c1292c7d98e admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:47.241081 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28af096-c5fc-4242-ba87-9c1292c7d98e admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:47.241332 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28af096-c5fc-4242-ba87-9c1292c7d98e admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:47.242016 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28af096-c5fc-4242-ba87-9c1292c7d98e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:47.243686 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28af096-c5fc-4242-ba87-9c1292c7d98e admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:47.255299 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1291/2574] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:15:47 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:15:47.259825 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a29bb-1c88-46db-b52f-c7edc3e5f266 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:47.271385 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a29bb-1c88-46db-b52f-c7edc3e5f266 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:47.280733 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a7bdaf-e3fd-4d40-aa71-519aed9fcef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:47.281720 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a7bdaf-e3fd-4d40-aa71-519aed9fcef0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:47.282108 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a7bdaf-e3fd-4d40-aa71-519aed9fcef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:47.282518 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a7bdaf-e3fd-4d40-aa71-519aed9fcef0 admin admin] PATH_INFO: `/v3/projects/618f4f39f6bb42acb1ee0ca47cf9630a/users/5ca2ffe1659d4867881a0df3da35a6a3/roles/2e4889bb71f9434392c0baba59f2534e` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:47.284691 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a7bdaf-e3fd-4d40-aa71-519aed9fcef0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=618f4f39f6bb42acb1ee0ca47cf9630a, user_id=5ca2ffe1659d4867881a0df3da35a6a3, role_id=2e4889bb71f9434392c0baba59f2534e)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:47.287446 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a7bdaf-e3fd-4d40-aa71-519aed9fcef0 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:47.298820 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1284/2575] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 01:15:47 2022] PUT /identity/v3/projects/618f4f39f6bb42acb1ee0ca47cf9630a/users/5ca2ffe1659d4867881a0df3da35a6a3/roles/2e4889bb71f9434392c0baba59f2534e => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:15:48.033607 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857602d-5448-44d8-841e-d1e9033f1413 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:48.034162 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857602d-5448-44d8-841e-d1e9033f1413 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:48.034162 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857602d-5448-44d8-841e-d1e9033f1413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:48.064683 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-4857602d-5448-44d8-841e-d1e9033f1413 None None] MFA Rules not processed for user `5ca2ffe1659d4867881a0df3da35a6a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:15:48.065931 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-4857602d-5448-44d8-841e-d1e9033f1413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:48.140906 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1292/2576] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:15:48 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:15:48.151913 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d004289-4c08-4d3b-9058-27ac125c8623 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:48.152428 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d004289-4c08-4d3b-9058-27ac125c8623 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:48.152545 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d004289-4c08-4d3b-9058-27ac125c8623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:48.171586 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-8d004289-4c08-4d3b-9058-27ac125c8623 None None] MFA Rules not processed for user `e85cbad7e1dc43cfbf22309f337585aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:15:48.172834 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-8d004289-4c08-4d3b-9058-27ac125c8623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:48.238089 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1285/2577] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:15:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:15:48.251591 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4857602d-5448-44d8-841e-d1e9033f1413 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:15:48.253217 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-4857602d-5448-44d8-841e-d1e9033f1413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:15:48.330068 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4857602d-5448-44d8-841e-d1e9033f1413 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:15:48.336046 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326af07e-01f1-4d6b-8f9d-e0ec128003d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:15:48.336666 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326af07e-01f1-4d6b-8f9d-e0ec128003d6 service nova] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:15:48.336940 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326af07e-01f1-4d6b-8f9d-e0ec128003d6 service nova] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:15:48.337209 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326af07e-01f1-4d6b-8f9d-e0ec128003d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:15:48.345869 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326af07e-01f1-4d6b-8f9d-e0ec128003d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:15:48.347535 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326af07e-01f1-4d6b-8f9d-e0ec128003d6 service nova] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:15:48.357097 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1293/2578] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:15:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:15:58.227102 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=59,keystone:INSERT=5 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:15:58.352890 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=98 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:16:14.199532 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d004289-4c08-4d3b-9058-27ac125c8623 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:16:14.263391 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d004289-4c08-4d3b-9058-27ac125c8623 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:16:14.268849 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660f2315-6af1-42fe-b342-17494f486e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:16:14.269490 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f2315-6af1-42fe-b342-17494f486e18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:14.269770 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f2315-6af1-42fe-b342-17494f486e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:14.270039 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f2315-6af1-42fe-b342-17494f486e18 admin admin] PATH_INFO: `/v3/users/e85cbad7e1dc43cfbf22309f337585aa` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:14.271348 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660f2315-6af1-42fe-b342-17494f486e18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e85cbad7e1dc43cfbf22309f337585aa)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:16:14.273500 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660f2315-6af1-42fe-b342-17494f486e18 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:14.327675 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-660f2315-6af1-42fe-b342-17494f486e18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e85cbad7e1dc43cfbf22309f337585aa'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:14.336137 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-660f2315-6af1-42fe-b342-17494f486e18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e85cbad7e1dc43cfbf22309f337585aa'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:14.350532 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-660f2315-6af1-42fe-b342-17494f486e18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e85cbad7e1dc43cfbf22309f337585aa'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:14.351326 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-660f2315-6af1-42fe-b342-17494f486e18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e85cbad7e1dc43cfbf22309f337585aa'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:14.351998 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-660f2315-6af1-42fe-b342-17494f486e18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e85cbad7e1dc43cfbf22309f337585aa'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:14.364982 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1286/2579] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 01:16:14 2022] DELETE /identity/v3/users/e85cbad7e1dc43cfbf22309f337585aa => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:16:14.561409 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326af07e-01f1-4d6b-8f9d-e0ec128003d6 service nova] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:16:14.573634 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326af07e-01f1-4d6b-8f9d-e0ec128003d6 service nova] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:16:14.632647 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e2e835-66cb-4290-b9e6-be001f083a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:16:14.633285 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e2e835-66cb-4290-b9e6-be001f083a71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:14.633589 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e2e835-66cb-4290-b9e6-be001f083a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:14.633859 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e2e835-66cb-4290-b9e6-be001f083a71 admin admin] PATH_INFO: `/v3/projects/6142bc4677d347f9af917b20338e1884` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:14.635137 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e2e835-66cb-4290-b9e6-be001f083a71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6142bc4677d347f9af917b20338e1884)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:16:14.637130 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e2e835-66cb-4290-b9e6-be001f083a71 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:14.689187 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-c4e2e835-66cb-4290-b9e6-be001f083a71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6142bc4677d347f9af917b20338e1884', 'request_id': 'req-c4e2e835-66cb-4290-b9e6-be001f083a71'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:14.695821 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-c4e2e835-66cb-4290-b9e6-be001f083a71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6142bc4677d347f9af917b20338e1884', 'request_id': 'req-c4e2e835-66cb-4290-b9e6-be001f083a71'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:14.705057 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-c4e2e835-66cb-4290-b9e6-be001f083a71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6142bc4677d347f9af917b20338e1884', 'request_id': 'req-c4e2e835-66cb-4290-b9e6-be001f083a71'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:14.716243 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-c4e2e835-66cb-4290-b9e6-be001f083a71 admin admin] The token cache is being invalidate because project 6142bc4677d347f9af917b20338e1884 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81807) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:16:14.716534 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-c4e2e835-66cb-4290-b9e6-be001f083a71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:14.717266 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-c4e2e835-66cb-4290-b9e6-be001f083a71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:14.718814 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1294/2580] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 01:16:14 2022] DELETE /identity/v3/projects/6142bc4677d347f9af917b20338e1884 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:16:14.723211 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660f2315-6af1-42fe-b342-17494f486e18 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:16:14.724666 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-660f2315-6af1-42fe-b342-17494f486e18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:16:14.738669 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660f2315-6af1-42fe-b342-17494f486e18 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:16:14.797937 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de13f490-a77e-401a-ac98-a53fdd61f2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:16:14.798570 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13f490-a77e-401a-ac98-a53fdd61f2b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:14.798851 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13f490-a77e-401a-ac98-a53fdd61f2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:14.799119 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13f490-a77e-401a-ac98-a53fdd61f2b9 admin admin] PATH_INFO: `/v3/users/5ca2ffe1659d4867881a0df3da35a6a3` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:14.800298 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de13f490-a77e-401a-ac98-a53fdd61f2b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ca2ffe1659d4867881a0df3da35a6a3)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:16:14.802238 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de13f490-a77e-401a-ac98-a53fdd61f2b9 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:14.825447 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:16:14.860327 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-de13f490-a77e-401a-ac98-a53fdd61f2b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ca2ffe1659d4867881a0df3da35a6a3'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:14.870359 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-de13f490-a77e-401a-ac98-a53fdd61f2b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ca2ffe1659d4867881a0df3da35a6a3'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:14.888205 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-de13f490-a77e-401a-ac98-a53fdd61f2b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ca2ffe1659d4867881a0df3da35a6a3'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:14.888936 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-de13f490-a77e-401a-ac98-a53fdd61f2b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ca2ffe1659d4867881a0df3da35a6a3'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:14.889549 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-de13f490-a77e-401a-ac98-a53fdd61f2b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ca2ffe1659d4867881a0df3da35a6a3'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:14.904080 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1287/2581] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 01:16:14 2022] DELETE /identity/v3/users/5ca2ffe1659d4867881a0df3da35a6a3 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:16:15.094427 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e2e835-66cb-4290-b9e6-be001f083a71 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:16:15.096155 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-c4e2e835-66cb-4290-b9e6-be001f083a71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:16:15.117534 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e2e835-66cb-4290-b9e6-be001f083a71 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:16:15.188813 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f444d-7c94-4a64-94ce-c70718ef64f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:16:15.189447 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f444d-7c94-4a64-94ce-c70718ef64f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:15.189728 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f444d-7c94-4a64-94ce-c70718ef64f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:15.190002 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f444d-7c94-4a64-94ce-c70718ef64f0 admin admin] PATH_INFO: `/v3/projects/618f4f39f6bb42acb1ee0ca47cf9630a` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:15.191153 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1f444d-7c94-4a64-94ce-c70718ef64f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=618f4f39f6bb42acb1ee0ca47cf9630a)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:16:15.193465 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1f444d-7c94-4a64-94ce-c70718ef64f0 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:15.232270 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:16:15.246514 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-de1f444d-7c94-4a64-94ce-c70718ef64f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '618f4f39f6bb42acb1ee0ca47cf9630a', 'request_id': 'req-de1f444d-7c94-4a64-94ce-c70718ef64f0'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:15.252776 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-de1f444d-7c94-4a64-94ce-c70718ef64f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '618f4f39f6bb42acb1ee0ca47cf9630a', 'request_id': 'req-de1f444d-7c94-4a64-94ce-c70718ef64f0'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:15.261783 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-de1f444d-7c94-4a64-94ce-c70718ef64f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '618f4f39f6bb42acb1ee0ca47cf9630a', 'request_id': 'req-de1f444d-7c94-4a64-94ce-c70718ef64f0'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:15.272968 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-de1f444d-7c94-4a64-94ce-c70718ef64f0 admin admin] The token cache is being invalidate because project 618f4f39f6bb42acb1ee0ca47cf9630a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81807) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:16:15.273315 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-de1f444d-7c94-4a64-94ce-c70718ef64f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:15.274150 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-de1f444d-7c94-4a64-94ce-c70718ef64f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:15.275961 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1295/2582] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 01:16:15 2022] DELETE /identity/v3/projects/618f4f39f6bb42acb1ee0ca47cf9630a => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:16:21.068270 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12504ba1-9c53-41dc-960f-3e164dd821a0 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:21.068873 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12504ba1-9c53-41dc-960f-3e164dd821a0 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:21.068873 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12504ba1-9c53-41dc-960f-3e164dd821a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:21.092921 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-12504ba1-9c53-41dc-960f-3e164dd821a0 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:16:21.094150 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-12504ba1-9c53-41dc-960f-3e164dd821a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:16:21.163282 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1288/2583] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:16:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:16:21.173075 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f4edbb-a766-4240-a04b-282790cb6e8a None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:21.173649 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f4edbb-a766-4240-a04b-282790cb6e8a None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:21.173649 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f4edbb-a766-4240-a04b-282790cb6e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:21.195928 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-e8f4edbb-a766-4240-a04b-282790cb6e8a None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:16:21.197272 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-e8f4edbb-a766-4240-a04b-282790cb6e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:16:21.205661 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1296/2584] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:16:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:16:21.211469 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12504ba1-9c53-41dc-960f-3e164dd821a0 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:16:21.223466 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12504ba1-9c53-41dc-960f-3e164dd821a0 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:16:21.232101 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a7652-7d91-4ac7-a9ca-ff97e2f42762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:16:21.233026 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a7652-7d91-4ac7-a9ca-ff97e2f42762 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:21.236608 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a7652-7d91-4ac7-a9ca-ff97e2f42762 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:21.236608 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a7652-7d91-4ac7-a9ca-ff97e2f42762 admin admin] PATH_INFO: `/v3/domains` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:21.236608 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5a7652-7d91-4ac7-a9ca-ff97e2f42762 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:16:21.236608 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5a7652-7d91-4ac7-a9ca-ff97e2f42762 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:16:21.239598 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5a7652-7d91-4ac7-a9ca-ff97e2f42762 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:21.255406 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1289/2585] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 01:16:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:16:21.264044 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f4edbb-a766-4240-a04b-282790cb6e8a None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:16:21.273804 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f4edbb-a766-4240-a04b-282790cb6e8a None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:16:21.279271 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a1c79-38da-4c37-9708-f0e1d2740ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:16:21.279993 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a1c79-38da-4c37-9708-f0e1d2740ac1 admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:21.280296 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a1c79-38da-4c37-9708-f0e1d2740ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:21.280497 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a1c79-38da-4c37-9708-f0e1d2740ac1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:21.281187 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618a1c79-38da-4c37-9708-f0e1d2740ac1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:16:21.283156 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618a1c79-38da-4c37-9708-f0e1d2740ac1 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:21.315848 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1297/2586] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 01:16:21 2022] POST /identity/v3/projects => generated 393 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:16:21.320796 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a7652-7d91-4ac7-a9ca-ff97e2f42762 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:16:21.332471 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a7652-7d91-4ac7-a9ca-ff97e2f42762 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:16:21.400239 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8806cf-ea54-4aa0-b358-2bea06f80825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:16:21.400901 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8806cf-ea54-4aa0-b358-2bea06f80825 admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:21.401168 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8806cf-ea54-4aa0-b358-2bea06f80825 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:21.401496 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8806cf-ea54-4aa0-b358-2bea06f80825 admin admin] PATH_INFO: `/v3/users` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:21.402155 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8806cf-ea54-4aa0-b358-2bea06f80825 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:16:21.404120 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8806cf-ea54-4aa0-b358-2bea06f80825 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:21.428264 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1290/2587] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 01:16:21 2022] POST /identity/v3/users => generated 297 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:16:21.432822 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a1c79-38da-4c37-9708-f0e1d2740ac1 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:16:21.443735 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a1c79-38da-4c37-9708-f0e1d2740ac1 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:16:21.448750 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf555c-45f9-411b-a8a6-df535d6d4b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:16:21.449346 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf555c-45f9-411b-a8a6-df535d6d4b4c admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:21.449626 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf555c-45f9-411b-a8a6-df535d6d4b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:21.449896 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf555c-45f9-411b-a8a6-df535d6d4b4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:21.450569 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bf555c-45f9-411b-a8a6-df535d6d4b4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:16:21.452206 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bf555c-45f9-411b-a8a6-df535d6d4b4c admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:21.463585 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1298/2588] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:16:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:16:21.468488 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8806cf-ea54-4aa0-b358-2bea06f80825 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:16:21.478900 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8806cf-ea54-4aa0-b358-2bea06f80825 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:16:21.483843 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec75cf60-f012-4a93-b8b6-ac5b5cf8df57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:16:21.484465 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75cf60-f012-4a93-b8b6-ac5b5cf8df57 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:21.484746 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75cf60-f012-4a93-b8b6-ac5b5cf8df57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:21.485020 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec75cf60-f012-4a93-b8b6-ac5b5cf8df57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:21.485678 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec75cf60-f012-4a93-b8b6-ac5b5cf8df57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:16:21.487291 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec75cf60-f012-4a93-b8b6-ac5b5cf8df57 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:21.498744 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1291/2589] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:16:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:16:21.503117 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf555c-45f9-411b-a8a6-df535d6d4b4c admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:16:21.516852 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf555c-45f9-411b-a8a6-df535d6d4b4c admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:16:21.524023 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b207b-6ed0-4370-b147-68ea76fb6bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:16:21.524964 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b207b-6ed0-4370-b147-68ea76fb6bec admin admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:21.525294 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b207b-6ed0-4370-b147-68ea76fb6bec admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:21.525655 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b207b-6ed0-4370-b147-68ea76fb6bec admin admin] PATH_INFO: `/v3/projects/6305ac8d7e7c4cb582abb4b00baebb44/users/bfd9797c6a40488aad2396ccad2b6121/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:21.542893 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8b207b-6ed0-4370-b147-68ea76fb6bec admin admin] RBAC: Authorizing `identity:create_grant(project_id=6305ac8d7e7c4cb582abb4b00baebb44, user_id=bfd9797c6a40488aad2396ccad2b6121, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:16:21.545603 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8b207b-6ed0-4370-b147-68ea76fb6bec admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:21.561330 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1299/2590] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 01:16:21 2022] PUT /identity/v3/projects/6305ac8d7e7c4cb582abb4b00baebb44/users/bfd9797c6a40488aad2396ccad2b6121/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:16:21.575705 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679cf62-cb24-4727-a120-96237b733b78 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:21.575945 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679cf62-cb24-4727-a120-96237b733b78 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:21.576238 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679cf62-cb24-4727-a120-96237b733b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:21.584796 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:16:21.607336 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-2679cf62-cb24-4727-a120-96237b733b78 None None] MFA Rules not processed for user `bfd9797c6a40488aad2396ccad2b6121`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:16:21.608599 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-2679cf62-cb24-4727-a120-96237b733b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:16:21.674246 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1292/2591] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:16:21 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:16:21.679198 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b207b-6ed0-4370-b147-68ea76fb6bec admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:16:21.749433 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b207b-6ed0-4370-b147-68ea76fb6bec admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:16:21.759205 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3921334-ea05-4813-98c6-e5afcecb6ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:16:21.759856 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3921334-ea05-4813-98c6-e5afcecb6ec4 admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:21.760136 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3921334-ea05-4813-98c6-e5afcecb6ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:21.760405 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3921334-ea05-4813-98c6-e5afcecb6ec4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:21.761126 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3921334-ea05-4813-98c6-e5afcecb6ec4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:16:21.763068 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3921334-ea05-4813-98c6-e5afcecb6ec4 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:21.793661 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1300/2592] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 01:16:21 2022] POST /identity/v3/projects => generated 391 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:16:21.798108 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2679cf62-cb24-4727-a120-96237b733b78 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:16:21.809354 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2679cf62-cb24-4727-a120-96237b733b78 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:16:21.869191 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9596de8c-70e9-4aa9-97f9-382eaa1a9dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:16:21.869722 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596de8c-70e9-4aa9-97f9-382eaa1a9dc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:21.869999 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596de8c-70e9-4aa9-97f9-382eaa1a9dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:21.870279 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596de8c-70e9-4aa9-97f9-382eaa1a9dc7 admin admin] PATH_INFO: `/v3/users` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:21.870924 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9596de8c-70e9-4aa9-97f9-382eaa1a9dc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:16:21.872892 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9596de8c-70e9-4aa9-97f9-382eaa1a9dc7 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:21.907813 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1293/2593] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 01:16:21 2022] POST /identity/v3/users => generated 302 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:16:21.913059 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3921334-ea05-4813-98c6-e5afcecb6ec4 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:16:21.925388 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3921334-ea05-4813-98c6-e5afcecb6ec4 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:16:21.931079 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e911abae-3d06-4fdc-8992-31d23bd44ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:16:21.931693 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911abae-3d06-4fdc-8992-31d23bd44ec3 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:21.931985 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911abae-3d06-4fdc-8992-31d23bd44ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:21.932245 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911abae-3d06-4fdc-8992-31d23bd44ec3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:21.932931 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e911abae-3d06-4fdc-8992-31d23bd44ec3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:16:21.934548 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e911abae-3d06-4fdc-8992-31d23bd44ec3 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:21.946249 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1301/2594] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:16:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:16:21.950927 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9596de8c-70e9-4aa9-97f9-382eaa1a9dc7 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:16:21.961923 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9596de8c-70e9-4aa9-97f9-382eaa1a9dc7 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:16:21.967271 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c50ca6b-6284-44f3-99ef-6ec6435ae351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:16:21.967960 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c50ca6b-6284-44f3-99ef-6ec6435ae351 admin admin] REQUEST_METHOD: `PUT` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:21.968260 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c50ca6b-6284-44f3-99ef-6ec6435ae351 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:21.968528 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c50ca6b-6284-44f3-99ef-6ec6435ae351 admin admin] PATH_INFO: `/v3/projects/c88706fe5bd546409c3bfaabbf3771b0/users/6d137038c3d64573b2681893cfecdfed/roles/2e4889bb71f9434392c0baba59f2534e` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:21.985658 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c50ca6b-6284-44f3-99ef-6ec6435ae351 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c88706fe5bd546409c3bfaabbf3771b0, user_id=6d137038c3d64573b2681893cfecdfed, role_id=2e4889bb71f9434392c0baba59f2534e)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:16:21.989751 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c50ca6b-6284-44f3-99ef-6ec6435ae351 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:22.007291 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1294/2595] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 01:16:21 2022] PUT /identity/v3/projects/c88706fe5bd546409c3bfaabbf3771b0/users/6d137038c3d64573b2681893cfecdfed/roles/2e4889bb71f9434392c0baba59f2534e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:16:22.011573 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e911abae-3d06-4fdc-8992-31d23bd44ec3 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:16:22.021662 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e911abae-3d06-4fdc-8992-31d23bd44ec3 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:16:22.049854 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:16:22.079971 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6252747d-bb4c-4fc0-8e46-5f737854b0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:16:22.080585 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252747d-bb4c-4fc0-8e46-5f737854b0ed admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:22.080857 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252747d-bb4c-4fc0-8e46-5f737854b0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:22.081123 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252747d-bb4c-4fc0-8e46-5f737854b0ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:22.081765 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6252747d-bb4c-4fc0-8e46-5f737854b0ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:16:22.083385 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6252747d-bb4c-4fc0-8e46-5f737854b0ed admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:22.094136 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1302/2596] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:16:22 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:16:22.098571 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c50ca6b-6284-44f3-99ef-6ec6435ae351 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:16:22.110076 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c50ca6b-6284-44f3-99ef-6ec6435ae351 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:16:22.116275 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14ab59f-d286-4f35-b5ce-5d87f3edb7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:16:22.118005 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ab59f-d286-4f35-b5ce-5d87f3edb7f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:22.118005 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ab59f-d286-4f35-b5ce-5d87f3edb7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:22.118005 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14ab59f-d286-4f35-b5ce-5d87f3edb7f2 admin admin] PATH_INFO: `/v3/projects/c88706fe5bd546409c3bfaabbf3771b0/users/6d137038c3d64573b2681893cfecdfed/roles/2e4889bb71f9434392c0baba59f2534e` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:22.119541 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14ab59f-d286-4f35-b5ce-5d87f3edb7f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c88706fe5bd546409c3bfaabbf3771b0, user_id=6d137038c3d64573b2681893cfecdfed, role_id=2e4889bb71f9434392c0baba59f2534e)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:16:22.122250 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14ab59f-d286-4f35-b5ce-5d87f3edb7f2 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:22.132908 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1295/2597] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 01:16:22 2022] PUT /identity/v3/projects/c88706fe5bd546409c3bfaabbf3771b0/users/6d137038c3d64573b2681893cfecdfed/roles/2e4889bb71f9434392c0baba59f2534e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:16:22.143410 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c0a6f-5f89-4c21-9f3b-d5fbc869c496 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:22.143729 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c0a6f-5f89-4c21-9f3b-d5fbc869c496 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:22.144003 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c0a6f-5f89-4c21-9f3b-d5fbc869c496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:22.175147 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-2c9c0a6f-5f89-4c21-9f3b-d5fbc869c496 None None] MFA Rules not processed for user `6d137038c3d64573b2681893cfecdfed`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:16:22.176417 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-2c9c0a6f-5f89-4c21-9f3b-d5fbc869c496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:16:22.246330 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1303/2598] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:16:22 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:16:22.260565 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe8f97-c987-4151-96bc-e5c5db9035c6 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:22.260910 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe8f97-c987-4151-96bc-e5c5db9035c6 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:22.261182 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe8f97-c987-4151-96bc-e5c5db9035c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:22.286716 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-9bbe8f97-c987-4151-96bc-e5c5db9035c6 None None] MFA Rules not processed for user `bfd9797c6a40488aad2396ccad2b6121`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:16:22.287948 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-9bbe8f97-c987-4151-96bc-e5c5db9035c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:16:22.352493 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:16:22.375016 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1296/2599] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:16:22 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:16:22.393435 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9c0a6f-5f89-4c21-9f3b-d5fbc869c496 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:16:22.395199 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-2c9c0a6f-5f89-4c21-9f3b-d5fbc869c496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:16:22.473728 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9c0a6f-5f89-4c21-9f3b-d5fbc869c496 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:16:22.480530 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cfa027-53b8-4128-9f94-7b9093925edc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:16:22.481141 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cfa027-53b8-4128-9f94-7b9093925edc service nova] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:22.481420 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cfa027-53b8-4128-9f94-7b9093925edc service nova] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:22.481695 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cfa027-53b8-4128-9f94-7b9093925edc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:22.489919 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cfa027-53b8-4128-9f94-7b9093925edc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:16:22.491529 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cfa027-53b8-4128-9f94-7b9093925edc service nova] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:22.500670 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1304/2600] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:16:22 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:16:32.362531 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=4 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:16:32.496487 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=83 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:16:33.639092 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe8f97-c987-4151-96bc-e5c5db9035c6 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:16:33.687538 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe8f97-c987-4151-96bc-e5c5db9035c6 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:16:33.696512 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c187a81-17f3-41b4-a90e-398014cb7901 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:16:33.697387 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c187a81-17f3-41b4-a90e-398014cb7901 service nova] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:33.697766 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c187a81-17f3-41b4-a90e-398014cb7901 service nova] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:33.698104 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c187a81-17f3-41b4-a90e-398014cb7901 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:33.708889 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c187a81-17f3-41b4-a90e-398014cb7901 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:16:33.710423 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c187a81-17f3-41b4-a90e-398014cb7901 service nova] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:33.720867 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1297/2601] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:16:33 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:16:33.736214 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4399db5-16c8-481b-971b-09db5da32aa3 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:33.736709 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4399db5-16c8-481b-971b-09db5da32aa3 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:33.736709 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4399db5-16c8-481b-971b-09db5da32aa3 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:33.738104 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1305/2602] 10.222.0.49 () {54 vars in 912 bytes} [Sun Aug 28 01:16:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:16:33.742785 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c187a81-17f3-41b4-a90e-398014cb7901 service nova] Authenticating service token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 01:16:33.754456 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-3c187a81-17f3-41b4-a90e-398014cb7901 service nova] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Aug 28 01:16:33.754752 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c187a81-17f3-41b4-a90e-398014cb7901 service nova] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:16:33.763063 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c187a81-17f3-41b4-a90e-398014cb7901 service nova] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:16:33.768218 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dbccf3-292f-419f-b51f-687afec0d6c3 tempest-ServersAdminNegativeTestJSON-956402260 tempest-ServersAdminNegativeTestJSON-956402260-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d137038c3d64573b2681893cfecdfed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c88706fe5bd546409c3bfaabbf3771b0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:16:33.768841 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dbccf3-292f-419f-b51f-687afec0d6c3 tempest-ServersAdminNegativeTestJSON-956402260 tempest-ServersAdminNegativeTestJSON-956402260-project-admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:33.769149 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dbccf3-292f-419f-b51f-687afec0d6c3 tempest-ServersAdminNegativeTestJSON-956402260 tempest-ServersAdminNegativeTestJSON-956402260-project-admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:33.769425 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dbccf3-292f-419f-b51f-687afec0d6c3 tempest-ServersAdminNegativeTestJSON-956402260 tempest-ServersAdminNegativeTestJSON-956402260-project-admin] PATH_INFO: `/v3/projects/c88706fe5bd546409c3bfaabbf3771b0` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:33.770606 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dbccf3-292f-419f-b51f-687afec0d6c3 tempest-ServersAdminNegativeTestJSON-956402260 tempest-ServersAdminNegativeTestJSON-956402260-project-admin] RBAC: Authorizing `identity:get_project(project_id=c88706fe5bd546409c3bfaabbf3771b0)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:16:33.772439 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dbccf3-292f-419f-b51f-687afec0d6c3 tempest-ServersAdminNegativeTestJSON-956402260 tempest-ServersAdminNegativeTestJSON-956402260-project-admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:33.774055 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1298/2603] 10.222.0.49 () {58 vars in 1443 bytes} [Sun Aug 28 01:16:33 2022] GET /identity/v3/projects/c88706fe5bd546409c3bfaabbf3771b0 => generated 391 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:16:33.948691 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4399db5-16c8-481b-971b-09db5da32aa3 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:16:33.950943 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-f4399db5-16c8-481b-971b-09db5da32aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:16:34.037649 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4399db5-16c8-481b-971b-09db5da32aa3 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:16:34.041718 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed90ef1-b92c-4dea-9809-2ea689d5add2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:16:34.042345 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed90ef1-b92c-4dea-9809-2ea689d5add2 service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:34.042625 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed90ef1-b92c-4dea-9809-2ea689d5add2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:34.042880 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed90ef1-b92c-4dea-9809-2ea689d5add2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:34.044958 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-2ed90ef1-b92c-4dea-9809-2ea689d5add2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:16:34.056391 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed90ef1-b92c-4dea-9809-2ea689d5add2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:16:34.057869 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed90ef1-b92c-4dea-9809-2ea689d5add2 service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:34.068275 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1306/2604] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:16:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:16:34.268510 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2fd907-1a79-4d83-a1c5-34ce5e44fbbb None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:34.268764 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2fd907-1a79-4d83-a1c5-34ce5e44fbbb None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:34.269079 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2fd907-1a79-4d83-a1c5-34ce5e44fbbb None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:34.270468 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1299/2605] 10.222.0.49 () {54 vars in 912 bytes} [Sun Aug 28 01:16:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:16:34.275774 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed90ef1-b92c-4dea-9809-2ea689d5add2 service neutron] Authenticating service token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Aug 28 01:16:34.277517 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-2ed90ef1-b92c-4dea-9809-2ea689d5add2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:16:34.294570 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-2ed90ef1-b92c-4dea-9809-2ea689d5add2 service neutron] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Aug 28 01:16:34.294797 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed90ef1-b92c-4dea-9809-2ea689d5add2 service neutron] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:16:34.304952 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed90ef1-b92c-4dea-9809-2ea689d5add2 service neutron] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:16:34.309969 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a9c4f5-c787-451f-8c74-541468aa45ca tempest-ServersAdminNegativeTestJSON-956402260 tempest-ServersAdminNegativeTestJSON-956402260-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d137038c3d64573b2681893cfecdfed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c88706fe5bd546409c3bfaabbf3771b0', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:16:34.310595 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9c4f5-c787-451f-8c74-541468aa45ca tempest-ServersAdminNegativeTestJSON-956402260 tempest-ServersAdminNegativeTestJSON-956402260-project-admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:34.310875 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9c4f5-c787-451f-8c74-541468aa45ca tempest-ServersAdminNegativeTestJSON-956402260 tempest-ServersAdminNegativeTestJSON-956402260-project-admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:34.311149 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9c4f5-c787-451f-8c74-541468aa45ca tempest-ServersAdminNegativeTestJSON-956402260 tempest-ServersAdminNegativeTestJSON-956402260-project-admin] PATH_INFO: `/v3/projects/c88706fe5bd546409c3bfaabbf3771b0` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:34.312308 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a9c4f5-c787-451f-8c74-541468aa45ca tempest-ServersAdminNegativeTestJSON-956402260 tempest-ServersAdminNegativeTestJSON-956402260-project-admin] RBAC: Authorizing `identity:get_project(project_id=c88706fe5bd546409c3bfaabbf3771b0)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:16:34.314143 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a9c4f5-c787-451f-8c74-541468aa45ca tempest-ServersAdminNegativeTestJSON-956402260 tempest-ServersAdminNegativeTestJSON-956402260-project-admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:34.315807 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1307/2606] 10.222.0.49 () {58 vars in 1443 bytes} [Sun Aug 28 01:16:34 2022] GET /identity/v3/projects/c88706fe5bd546409c3bfaabbf3771b0 => generated 391 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:16:38.327907 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2fd907-1a79-4d83-a1c5-34ce5e44fbbb None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:16:38.410124 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2fd907-1a79-4d83-a1c5-34ce5e44fbbb None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:16:38.415094 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60e47fd-0d5f-421a-b352-74fb6fd4af59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:16:38.415694 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e47fd-0d5f-421a-b352-74fb6fd4af59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:38.415993 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e47fd-0d5f-421a-b352-74fb6fd4af59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:38.416257 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e47fd-0d5f-421a-b352-74fb6fd4af59 admin admin] PATH_INFO: `/v3/users/bfd9797c6a40488aad2396ccad2b6121` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:38.417371 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60e47fd-0d5f-421a-b352-74fb6fd4af59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfd9797c6a40488aad2396ccad2b6121)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:16:38.419347 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60e47fd-0d5f-421a-b352-74fb6fd4af59 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:38.480867 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-e60e47fd-0d5f-421a-b352-74fb6fd4af59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfd9797c6a40488aad2396ccad2b6121'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:38.492576 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-e60e47fd-0d5f-421a-b352-74fb6fd4af59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfd9797c6a40488aad2396ccad2b6121'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:38.506169 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-e60e47fd-0d5f-421a-b352-74fb6fd4af59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfd9797c6a40488aad2396ccad2b6121'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:38.506935 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-e60e47fd-0d5f-421a-b352-74fb6fd4af59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfd9797c6a40488aad2396ccad2b6121'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:38.507545 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-e60e47fd-0d5f-421a-b352-74fb6fd4af59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfd9797c6a40488aad2396ccad2b6121'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:38.519917 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1300/2607] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 01:16:38 2022] DELETE /identity/v3/users/bfd9797c6a40488aad2396ccad2b6121 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:16:38.525487 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb9c245-f73c-447e-9457-836d9b47ec23 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:38.526007 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb9c245-f73c-447e-9457-836d9b47ec23 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:38.526007 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb9c245-f73c-447e-9457-836d9b47ec23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:38.547585 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-8cb9c245-f73c-447e-9457-836d9b47ec23 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:16:38.548846 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-8cb9c245-f73c-447e-9457-836d9b47ec23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:16:38.612992 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1308/2608] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:16:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:16:38.624114 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60e47fd-0d5f-421a-b352-74fb6fd4af59 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:16:38.626438 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-e60e47fd-0d5f-421a-b352-74fb6fd4af59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:16:38.665414 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:16:38.695453 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60e47fd-0d5f-421a-b352-74fb6fd4af59 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:16:38.699610 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ad030-f1f6-4aa1-8d41-9274147e2e80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:16:38.700358 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ad030-f1f6-4aa1-8d41-9274147e2e80 service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:38.700637 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ad030-f1f6-4aa1-8d41-9274147e2e80 service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:38.700906 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ad030-f1f6-4aa1-8d41-9274147e2e80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:38.711126 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091ad030-f1f6-4aa1-8d41-9274147e2e80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:16:38.712600 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091ad030-f1f6-4aa1-8d41-9274147e2e80 service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:38.723964 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1301/2609] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:16:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:16:38.921122 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb9c245-f73c-447e-9457-836d9b47ec23 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:16:38.922643 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-8cb9c245-f73c-447e-9457-836d9b47ec23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:16:38.934895 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb9c245-f73c-447e-9457-836d9b47ec23 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:16:38.940355 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a993a-083c-4ad8-9b95-ebea628db780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:16:38.940999 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a993a-083c-4ad8-9b95-ebea628db780 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:38.941275 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a993a-083c-4ad8-9b95-ebea628db780 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:38.941547 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a993a-083c-4ad8-9b95-ebea628db780 admin admin] PATH_INFO: `/v3/projects/6305ac8d7e7c4cb582abb4b00baebb44` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:38.943022 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a993a-083c-4ad8-9b95-ebea628db780 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6305ac8d7e7c4cb582abb4b00baebb44)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:16:38.945020 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a993a-083c-4ad8-9b95-ebea628db780 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:38.996895 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-de5a993a-083c-4ad8-9b95-ebea628db780 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6305ac8d7e7c4cb582abb4b00baebb44', 'request_id': 'req-de5a993a-083c-4ad8-9b95-ebea628db780'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:39.003393 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-de5a993a-083c-4ad8-9b95-ebea628db780 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6305ac8d7e7c4cb582abb4b00baebb44', 'request_id': 'req-de5a993a-083c-4ad8-9b95-ebea628db780'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:39.013475 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-de5a993a-083c-4ad8-9b95-ebea628db780 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6305ac8d7e7c4cb582abb4b00baebb44', 'request_id': 'req-de5a993a-083c-4ad8-9b95-ebea628db780'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:39.021426 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:16:39.025698 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-de5a993a-083c-4ad8-9b95-ebea628db780 admin admin] The token cache is being invalidate because project 6305ac8d7e7c4cb582abb4b00baebb44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81807) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:16:39.025997 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-de5a993a-083c-4ad8-9b95-ebea628db780 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:39.027200 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-de5a993a-083c-4ad8-9b95-ebea628db780 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:39.028979 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1309/2610] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 01:16:38 2022] DELETE /identity/v3/projects/6305ac8d7e7c4cb582abb4b00baebb44 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:16:39.033406 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ad030-f1f6-4aa1-8d41-9274147e2e80 service neutron] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:16:39.043880 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ad030-f1f6-4aa1-8d41-9274147e2e80 service neutron] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:16:39.105516 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee06134-3a2f-4c94-9f82-5307ac9a05f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:16:39.106125 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee06134-3a2f-4c94-9f82-5307ac9a05f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:39.106405 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee06134-3a2f-4c94-9f82-5307ac9a05f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:39.106673 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee06134-3a2f-4c94-9f82-5307ac9a05f6 admin admin] PATH_INFO: `/v3/users/6d137038c3d64573b2681893cfecdfed` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:39.107895 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee06134-3a2f-4c94-9f82-5307ac9a05f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d137038c3d64573b2681893cfecdfed)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:16:39.109843 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee06134-3a2f-4c94-9f82-5307ac9a05f6 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:39.162072 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-bee06134-3a2f-4c94-9f82-5307ac9a05f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d137038c3d64573b2681893cfecdfed'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:39.171094 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-bee06134-3a2f-4c94-9f82-5307ac9a05f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d137038c3d64573b2681893cfecdfed'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:39.185099 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-bee06134-3a2f-4c94-9f82-5307ac9a05f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d137038c3d64573b2681893cfecdfed'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:39.185793 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-bee06134-3a2f-4c94-9f82-5307ac9a05f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d137038c3d64573b2681893cfecdfed'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:39.186487 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-bee06134-3a2f-4c94-9f82-5307ac9a05f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d137038c3d64573b2681893cfecdfed'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:39.202482 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1302/2611] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 01:16:39 2022] DELETE /identity/v3/users/6d137038c3d64573b2681893cfecdfed => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:16:39.513178 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a993a-083c-4ad8-9b95-ebea628db780 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:16:39.514618 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-de5a993a-083c-4ad8-9b95-ebea628db780 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:16:39.529136 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a993a-083c-4ad8-9b95-ebea628db780 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:16:39.599681 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bcd02d-b9df-4bff-a7bf-c6a0e69fc94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:16:39.600600 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bcd02d-b9df-4bff-a7bf-c6a0e69fc94a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:39.600935 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bcd02d-b9df-4bff-a7bf-c6a0e69fc94a admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:39.601320 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bcd02d-b9df-4bff-a7bf-c6a0e69fc94a admin admin] PATH_INFO: `/v3/projects/c88706fe5bd546409c3bfaabbf3771b0` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:39.602598 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bcd02d-b9df-4bff-a7bf-c6a0e69fc94a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c88706fe5bd546409c3bfaabbf3771b0)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:16:39.604795 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bcd02d-b9df-4bff-a7bf-c6a0e69fc94a admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:39.655626 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-b4bcd02d-b9df-4bff-a7bf-c6a0e69fc94a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c88706fe5bd546409c3bfaabbf3771b0', 'request_id': 'req-b4bcd02d-b9df-4bff-a7bf-c6a0e69fc94a'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:39.662292 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-b4bcd02d-b9df-4bff-a7bf-c6a0e69fc94a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c88706fe5bd546409c3bfaabbf3771b0', 'request_id': 'req-b4bcd02d-b9df-4bff-a7bf-c6a0e69fc94a'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:39.671692 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-b4bcd02d-b9df-4bff-a7bf-c6a0e69fc94a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c88706fe5bd546409c3bfaabbf3771b0', 'request_id': 'req-b4bcd02d-b9df-4bff-a7bf-c6a0e69fc94a'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:39.684508 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-b4bcd02d-b9df-4bff-a7bf-c6a0e69fc94a admin admin] The token cache is being invalidate because project c88706fe5bd546409c3bfaabbf3771b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81807) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:16:39.684796 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-b4bcd02d-b9df-4bff-a7bf-c6a0e69fc94a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:39.685841 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-b4bcd02d-b9df-4bff-a7bf-c6a0e69fc94a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:16:39.687365 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1310/2612] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 01:16:39 2022] DELETE /identity/v3/projects/c88706fe5bd546409c3bfaabbf3771b0 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:16:39.693913 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a20db8-0769-4d35-ac4b-a1442c6269d9 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:39.694419 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a20db8-0769-4d35-ac4b-a1442c6269d9 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:39.694655 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a20db8-0769-4d35-ac4b-a1442c6269d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:39.714509 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-41a20db8-0769-4d35-ac4b-a1442c6269d9 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:16:39.715781 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-41a20db8-0769-4d35-ac4b-a1442c6269d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:16:39.765464 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:16:39.782949 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1303/2613] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:16:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:16:39.791311 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83650e01-f6f6-439c-ab4a-7cd4ad94ec0d None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:39.791596 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83650e01-f6f6-439c-ab4a-7cd4ad94ec0d None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:39.791893 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83650e01-f6f6-439c-ab4a-7cd4ad94ec0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:39.813093 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-83650e01-f6f6-439c-ab4a-7cd4ad94ec0d None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:16:39.814318 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-83650e01-f6f6-439c-ab4a-7cd4ad94ec0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:16:39.823465 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1311/2614] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:16:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:16:39.828156 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a20db8-0769-4d35-ac4b-a1442c6269d9 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:16:39.838301 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a20db8-0769-4d35-ac4b-a1442c6269d9 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:16:39.843259 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9e6903-1181-49cd-96df-20e856578c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:16:39.843912 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e6903-1181-49cd-96df-20e856578c6b admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:39.844190 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e6903-1181-49cd-96df-20e856578c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:39.844460 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e6903-1181-49cd-96df-20e856578c6b admin admin] PATH_INFO: `/v3/domains` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:39.845118 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9e6903-1181-49cd-96df-20e856578c6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:16:39.845416 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9e6903-1181-49cd-96df-20e856578c6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:16:39.847028 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9e6903-1181-49cd-96df-20e856578c6b admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:39.859227 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1304/2615] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 01:16:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:16:39.872215 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83650e01-f6f6-439c-ab4a-7cd4ad94ec0d None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:16:39.889213 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83650e01-f6f6-439c-ab4a-7cd4ad94ec0d None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:16:39.895336 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d534c4a-cd3d-4415-a994-9a2aaf11aa8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:16:39.896008 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d534c4a-cd3d-4415-a994-9a2aaf11aa8c admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:39.896292 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d534c4a-cd3d-4415-a994-9a2aaf11aa8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:39.896566 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d534c4a-cd3d-4415-a994-9a2aaf11aa8c admin admin] PATH_INFO: `/v3/projects` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:39.897238 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d534c4a-cd3d-4415-a994-9a2aaf11aa8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:16:39.899224 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d534c4a-cd3d-4415-a994-9a2aaf11aa8c admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:39.935009 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1312/2616] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 01:16:39 2022] POST /identity/v3/projects => generated 379 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:16:39.941311 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9e6903-1181-49cd-96df-20e856578c6b admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:16:39.954039 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9e6903-1181-49cd-96df-20e856578c6b admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:16:40.021391 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4a8646-6bd0-4055-a883-8ddb68b913f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:16:40.022039 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a8646-6bd0-4055-a883-8ddb68b913f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:40.022318 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a8646-6bd0-4055-a883-8ddb68b913f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:40.022587 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a8646-6bd0-4055-a883-8ddb68b913f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:40.023238 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4a8646-6bd0-4055-a883-8ddb68b913f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:16:40.025267 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4a8646-6bd0-4055-a883-8ddb68b913f1 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:40.051298 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1305/2617] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 01:16:39 2022] POST /identity/v3/users => generated 290 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:16:40.055746 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d534c4a-cd3d-4415-a994-9a2aaf11aa8c admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:16:40.067216 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d534c4a-cd3d-4415-a994-9a2aaf11aa8c admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:16:40.073413 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4613d692-2449-4346-b9c6-a15d7f1e34bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:16:40.074022 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4613d692-2449-4346-b9c6-a15d7f1e34bb admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:40.074385 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4613d692-2449-4346-b9c6-a15d7f1e34bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:40.074656 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4613d692-2449-4346-b9c6-a15d7f1e34bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:40.075317 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4613d692-2449-4346-b9c6-a15d7f1e34bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:16:40.076995 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4613d692-2449-4346-b9c6-a15d7f1e34bb admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:40.087920 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1313/2618] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:16:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:16:40.092279 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4a8646-6bd0-4055-a883-8ddb68b913f1 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:16:40.102814 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4a8646-6bd0-4055-a883-8ddb68b913f1 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:16:40.108678 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d2280-bbce-4f1d-884a-19c32bcdd73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:16:40.109276 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d2280-bbce-4f1d-884a-19c32bcdd73d admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:40.109549 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d2280-bbce-4f1d-884a-19c32bcdd73d admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:40.109814 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d2280-bbce-4f1d-884a-19c32bcdd73d admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:40.110463 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093d2280-bbce-4f1d-884a-19c32bcdd73d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:16:40.112108 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093d2280-bbce-4f1d-884a-19c32bcdd73d admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:40.122722 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1306/2619] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:16:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:16:40.127259 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4613d692-2449-4346-b9c6-a15d7f1e34bb admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:16:40.140151 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4613d692-2449-4346-b9c6-a15d7f1e34bb admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:16:40.147374 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37004fb5-833e-4083-b0bc-f606cec9048e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:16:40.148419 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37004fb5-833e-4083-b0bc-f606cec9048e admin admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:40.148784 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37004fb5-833e-4083-b0bc-f606cec9048e admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:40.149114 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37004fb5-833e-4083-b0bc-f606cec9048e admin admin] PATH_INFO: `/v3/projects/e39f81250cd54c2abb275abe21a30a55/users/fc0243ecee7a417cbaeedf634941db03/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:40.167002 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37004fb5-833e-4083-b0bc-f606cec9048e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e39f81250cd54c2abb275abe21a30a55, user_id=fc0243ecee7a417cbaeedf634941db03, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:16:40.169946 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37004fb5-833e-4083-b0bc-f606cec9048e admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:40.188653 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1314/2620] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 01:16:40 2022] PUT /identity/v3/projects/e39f81250cd54c2abb275abe21a30a55/users/fc0243ecee7a417cbaeedf634941db03/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:16:40.194204 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d999e-bc7a-4cb7-bae9-4e579f742ed7 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:40.194489 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d999e-bc7a-4cb7-bae9-4e579f742ed7 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:40.194770 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d999e-bc7a-4cb7-bae9-4e579f742ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:40.214976 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-875d999e-bc7a-4cb7-bae9-4e579f742ed7 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:16:40.216231 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-875d999e-bc7a-4cb7-bae9-4e579f742ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:16:40.281690 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1307/2621] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:16:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:16:40.293462 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37004fb5-833e-4083-b0bc-f606cec9048e admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:16:40.295463 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-37004fb5-833e-4083-b0bc-f606cec9048e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:16:40.328587 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:16:40.357433 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37004fb5-833e-4083-b0bc-f606cec9048e admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:16:40.361540 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80005294-dc69-41c5-8362-4d7e274c8330 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:16:40.362152 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80005294-dc69-41c5-8362-4d7e274c8330 service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:40.362429 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80005294-dc69-41c5-8362-4d7e274c8330 service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:40.362705 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80005294-dc69-41c5-8362-4d7e274c8330 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:40.372173 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80005294-dc69-41c5-8362-4d7e274c8330 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:16:40.373613 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80005294-dc69-41c5-8362-4d7e274c8330 service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:40.383057 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1315/2622] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:16:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:16:44.745638 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e43215-4a0b-4039-ba41-d89556b4eb54 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:44.746180 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e43215-4a0b-4039-ba41-d89556b4eb54 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:44.746266 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e43215-4a0b-4039-ba41-d89556b4eb54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:44.784973 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-d7e43215-4a0b-4039-ba41-d89556b4eb54 None None] MFA Rules not processed for user `fc0243ecee7a417cbaeedf634941db03`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:16:44.786246 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-d7e43215-4a0b-4039-ba41-d89556b4eb54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:16:44.835114 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:16:44.858509 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1308/2623] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:16:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:16:44.871374 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f515c-c231-4a13-9723-6fd74566fef1 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:44.871932 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f515c-c231-4a13-9723-6fd74566fef1 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:44.871932 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f515c-c231-4a13-9723-6fd74566fef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:44.891929 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-f99f515c-c231-4a13-9723-6fd74566fef1 None None] MFA Rules not processed for user `fc0243ecee7a417cbaeedf634941db03`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:16:44.893149 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-f99f515c-c231-4a13-9723-6fd74566fef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:16:44.901094 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1316/2624] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:16:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:16:44.914358 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e43215-4a0b-4039-ba41-d89556b4eb54 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:16:44.915922 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-d7e43215-4a0b-4039-ba41-d89556b4eb54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:16:44.993568 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e43215-4a0b-4039-ba41-d89556b4eb54 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:16:44.999269 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a5e11c-07d7-4a24-b908-2f179b063ec2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:16:44.999925 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5e11c-07d7-4a24-b908-2f179b063ec2 service nova] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:45.000235 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5e11c-07d7-4a24-b908-2f179b063ec2 service nova] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:45.000492 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a5e11c-07d7-4a24-b908-2f179b063ec2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:45.009696 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a5e11c-07d7-4a24-b908-2f179b063ec2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:16:45.011272 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a5e11c-07d7-4a24-b908-2f179b063ec2 service nova] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:45.020522 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1309/2625] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:16:44 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:16:54.886504 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=17 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:16:55.016191 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=41 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:16:55.528574 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e5bc1-5951-4385-9554-92b8f09d7147 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:55.528933 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e5bc1-5951-4385-9554-92b8f09d7147 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:55.529087 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e5bc1-5951-4385-9554-92b8f09d7147 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:55.530453 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1317/2626] 10.222.0.49 () {54 vars in 921 bytes} [Sun Aug 28 01:16:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:16:55.536980 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e56cd-a545-405d-8890-400cc9fda0c3 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:55.537267 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e56cd-a545-405d-8890-400cc9fda0c3 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:55.537579 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e56cd-a545-405d-8890-400cc9fda0c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:55.580719 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-050e56cd-a545-405d-8890-400cc9fda0c3 None None] MFA Rules not processed for user `2d14dcd0cb25427291ab8831924184e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:16:55.582090 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-050e56cd-a545-405d-8890-400cc9fda0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:16:55.589297 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1310/2627] 10.222.0.49 () {58 vars in 1018 bytes} [Sun Aug 28 01:16:55 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:16:55.601816 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e5bc1-5951-4385-9554-92b8f09d7147 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:16:55.604089 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-144e5bc1-5951-4385-9554-92b8f09d7147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:16:55.618582 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e5bc1-5951-4385-9554-92b8f09d7147 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:16:55.623038 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec07aa18-5c55-4124-88c3-b1de206edbc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:16:55.623782 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07aa18-5c55-4124-88c3-b1de206edbc8 service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:55.624051 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07aa18-5c55-4124-88c3-b1de206edbc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:55.624330 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec07aa18-5c55-4124-88c3-b1de206edbc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:55.632397 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec07aa18-5c55-4124-88c3-b1de206edbc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:16:55.633830 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec07aa18-5c55-4124-88c3-b1de206edbc8 service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:55.642530 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1318/2628] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:16:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:16:55.759157 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e56cd-a545-405d-8890-400cc9fda0c3 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:16:55.760630 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-050e56cd-a545-405d-8890-400cc9fda0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:16:55.869496 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e56cd-a545-405d-8890-400cc9fda0c3 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:16:55.876229 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b1cbc-ee5a-4f42-8d90-f744cff3c506 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4fc1d11f5641b0b5f301b234282aa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:16:55.876866 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b1cbc-ee5a-4f42-8d90-f744cff3c506 service placement] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:55.877142 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b1cbc-ee5a-4f42-8d90-f744cff3c506 service placement] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:55.877431 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b1cbc-ee5a-4f42-8d90-f744cff3c506 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:55.879246 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-b50b1cbc-ee5a-4f42-8d90-f744cff3c506 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:16:55.891939 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50b1cbc-ee5a-4f42-8d90-f744cff3c506 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:16:55.893546 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50b1cbc-ee5a-4f42-8d90-f744cff3c506 service placement] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:55.903895 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1311/2629] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:16:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:16:56.088890 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d760a-e233-406b-808c-1218a8064cde None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:56.089338 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d760a-e233-406b-808c-1218a8064cde None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:56.089441 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d760a-e233-406b-808c-1218a8064cde None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:56.090788 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1319/2630] 10.222.0.49 () {54 vars in 921 bytes} [Sun Aug 28 01:16:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:16:56.095855 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36290eb0-f6eb-4428-8d2c-9e050bcc9cd4 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:56.096273 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36290eb0-f6eb-4428-8d2c-9e050bcc9cd4 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:56.096427 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36290eb0-f6eb-4428-8d2c-9e050bcc9cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:56.116808 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-36290eb0-f6eb-4428-8d2c-9e050bcc9cd4 None None] MFA Rules not processed for user `3dc0655c8156457a8fcb006c9fe85eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:16:56.118077 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-36290eb0-f6eb-4428-8d2c-9e050bcc9cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:16:56.128160 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1312/2631] 10.222.0.49 () {58 vars in 1018 bytes} [Sun Aug 28 01:16:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:16:56.139126 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d760a-e233-406b-808c-1218a8064cde None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:16:56.151754 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d760a-e233-406b-808c-1218a8064cde None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:16:56.155624 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7988773-2b1e-4c2f-96dd-bfb1ce5b6e10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:16:56.156278 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7988773-2b1e-4c2f-96dd-bfb1ce5b6e10 service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:16:56.156545 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7988773-2b1e-4c2f-96dd-bfb1ce5b6e10 service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:16:56.156821 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7988773-2b1e-4c2f-96dd-bfb1ce5b6e10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:16:56.167845 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7988773-2b1e-4c2f-96dd-bfb1ce5b6e10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:16:56.169331 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7988773-2b1e-4c2f-96dd-bfb1ce5b6e10 service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:16:56.180667 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1320/2632] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:16:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:17:06.111802 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=53 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:17:06.175895 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=12 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:17:11.458383 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36290eb0-f6eb-4428-8d2c-9e050bcc9cd4 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:11.460188 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-36290eb0-f6eb-4428-8d2c-9e050bcc9cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:11.475813 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36290eb0-f6eb-4428-8d2c-9e050bcc9cd4 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:11.482363 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a7d31f-7d5f-4271-b89a-5b173dbf569b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4fc1d11f5641b0b5f301b234282aa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:11.482963 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7d31f-7d5f-4271-b89a-5b173dbf569b service placement] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:11.483241 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7d31f-7d5f-4271-b89a-5b173dbf569b service placement] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:11.483511 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7d31f-7d5f-4271-b89a-5b173dbf569b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:11.485507 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-55a7d31f-7d5f-4271-b89a-5b173dbf569b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:11.498387 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a7d31f-7d5f-4271-b89a-5b173dbf569b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:11.500035 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a7d31f-7d5f-4271-b89a-5b173dbf569b service placement] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:11.510995 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1313/2633] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:17:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:17:21.506055 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=6 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:17:36.402859 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7988773-2b1e-4c2f-96dd-bfb1ce5b6e10 service neutron] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:36.434659 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7988773-2b1e-4c2f-96dd-bfb1ce5b6e10 service neutron] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:36.439905 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22764124-200d-4e27-991f-2e764aaeb9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:36.440571 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22764124-200d-4e27-991f-2e764aaeb9c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:36.440847 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22764124-200d-4e27-991f-2e764aaeb9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:36.441117 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22764124-200d-4e27-991f-2e764aaeb9c2 admin admin] PATH_INFO: `/v3/users/fc0243ecee7a417cbaeedf634941db03` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:36.442669 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22764124-200d-4e27-991f-2e764aaeb9c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc0243ecee7a417cbaeedf634941db03)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:36.444720 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22764124-200d-4e27-991f-2e764aaeb9c2 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:36.499306 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-22764124-200d-4e27-991f-2e764aaeb9c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc0243ecee7a417cbaeedf634941db03'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:36.511869 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-22764124-200d-4e27-991f-2e764aaeb9c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc0243ecee7a417cbaeedf634941db03'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:36.521723 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-22764124-200d-4e27-991f-2e764aaeb9c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc0243ecee7a417cbaeedf634941db03'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:36.522489 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-22764124-200d-4e27-991f-2e764aaeb9c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc0243ecee7a417cbaeedf634941db03'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:36.523141 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-22764124-200d-4e27-991f-2e764aaeb9c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc0243ecee7a417cbaeedf634941db03'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:36.536331 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1321/2634] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 01:17:36 2022] DELETE /identity/v3/users/fc0243ecee7a417cbaeedf634941db03 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:17:36.730398 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a7d31f-7d5f-4271-b89a-5b173dbf569b service placement] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:36.742985 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a7d31f-7d5f-4271-b89a-5b173dbf569b service placement] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:36.808782 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c16b2-55a2-445d-bdcb-d3336e6293e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:36.809435 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c16b2-55a2-445d-bdcb-d3336e6293e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:36.809717 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c16b2-55a2-445d-bdcb-d3336e6293e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:36.810021 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c16b2-55a2-445d-bdcb-d3336e6293e9 admin admin] PATH_INFO: `/v3/projects/e39f81250cd54c2abb275abe21a30a55` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:36.811392 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250c16b2-55a2-445d-bdcb-d3336e6293e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e39f81250cd54c2abb275abe21a30a55)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:36.813375 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250c16b2-55a2-445d-bdcb-d3336e6293e9 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:36.864545 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-250c16b2-55a2-445d-bdcb-d3336e6293e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e39f81250cd54c2abb275abe21a30a55', 'request_id': 'req-250c16b2-55a2-445d-bdcb-d3336e6293e9'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:36.870722 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-250c16b2-55a2-445d-bdcb-d3336e6293e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e39f81250cd54c2abb275abe21a30a55', 'request_id': 'req-250c16b2-55a2-445d-bdcb-d3336e6293e9'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:36.878584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-250c16b2-55a2-445d-bdcb-d3336e6293e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e39f81250cd54c2abb275abe21a30a55', 'request_id': 'req-250c16b2-55a2-445d-bdcb-d3336e6293e9'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:36.901464 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-250c16b2-55a2-445d-bdcb-d3336e6293e9 admin admin] The token cache is being invalidate because project e39f81250cd54c2abb275abe21a30a55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81808) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:17:36.901751 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-250c16b2-55a2-445d-bdcb-d3336e6293e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:36.902430 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-250c16b2-55a2-445d-bdcb-d3336e6293e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:17:36.904209 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1314/2635] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 01:17:36 2022] DELETE /identity/v3/projects/e39f81250cd54c2abb275abe21a30a55 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:17:36.909428 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ec55b-0860-49af-a571-855254b19886 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:36.909711 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ec55b-0860-49af-a571-855254b19886 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:36.909978 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ec55b-0860-49af-a571-855254b19886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:36.942645 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-eb8ec55b-0860-49af-a571-855254b19886 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:17:36.944032 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-eb8ec55b-0860-49af-a571-855254b19886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:37.008063 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1322/2636] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:17:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:17:37.015829 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d70b8-0be0-4d18-9225-3dada8a22dd1 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:37.016121 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d70b8-0be0-4d18-9225-3dada8a22dd1 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:37.016396 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d70b8-0be0-4d18-9225-3dada8a22dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:37.036931 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-516d70b8-0be0-4d18-9225-3dada8a22dd1 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:17:37.038146 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-516d70b8-0be0-4d18-9225-3dada8a22dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:37.047075 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1315/2637] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:17:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:17:37.052811 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8ec55b-0860-49af-a571-855254b19886 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:37.063338 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8ec55b-0860-49af-a571-855254b19886 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:37.068814 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b0722b-fa0f-4b9e-a021-40b69de68389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:37.069458 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0722b-fa0f-4b9e-a021-40b69de68389 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:37.069729 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0722b-fa0f-4b9e-a021-40b69de68389 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:37.069995 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0722b-fa0f-4b9e-a021-40b69de68389 admin admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:37.070665 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b0722b-fa0f-4b9e-a021-40b69de68389 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:17:37.071015 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b0722b-fa0f-4b9e-a021-40b69de68389 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:37.072851 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b0722b-fa0f-4b9e-a021-40b69de68389 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:37.090109 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1323/2638] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 01:17:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:17:37.094801 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d70b8-0be0-4d18-9225-3dada8a22dd1 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:37.104267 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d70b8-0be0-4d18-9225-3dada8a22dd1 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:37.109266 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202279ac-334f-40e2-9f2f-2e464b023e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:37.109883 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202279ac-334f-40e2-9f2f-2e464b023e2a admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:37.110161 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202279ac-334f-40e2-9f2f-2e464b023e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:37.110431 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202279ac-334f-40e2-9f2f-2e464b023e2a admin admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:37.111067 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202279ac-334f-40e2-9f2f-2e464b023e2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:37.113014 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202279ac-334f-40e2-9f2f-2e464b023e2a admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:37.148942 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1316/2639] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 01:17:37 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:17:37.153960 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b0722b-fa0f-4b9e-a021-40b69de68389 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:37.164782 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b0722b-fa0f-4b9e-a021-40b69de68389 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:37.202719 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:17:37.227896 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d9d707-56e7-4c43-b8a3-19ef9fc2d51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:37.228509 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9d707-56e7-4c43-b8a3-19ef9fc2d51e admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:37.228790 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9d707-56e7-4c43-b8a3-19ef9fc2d51e admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:37.229117 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9d707-56e7-4c43-b8a3-19ef9fc2d51e admin admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:37.229721 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d9d707-56e7-4c43-b8a3-19ef9fc2d51e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:37.231656 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d9d707-56e7-4c43-b8a3-19ef9fc2d51e admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:37.254815 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1324/2640] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 01:17:37 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:17:37.258971 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202279ac-334f-40e2-9f2f-2e464b023e2a admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:37.270010 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202279ac-334f-40e2-9f2f-2e464b023e2a admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:37.275868 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847784ad-9350-4232-b9f1-36aab9c48e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:37.276478 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847784ad-9350-4232-b9f1-36aab9c48e2f admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:37.276754 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847784ad-9350-4232-b9f1-36aab9c48e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:37.277019 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847784ad-9350-4232-b9f1-36aab9c48e2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:37.277680 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847784ad-9350-4232-b9f1-36aab9c48e2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:37.279314 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847784ad-9350-4232-b9f1-36aab9c48e2f admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:37.290002 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1317/2641] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:17:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:17:37.294422 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d9d707-56e7-4c43-b8a3-19ef9fc2d51e admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:37.305133 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d9d707-56e7-4c43-b8a3-19ef9fc2d51e admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:37.309906 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6df91fc-3ce6-4532-b663-517a86b70bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:37.310505 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6df91fc-3ce6-4532-b663-517a86b70bae admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:37.310787 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6df91fc-3ce6-4532-b663-517a86b70bae admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:37.311059 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6df91fc-3ce6-4532-b663-517a86b70bae admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:37.311736 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6df91fc-3ce6-4532-b663-517a86b70bae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:37.313356 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6df91fc-3ce6-4532-b663-517a86b70bae admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:37.324037 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1325/2642] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:17:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:17:37.328566 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847784ad-9350-4232-b9f1-36aab9c48e2f admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:37.339150 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847784ad-9350-4232-b9f1-36aab9c48e2f admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:37.346097 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0157a18-484d-409a-87cb-7c382d39143b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:37.347030 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0157a18-484d-409a-87cb-7c382d39143b admin admin] REQUEST_METHOD: `PUT` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:37.347291 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0157a18-484d-409a-87cb-7c382d39143b admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:37.347579 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0157a18-484d-409a-87cb-7c382d39143b admin admin] PATH_INFO: `/v3/projects/556899da1de44ba598f6e913d05612d3/users/77556d09963d431e92d8e5c1ec73ed65/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:37.373262 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0157a18-484d-409a-87cb-7c382d39143b admin admin] RBAC: Authorizing `identity:create_grant(project_id=556899da1de44ba598f6e913d05612d3, user_id=77556d09963d431e92d8e5c1ec73ed65, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:37.377018 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0157a18-484d-409a-87cb-7c382d39143b admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:37.398097 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1318/2643] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 01:17:37 2022] PUT /identity/v3/projects/556899da1de44ba598f6e913d05612d3/users/77556d09963d431e92d8e5c1ec73ed65/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:17:37.403861 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3f2e0-29be-4803-9afe-d94238c8526e None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:37.404352 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3f2e0-29be-4803-9afe-d94238c8526e None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:37.404461 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3f2e0-29be-4803-9afe-d94238c8526e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:37.424720 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-0cc3f2e0-29be-4803-9afe-d94238c8526e None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:17:37.426013 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-0cc3f2e0-29be-4803-9afe-d94238c8526e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:37.486283 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1326/2644] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:17:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:17:37.496393 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0157a18-484d-409a-87cb-7c382d39143b admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:37.498368 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-a0157a18-484d-409a-87cb-7c382d39143b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:37.519318 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:17:37.591770 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0157a18-484d-409a-87cb-7c382d39143b admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:37.595611 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162971cf-e5e0-40b8-ad02-a6888b9159a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:37.596264 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162971cf-e5e0-40b8-ad02-a6888b9159a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:37.596538 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162971cf-e5e0-40b8-ad02-a6888b9159a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:37.596804 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162971cf-e5e0-40b8-ad02-a6888b9159a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:37.606456 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162971cf-e5e0-40b8-ad02-a6888b9159a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:37.608019 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162971cf-e5e0-40b8-ad02-a6888b9159a3 service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:37.618537 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1319/2645] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:17:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:17:42.110833 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce00f2-e9b8-4890-bb70-255a33a99113 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:42.111356 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce00f2-e9b8-4890-bb70-255a33a99113 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:42.111356 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce00f2-e9b8-4890-bb70-255a33a99113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:42.143524 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-97ce00f2-e9b8-4890-bb70-255a33a99113 None None] MFA Rules not processed for user `77556d09963d431e92d8e5c1ec73ed65`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:17:42.144749 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-97ce00f2-e9b8-4890-bb70-255a33a99113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:42.226617 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1327/2646] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:17:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:17:42.238384 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8efee6d-223c-481d-aa02-0a4b0a991b49 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:42.238849 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8efee6d-223c-481d-aa02-0a4b0a991b49 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:42.238940 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8efee6d-223c-481d-aa02-0a4b0a991b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:42.268458 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-d8efee6d-223c-481d-aa02-0a4b0a991b49 None None] MFA Rules not processed for user `77556d09963d431e92d8e5c1ec73ed65`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:17:42.269694 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-d8efee6d-223c-481d-aa02-0a4b0a991b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:42.279074 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1320/2647] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:17:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:17:42.289278 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce00f2-e9b8-4890-bb70-255a33a99113 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:17:42.290808 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-97ce00f2-e9b8-4890-bb70-255a33a99113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:17:42.355658 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:17:42.422205 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce00f2-e9b8-4890-bb70-255a33a99113 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:17:42.428540 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcf00aa-28ae-4472-9601-48065361b55f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:17:42.429224 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf00aa-28ae-4472-9601-48065361b55f service nova] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:17:42.433085 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf00aa-28ae-4472-9601-48065361b55f service nova] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:17:42.433495 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf00aa-28ae-4472-9601-48065361b55f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:17:42.443813 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcf00aa-28ae-4472-9601-48065361b55f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:17:42.445460 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcf00aa-28ae-4472-9601-48065361b55f service nova] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:17:42.456085 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1328/2648] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:17:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:17:52.261501 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=31 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:17:52.451838 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=25 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:18:30.300716 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8efee6d-223c-481d-aa02-0a4b0a991b49 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:30.302321 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-d8efee6d-223c-481d-aa02-0a4b0a991b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:30.315369 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8efee6d-223c-481d-aa02-0a4b0a991b49 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:30.319705 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e81dd7-eb3f-4a09-8150-e65a8a57c1a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:30.320356 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e81dd7-eb3f-4a09-8150-e65a8a57c1a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:30.320632 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e81dd7-eb3f-4a09-8150-e65a8a57c1a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:30.320901 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e81dd7-eb3f-4a09-8150-e65a8a57c1a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:30.322903 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-42e81dd7-eb3f-4a09-8150-e65a8a57c1a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:30.333978 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e81dd7-eb3f-4a09-8150-e65a8a57c1a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:30.335440 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e81dd7-eb3f-4a09-8150-e65a8a57c1a1 service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:30.345416 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1321/2649] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:18:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:18:34.510767 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf65539-581b-45cd-af75-ddae53fcc2e9 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:34.511349 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf65539-581b-45cd-af75-ddae53fcc2e9 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:34.511349 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf65539-581b-45cd-af75-ddae53fcc2e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:34.531302 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-aaf65539-581b-45cd-af75-ddae53fcc2e9 None None] MFA Rules not processed for user `77556d09963d431e92d8e5c1ec73ed65`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:18:34.532586 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-aaf65539-581b-45cd-af75-ddae53fcc2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:34.539992 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1329/2650] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:18:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:18:40.341052 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=6 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:18:40.998798 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e81dd7-eb3f-4a09-8150-e65a8a57c1a1 service neutron] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:41.009751 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e81dd7-eb3f-4a09-8150-e65a8a57c1a1 service neutron] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:41.014409 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce707d0-543b-48e0-9df9-1f460e94ff35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:41.015012 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce707d0-543b-48e0-9df9-1f460e94ff35 service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:41.015287 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce707d0-543b-48e0-9df9-1f460e94ff35 service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:41.015558 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce707d0-543b-48e0-9df9-1f460e94ff35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:41.017754 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-2ce707d0-543b-48e0-9df9-1f460e94ff35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:41.032535 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce707d0-543b-48e0-9df9-1f460e94ff35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:41.033970 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce707d0-543b-48e0-9df9-1f460e94ff35 service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:41.045171 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1322/2651] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:18:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:18:42.258434 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf65539-581b-45cd-af75-ddae53fcc2e9 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:18:42.269433 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf65539-581b-45cd-af75-ddae53fcc2e9 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:18:42.274145 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fa98ca-a656-4026-87e4-a841742b337c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:18:42.274437 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa98ca-a656-4026-87e4-a841742b337c service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:18:42.274716 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa98ca-a656-4026-87e4-a841742b337c service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:18:42.275083 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fa98ca-a656-4026-87e4-a841742b337c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:18:42.277462 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-81fa98ca-a656-4026-87e4-a841742b337c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:18:42.293882 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fa98ca-a656-4026-87e4-a841742b337c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:18:42.295456 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fa98ca-a656-4026-87e4-a841742b337c service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:18:42.307442 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1330/2652] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:18:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:18:51.040247 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=6 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:18:52.302292 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=9 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:19:29.504010 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce707d0-543b-48e0-9df9-1f460e94ff35 service neutron] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:19:29.517697 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce707d0-543b-48e0-9df9-1f460e94ff35 service neutron] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:19:29.525230 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f261c-4412-4eef-acef-a942cd57baa4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:19:29.525923 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f261c-4412-4eef-acef-a942cd57baa4 service nova] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:19:29.526203 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f261c-4412-4eef-acef-a942cd57baa4 service nova] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:19:29.526475 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f261c-4412-4eef-acef-a942cd57baa4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:19:29.528425 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-e80f261c-4412-4eef-acef-a942cd57baa4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:19:29.543811 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80f261c-4412-4eef-acef-a942cd57baa4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:19:29.545562 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80f261c-4412-4eef-acef-a942cd57baa4 service nova] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:19:29.570103 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1323/2653] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:19:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:19:34.856553 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fa98ca-a656-4026-87e4-a841742b337c service neutron] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:19:34.869716 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fa98ca-a656-4026-87e4-a841742b337c service neutron] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:19:34.875092 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d956b4f-f56a-4213-858b-11c77ad1355d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:19:34.875764 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d956b4f-f56a-4213-858b-11c77ad1355d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:19:34.876049 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d956b4f-f56a-4213-858b-11c77ad1355d admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:19:34.876320 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d956b4f-f56a-4213-858b-11c77ad1355d admin admin] PATH_INFO: `/v3/users/77556d09963d431e92d8e5c1ec73ed65` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:19:34.877554 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d956b4f-f56a-4213-858b-11c77ad1355d admin admin] RBAC: Authorizing `identity:delete_user(user_id=77556d09963d431e92d8e5c1ec73ed65)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:19:34.879501 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d956b4f-f56a-4213-858b-11c77ad1355d admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:19:34.931593 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-4d956b4f-f56a-4213-858b-11c77ad1355d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77556d09963d431e92d8e5c1ec73ed65'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:19:34.945350 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-4d956b4f-f56a-4213-858b-11c77ad1355d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77556d09963d431e92d8e5c1ec73ed65'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:19:34.955046 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-4d956b4f-f56a-4213-858b-11c77ad1355d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77556d09963d431e92d8e5c1ec73ed65'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:19:34.955775 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-4d956b4f-f56a-4213-858b-11c77ad1355d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77556d09963d431e92d8e5c1ec73ed65'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:19:34.956573 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-4d956b4f-f56a-4213-858b-11c77ad1355d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77556d09963d431e92d8e5c1ec73ed65'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:19:34.969808 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1331/2654] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 01:19:34 2022] DELETE /identity/v3/users/77556d09963d431e92d8e5c1ec73ed65 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:19:35.157682 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f261c-4412-4eef-acef-a942cd57baa4 service nova] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:19:35.174356 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f261c-4412-4eef-acef-a942cd57baa4 service nova] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:19:35.232266 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73e0e4-0e0f-4c25-bb2c-b99051dc1ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:19:35.232958 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73e0e4-0e0f-4c25-bb2c-b99051dc1ed5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:19:35.233237 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73e0e4-0e0f-4c25-bb2c-b99051dc1ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:19:35.233507 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73e0e4-0e0f-4c25-bb2c-b99051dc1ed5 admin admin] PATH_INFO: `/v3/projects/556899da1de44ba598f6e913d05612d3` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:19:35.234799 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f73e0e4-0e0f-4c25-bb2c-b99051dc1ed5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=556899da1de44ba598f6e913d05612d3)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:19:35.236794 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f73e0e4-0e0f-4c25-bb2c-b99051dc1ed5 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:19:35.290507 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-2f73e0e4-0e0f-4c25-bb2c-b99051dc1ed5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '556899da1de44ba598f6e913d05612d3', 'request_id': 'req-2f73e0e4-0e0f-4c25-bb2c-b99051dc1ed5'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:19:35.297410 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-2f73e0e4-0e0f-4c25-bb2c-b99051dc1ed5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '556899da1de44ba598f6e913d05612d3', 'request_id': 'req-2f73e0e4-0e0f-4c25-bb2c-b99051dc1ed5'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:19:35.308690 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-2f73e0e4-0e0f-4c25-bb2c-b99051dc1ed5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '556899da1de44ba598f6e913d05612d3', 'request_id': 'req-2f73e0e4-0e0f-4c25-bb2c-b99051dc1ed5'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:19:35.321509 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-2f73e0e4-0e0f-4c25-bb2c-b99051dc1ed5 admin admin] The token cache is being invalidate because project 556899da1de44ba598f6e913d05612d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81808) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:19:35.321787 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-2f73e0e4-0e0f-4c25-bb2c-b99051dc1ed5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:19:35.322509 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-2f73e0e4-0e0f-4c25-bb2c-b99051dc1ed5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:19:35.324114 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1324/2655] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 01:19:35 2022] DELETE /identity/v3/projects/556899da1de44ba598f6e913d05612d3 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:19:35.329909 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1119d-17f3-4e7a-a514-c0328983c3c9 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:19:35.330199 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1119d-17f3-4e7a-a514-c0328983c3c9 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:19:35.330474 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1119d-17f3-4e7a-a514-c0328983c3c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:19:35.361990 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-f1e1119d-17f3-4e7a-a514-c0328983c3c9 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:19:35.363231 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-f1e1119d-17f3-4e7a-a514-c0328983c3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:19:35.428089 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1332/2656] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:19:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:19:35.436597 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1eecf-259b-4771-9c6d-491d64a9b286 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:19:35.436876 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1eecf-259b-4771-9c6d-491d64a9b286 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:19:35.437158 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1eecf-259b-4771-9c6d-491d64a9b286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:19:35.458279 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-1ea1eecf-259b-4771-9c6d-491d64a9b286 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:19:35.459483 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-1ea1eecf-259b-4771-9c6d-491d64a9b286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:19:35.468206 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1325/2657] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:19:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:19:35.473046 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e1119d-17f3-4e7a-a514-c0328983c3c9 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:19:35.483348 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e1119d-17f3-4e7a-a514-c0328983c3c9 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:19:35.488169 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aeb116-be82-447a-93c6-3a4b443a69b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:19:35.488787 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aeb116-be82-447a-93c6-3a4b443a69b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:19:35.489051 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aeb116-be82-447a-93c6-3a4b443a69b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:19:35.489326 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aeb116-be82-447a-93c6-3a4b443a69b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:19:35.489985 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aeb116-be82-447a-93c6-3a4b443a69b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:19:35.490284 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aeb116-be82-447a-93c6-3a4b443a69b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:19:35.491934 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aeb116-be82-447a-93c6-3a4b443a69b8 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:19:35.504483 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1333/2658] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 01:19:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:19:35.509458 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea1eecf-259b-4771-9c6d-491d64a9b286 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:19:35.520563 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea1eecf-259b-4771-9c6d-491d64a9b286 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:19:35.526058 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029c1358-9e91-4904-a5e6-464d4581c61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:19:35.526674 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c1358-9e91-4904-a5e6-464d4581c61f admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:19:35.526950 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c1358-9e91-4904-a5e6-464d4581c61f admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:19:35.527214 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c1358-9e91-4904-a5e6-464d4581c61f admin admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:19:35.527884 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029c1358-9e91-4904-a5e6-464d4581c61f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:19:35.529820 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029c1358-9e91-4904-a5e6-464d4581c61f admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:19:35.561218 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1326/2659] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 01:19:35 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:19:35.566666 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aeb116-be82-447a-93c6-3a4b443a69b8 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:19:35.579581 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aeb116-be82-447a-93c6-3a4b443a69b8 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:19:35.634202 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:19:35.650038 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd640cbd-12d7-45d8-ab80-6286f34f3768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:19:35.651122 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd640cbd-12d7-45d8-ab80-6286f34f3768 admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:19:35.651933 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd640cbd-12d7-45d8-ab80-6286f34f3768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:19:35.652620 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd640cbd-12d7-45d8-ab80-6286f34f3768 admin admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:19:35.653644 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd640cbd-12d7-45d8-ab80-6286f34f3768 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:19:35.656350 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd640cbd-12d7-45d8-ab80-6286f34f3768 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:19:35.684758 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1334/2660] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 01:19:35 2022] POST /identity/v3/users => generated 289 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:19:35.689206 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029c1358-9e91-4904-a5e6-464d4581c61f admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:19:35.700284 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029c1358-9e91-4904-a5e6-464d4581c61f admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:19:35.705022 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc657757-b647-4771-ae56-4adff5550766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:19:35.705625 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc657757-b647-4771-ae56-4adff5550766 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:19:35.705905 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc657757-b647-4771-ae56-4adff5550766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:19:35.706179 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc657757-b647-4771-ae56-4adff5550766 admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:19:35.706828 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc657757-b647-4771-ae56-4adff5550766 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:19:35.708459 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc657757-b647-4771-ae56-4adff5550766 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:19:35.718824 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1327/2661] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:19:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:19:35.722999 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd640cbd-12d7-45d8-ab80-6286f34f3768 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:19:35.733841 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd640cbd-12d7-45d8-ab80-6286f34f3768 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:19:35.739812 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c0a498-4fd1-45fc-a5cd-d53ab61de67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:19:35.740427 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0a498-4fd1-45fc-a5cd-d53ab61de67e admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:19:35.740705 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0a498-4fd1-45fc-a5cd-d53ab61de67e admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:19:35.740970 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0a498-4fd1-45fc-a5cd-d53ab61de67e admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:19:35.741627 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c0a498-4fd1-45fc-a5cd-d53ab61de67e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:19:35.743307 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c0a498-4fd1-45fc-a5cd-d53ab61de67e admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:19:35.754388 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1335/2662] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:19:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:19:35.758770 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc657757-b647-4771-ae56-4adff5550766 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:19:35.768815 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc657757-b647-4771-ae56-4adff5550766 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:19:35.773625 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f76cef-ae40-4fb9-bb7b-400762dea5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:19:35.774271 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f76cef-ae40-4fb9-bb7b-400762dea5b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:19:35.774544 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f76cef-ae40-4fb9-bb7b-400762dea5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:19:35.774811 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f76cef-ae40-4fb9-bb7b-400762dea5b3 admin admin] PATH_INFO: `/v3/projects/4e972ed035f9493dbd0d1d53fd0ccc50/users/8b88a087f3d24635b2c43c456537d0aa/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:19:35.790558 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f76cef-ae40-4fb9-bb7b-400762dea5b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e972ed035f9493dbd0d1d53fd0ccc50, user_id=8b88a087f3d24635b2c43c456537d0aa, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:19:35.793229 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f76cef-ae40-4fb9-bb7b-400762dea5b3 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:19:35.811273 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1328/2663] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 01:19:35 2022] PUT /identity/v3/projects/4e972ed035f9493dbd0d1d53fd0ccc50/users/8b88a087f3d24635b2c43c456537d0aa/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:19:35.817028 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf77bf9-bed0-4638-a646-ad11f0186bf1 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:19:35.817314 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf77bf9-bed0-4638-a646-ad11f0186bf1 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:19:35.817611 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf77bf9-bed0-4638-a646-ad11f0186bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:19:35.837243 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-aaf77bf9-bed0-4638-a646-ad11f0186bf1 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:19:35.838464 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-aaf77bf9-bed0-4638-a646-ad11f0186bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:19:35.899692 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1336/2664] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:19:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:19:35.912998 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f76cef-ae40-4fb9-bb7b-400762dea5b3 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:19:35.914973 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-94f76cef-ae40-4fb9-bb7b-400762dea5b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:19:35.930334 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:19:35.976522 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f76cef-ae40-4fb9-bb7b-400762dea5b3 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:19:35.980220 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc816e5-6adb-4ef1-b5c0-9442cbc9d5ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:19:35.980840 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc816e5-6adb-4ef1-b5c0-9442cbc9d5ea service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:19:35.981166 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc816e5-6adb-4ef1-b5c0-9442cbc9d5ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:19:35.981427 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc816e5-6adb-4ef1-b5c0-9442cbc9d5ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:19:35.991164 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc816e5-6adb-4ef1-b5c0-9442cbc9d5ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:19:35.992635 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc816e5-6adb-4ef1-b5c0-9442cbc9d5ea service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:19:36.002365 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1329/2665] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:19:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:19:40.271110 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bfa42f-3091-47f6-b771-4eb2ee5bd760 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:19:40.272088 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bfa42f-3091-47f6-b771-4eb2ee5bd760 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:19:40.272452 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bfa42f-3091-47f6-b771-4eb2ee5bd760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:19:40.322898 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-b6bfa42f-3091-47f6-b771-4eb2ee5bd760 None None] MFA Rules not processed for user `8b88a087f3d24635b2c43c456537d0aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:19:40.324216 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-b6bfa42f-3091-47f6-b771-4eb2ee5bd760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:19:40.436256 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1337/2666] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:19:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:19:40.448280 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc816e5-6adb-4ef1-b5c0-9442cbc9d5ea service neutron] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:19:40.449987 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-dfc816e5-6adb-4ef1-b5c0-9442cbc9d5ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:19:40.583204 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc816e5-6adb-4ef1-b5c0-9442cbc9d5ea service neutron] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:19:40.590914 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cc804b-3ef9-404f-802e-a68301097fd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:19:40.591713 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc804b-3ef9-404f-802e-a68301097fd1 service nova] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:19:40.592064 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc804b-3ef9-404f-802e-a68301097fd1 service nova] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:19:40.592402 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc804b-3ef9-404f-802e-a68301097fd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:19:40.603255 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cc804b-3ef9-404f-802e-a68301097fd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:19:40.604844 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cc804b-3ef9-404f-802e-a68301097fd1 service nova] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:19:40.615366 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1330/2667] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:19:40 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:19:42.062982 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6adb16d-b015-4624-ace4-0d701e4d2fe6 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:19:42.063453 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6adb16d-b015-4624-ace4-0d701e4d2fe6 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:19:42.063544 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6adb16d-b015-4624-ace4-0d701e4d2fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:19:42.084129 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-c6adb16d-b015-4624-ace4-0d701e4d2fe6 None None] MFA Rules not processed for user `8b88a087f3d24635b2c43c456537d0aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:19:42.085376 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-c6adb16d-b015-4624-ace4-0d701e4d2fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:19:42.092751 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1338/2668] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:19:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:19:50.614113 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=54 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:19:52.079526 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=73,keystone:INSERT=3 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:20:28.843840 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cc804b-3ef9-404f-802e-a68301097fd1 service nova] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:28.845394 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-f3cc804b-3ef9-404f-802e-a68301097fd1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:28.914141 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cc804b-3ef9-404f-802e-a68301097fd1 service nova] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:28.919860 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f38a4c-4d8e-4366-b3c1-bf9df7263818 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4fc1d11f5641b0b5f301b234282aa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:28.920471 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f38a4c-4d8e-4366-b3c1-bf9df7263818 service placement] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:28.920748 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f38a4c-4d8e-4366-b3c1-bf9df7263818 service placement] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:28.921007 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f38a4c-4d8e-4366-b3c1-bf9df7263818 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:28.923179 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-b1f38a4c-4d8e-4366-b3c1-bf9df7263818 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:28.935061 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f38a4c-4d8e-4366-b3c1-bf9df7263818 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:28.936670 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f38a4c-4d8e-4366-b3c1-bf9df7263818 service placement] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:28.946914 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1331/2669] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:20:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:20:38.942843 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=32 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:20:50.801372 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6adb16d-b015-4624-ace4-0d701e4d2fe6 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:50.815863 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6adb16d-b015-4624-ace4-0d701e4d2fe6 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:50.822690 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d50925-76d2-4126-8f5b-41a95d033035 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:50.823237 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d50925-76d2-4126-8f5b-41a95d033035 service nova] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:50.823535 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d50925-76d2-4126-8f5b-41a95d033035 service nova] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:50.823850 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d50925-76d2-4126-8f5b-41a95d033035 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:50.825812 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-17d50925-76d2-4126-8f5b-41a95d033035 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:50.839575 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d50925-76d2-4126-8f5b-41a95d033035 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:50.841236 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d50925-76d2-4126-8f5b-41a95d033035 service nova] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:50.852339 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1339/2670] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:20:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:20:58.214838 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d32cc0-5fc0-4323-be95-74ef92fce50c None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:58.215606 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d32cc0-5fc0-4323-be95-74ef92fce50c None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:58.215606 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d32cc0-5fc0-4323-be95-74ef92fce50c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:58.236079 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-b1d32cc0-5fc0-4323-be95-74ef92fce50c None None] MFA Rules not processed for user `8b88a087f3d24635b2c43c456537d0aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:20:58.237344 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-b1d32cc0-5fc0-4323-be95-74ef92fce50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:58.247424 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1332/2671] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:20:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:20:58.608324 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d50925-76d2-4126-8f5b-41a95d033035 service nova] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:20:58.609901 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-17d50925-76d2-4126-8f5b-41a95d033035 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:58.621551 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d50925-76d2-4126-8f5b-41a95d033035 service nova] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:20:58.625766 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ef9b1-31e2-4c03-b6d2-5f6c5a2da142 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:20:58.626404 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ef9b1-31e2-4c03-b6d2-5f6c5a2da142 service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:20:58.626674 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ef9b1-31e2-4c03-b6d2-5f6c5a2da142 service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:20:58.626941 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ef9b1-31e2-4c03-b6d2-5f6c5a2da142 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:20:58.629013 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-421ef9b1-31e2-4c03-b6d2-5f6c5a2da142 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:20:58.639542 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421ef9b1-31e2-4c03-b6d2-5f6c5a2da142 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:20:58.641038 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421ef9b1-31e2-4c03-b6d2-5f6c5a2da142 service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:20:58.649382 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1340/2672] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:20:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:21:08.230384 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=3 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:21:08.645556 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=12 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:22:10.315045 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46caa0b9-06c5-4a7e-a9ac-fefac7229bfb None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:10.315624 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46caa0b9-06c5-4a7e-a9ac-fefac7229bfb None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:10.315624 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46caa0b9-06c5-4a7e-a9ac-fefac7229bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:10.336140 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-46caa0b9-06c5-4a7e-a9ac-fefac7229bfb None None] MFA Rules not processed for user `8b88a087f3d24635b2c43c456537d0aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:22:10.337370 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-46caa0b9-06c5-4a7e-a9ac-fefac7229bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:22:10.345320 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1333/2673] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:22:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:22:11.527765 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ef9b1-31e2-4c03-b6d2-5f6c5a2da142 service neutron] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:22:11.540447 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ef9b1-31e2-4c03-b6d2-5f6c5a2da142 service neutron] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:22:11.546321 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20743d1d-b8e7-4bf7-aab9-2ed478d40124 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4fc1d11f5641b0b5f301b234282aa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:22:11.546927 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20743d1d-b8e7-4bf7-aab9-2ed478d40124 service placement] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:11.547202 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20743d1d-b8e7-4bf7-aab9-2ed478d40124 service placement] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:11.547473 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20743d1d-b8e7-4bf7-aab9-2ed478d40124 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:11.549305 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-20743d1d-b8e7-4bf7-aab9-2ed478d40124 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:22:11.561031 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20743d1d-b8e7-4bf7-aab9-2ed478d40124 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:22:11.562625 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20743d1d-b8e7-4bf7-aab9-2ed478d40124 service placement] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:22:11.573279 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1341/2674] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:22:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:22:20.330902 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=3 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:22:21.568919 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=6 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:22:22.053935 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46caa0b9-06c5-4a7e-a9ac-fefac7229bfb None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:22:22.059025 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-46caa0b9-06c5-4a7e-a9ac-fefac7229bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:22:22.075911 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46caa0b9-06c5-4a7e-a9ac-fefac7229bfb None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:22:22.083906 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b132c5-fd90-4694-95e7-83f1002779e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:22:22.084532 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b132c5-fd90-4694-95e7-83f1002779e2 service nova] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:22.084804 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b132c5-fd90-4694-95e7-83f1002779e2 service nova] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:22.085190 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b132c5-fd90-4694-95e7-83f1002779e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:22.086986 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-86b132c5-fd90-4694-95e7-83f1002779e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:22:22.106965 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b132c5-fd90-4694-95e7-83f1002779e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:22:22.108938 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b132c5-fd90-4694-95e7-83f1002779e2 service nova] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:22:22.120556 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1334/2675] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:22:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:22:32.115789 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=6 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:22:55.144675 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20743d1d-b8e7-4bf7-aab9-2ed478d40124 service placement] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:22:55.154944 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20743d1d-b8e7-4bf7-aab9-2ed478d40124 service placement] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:22:55.159004 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4cf47-bebb-4f84-8144-e72045b21910 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:22:55.159641 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4cf47-bebb-4f84-8144-e72045b21910 service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:55.159955 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4cf47-bebb-4f84-8144-e72045b21910 service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:55.160226 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a4cf47-bebb-4f84-8144-e72045b21910 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:55.162527 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-22a4cf47-bebb-4f84-8144-e72045b21910 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:22:55.174906 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a4cf47-bebb-4f84-8144-e72045b21910 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:22:55.177836 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a4cf47-bebb-4f84-8144-e72045b21910 service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:22:55.194319 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1342/2676] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:22:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:22:55.296735 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b132c5-fd90-4694-95e7-83f1002779e2 service nova] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:22:55.308800 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b132c5-fd90-4694-95e7-83f1002779e2 service nova] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:22:55.314912 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51f9c28-946e-4ce3-bfbe-659c19492912 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4fc1d11f5641b0b5f301b234282aa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:22:55.315513 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f9c28-946e-4ce3-bfbe-659c19492912 service placement] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:55.315831 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f9c28-946e-4ce3-bfbe-659c19492912 service placement] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:55.316100 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f9c28-946e-4ce3-bfbe-659c19492912 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:55.317828 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-f51f9c28-946e-4ce3-bfbe-659c19492912 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:22:55.329750 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51f9c28-946e-4ce3-bfbe-659c19492912 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:22:55.331291 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51f9c28-946e-4ce3-bfbe-659c19492912 service placement] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:22:55.341747 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1335/2677] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:22:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:22:55.545581 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4cf47-bebb-4f84-8144-e72045b21910 service neutron] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:22:55.554782 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a4cf47-bebb-4f84-8144-e72045b21910 service neutron] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:22:55.558795 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d8aac-5da6-4277-a29c-5fa14eb30536 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:22:55.559402 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d8aac-5da6-4277-a29c-5fa14eb30536 service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:22:55.559690 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d8aac-5da6-4277-a29c-5fa14eb30536 service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:22:55.559985 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d8aac-5da6-4277-a29c-5fa14eb30536 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:22:55.562163 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-0b9d8aac-5da6-4277-a29c-5fa14eb30536 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:22:55.577485 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9d8aac-5da6-4277-a29c-5fa14eb30536 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:22:55.579344 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9d8aac-5da6-4277-a29c-5fa14eb30536 service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:22:55.591326 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1343/2678] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:22:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:23:05.337216 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=6 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:23:05.586327 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=12 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:23:30.981199 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8edef-7af5-4ef5-b701-f2d7e6ee2c3e None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:30.981732 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8edef-7af5-4ef5-b701-f2d7e6ee2c3e None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:30.981732 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8edef-7af5-4ef5-b701-f2d7e6ee2c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:31.001746 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-dbc8edef-7af5-4ef5-b701-f2d7e6ee2c3e None None] MFA Rules not processed for user `8b88a087f3d24635b2c43c456537d0aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:23:31.002997 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-dbc8edef-7af5-4ef5-b701-f2d7e6ee2c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:31.010723 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1336/2679] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:23:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:23:33.709117 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d8aac-5da6-4277-a29c-5fa14eb30536 service neutron] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:33.722116 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d8aac-5da6-4277-a29c-5fa14eb30536 service neutron] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:33.725528 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17c8dd5-9d41-48ec-9085-fff9be66d63a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:33.726220 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c8dd5-9d41-48ec-9085-fff9be66d63a service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:33.726504 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c8dd5-9d41-48ec-9085-fff9be66d63a service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:33.726825 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c8dd5-9d41-48ec-9085-fff9be66d63a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:33.728964 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-d17c8dd5-9d41-48ec-9085-fff9be66d63a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:33.740451 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17c8dd5-9d41-48ec-9085-fff9be66d63a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:33.741932 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17c8dd5-9d41-48ec-9085-fff9be66d63a service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:33.751404 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1344/2680] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:23:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:23:40.996968 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=3 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:23:41.090804 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc8edef-7af5-4ef5-b701-f2d7e6ee2c3e None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:23:41.102013 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc8edef-7af5-4ef5-b701-f2d7e6ee2c3e None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:23:41.107518 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed1f917-41ff-4d3c-87c9-8e32f2ef7e64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:23:41.108188 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed1f917-41ff-4d3c-87c9-8e32f2ef7e64 service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:23:41.108431 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed1f917-41ff-4d3c-87c9-8e32f2ef7e64 service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:23:41.108734 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed1f917-41ff-4d3c-87c9-8e32f2ef7e64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:23:41.110897 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-6ed1f917-41ff-4d3c-87c9-8e32f2ef7e64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:23:41.126922 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed1f917-41ff-4d3c-87c9-8e32f2ef7e64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:23:41.128433 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed1f917-41ff-4d3c-87c9-8e32f2ef7e64 service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:23:41.141430 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1337/2681] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:23:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:23:43.747750 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=6 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:23:51.135835 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=6 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:24:17.096933 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17c8dd5-9d41-48ec-9085-fff9be66d63a service neutron] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:17.108840 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17c8dd5-9d41-48ec-9085-fff9be66d63a service neutron] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:17.113426 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f59833-d50d-4052-a4d3-a5de145d633e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:17.114099 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f59833-d50d-4052-a4d3-a5de145d633e service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:17.114380 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f59833-d50d-4052-a4d3-a5de145d633e service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:17.114645 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f59833-d50d-4052-a4d3-a5de145d633e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:17.116665 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-a9f59833-d50d-4052-a4d3-a5de145d633e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:24:17.136013 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f59833-d50d-4052-a4d3-a5de145d633e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:17.137474 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f59833-d50d-4052-a4d3-a5de145d633e service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:17.149434 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1345/2682] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:24:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:24:27.144037 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=6 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:24:40.339798 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed1f917-41ff-4d3c-87c9-8e32f2ef7e64 service neutron] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:24:40.357230 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed1f917-41ff-4d3c-87c9-8e32f2ef7e64 service neutron] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:24:40.364132 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f8a03-556d-4c55-a543-d0b43eb62f15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:24:40.364750 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f8a03-556d-4c55-a543-d0b43eb62f15 service nova] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:24:40.365030 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f8a03-556d-4c55-a543-d0b43eb62f15 service nova] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:24:40.365301 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f8a03-556d-4c55-a543-d0b43eb62f15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:24:40.373446 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0f8a03-556d-4c55-a543-d0b43eb62f15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:24:40.375031 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0f8a03-556d-4c55-a543-d0b43eb62f15 service nova] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:24:40.384416 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1338/2683] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:24:40 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:24:50.380113 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=6 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:25:28.155951 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f59833-d50d-4052-a4d3-a5de145d633e service neutron] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:28.167816 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f59833-d50d-4052-a4d3-a5de145d633e service neutron] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:28.174362 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb946281-847a-4153-ba07-1a7107d8a539 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:28.175016 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb946281-847a-4153-ba07-1a7107d8a539 service nova] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:28.175166 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb946281-847a-4153-ba07-1a7107d8a539 service nova] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:28.175435 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb946281-847a-4153-ba07-1a7107d8a539 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:28.177276 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-fb946281-847a-4153-ba07-1a7107d8a539 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:28.192008 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb946281-847a-4153-ba07-1a7107d8a539 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:28.193616 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb946281-847a-4153-ba07-1a7107d8a539 service nova] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:28.207719 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1346/2684] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:25:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:25:37.970740 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f8a03-556d-4c55-a543-d0b43eb62f15 service nova] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:37.981118 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f8a03-556d-4c55-a543-d0b43eb62f15 service nova] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:37.985115 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47804a5e-5f1c-4447-941d-84b00ee9d477 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:37.985672 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47804a5e-5f1c-4447-941d-84b00ee9d477 service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:37.985951 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47804a5e-5f1c-4447-941d-84b00ee9d477 service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:37.986223 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47804a5e-5f1c-4447-941d-84b00ee9d477 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:37.996568 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47804a5e-5f1c-4447-941d-84b00ee9d477 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:37.997915 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47804a5e-5f1c-4447-941d-84b00ee9d477 service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:38.010429 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1339/2685] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:25:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:25:38.200131 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=6 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:25:41.333060 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb946281-847a-4153-ba07-1a7107d8a539 service nova] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:41.334733 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-fb946281-847a-4153-ba07-1a7107d8a539 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:41.349673 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb946281-847a-4153-ba07-1a7107d8a539 service nova] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:41.356017 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303eaf10-0dda-42d2-86e3-61ce499546e7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4fc1d11f5641b0b5f301b234282aa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:41.356584 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303eaf10-0dda-42d2-86e3-61ce499546e7 service placement] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:41.356857 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303eaf10-0dda-42d2-86e3-61ce499546e7 service placement] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:41.357119 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303eaf10-0dda-42d2-86e3-61ce499546e7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:41.359574 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-303eaf10-0dda-42d2-86e3-61ce499546e7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:41.372223 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303eaf10-0dda-42d2-86e3-61ce499546e7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:41.373841 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303eaf10-0dda-42d2-86e3-61ce499546e7 service placement] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:41.387226 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1347/2686] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:25:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:25:41.402757 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47804a5e-5f1c-4447-941d-84b00ee9d477 service neutron] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:41.413570 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47804a5e-5f1c-4447-941d-84b00ee9d477 service neutron] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:41.419199 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf849ca-b05a-46a8-9cca-6edaabc9118d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:41.419904 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf849ca-b05a-46a8-9cca-6edaabc9118d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:41.420181 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf849ca-b05a-46a8-9cca-6edaabc9118d admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:41.420453 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf849ca-b05a-46a8-9cca-6edaabc9118d admin admin] PATH_INFO: `/v3/users/8b88a087f3d24635b2c43c456537d0aa` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:41.422008 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf849ca-b05a-46a8-9cca-6edaabc9118d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b88a087f3d24635b2c43c456537d0aa)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:41.423564 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf849ca-b05a-46a8-9cca-6edaabc9118d admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:41.473146 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-caf849ca-b05a-46a8-9cca-6edaabc9118d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b88a087f3d24635b2c43c456537d0aa'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:41.482469 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-caf849ca-b05a-46a8-9cca-6edaabc9118d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b88a087f3d24635b2c43c456537d0aa'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:41.494764 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-caf849ca-b05a-46a8-9cca-6edaabc9118d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b88a087f3d24635b2c43c456537d0aa'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:41.495266 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-caf849ca-b05a-46a8-9cca-6edaabc9118d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b88a087f3d24635b2c43c456537d0aa'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:41.495992 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-caf849ca-b05a-46a8-9cca-6edaabc9118d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b88a087f3d24635b2c43c456537d0aa'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:41.508603 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1340/2687] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 01:25:41 2022] DELETE /identity/v3/users/8b88a087f3d24635b2c43c456537d0aa => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:25:41.693915 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303eaf10-0dda-42d2-86e3-61ce499546e7 service placement] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:41.704915 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303eaf10-0dda-42d2-86e3-61ce499546e7 service placement] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:41.765072 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1776b52-86e1-4083-bfe6-d5ae08b9aeac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:41.765614 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1776b52-86e1-4083-bfe6-d5ae08b9aeac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:41.765888 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1776b52-86e1-4083-bfe6-d5ae08b9aeac admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:41.766158 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1776b52-86e1-4083-bfe6-d5ae08b9aeac admin admin] PATH_INFO: `/v3/projects/4e972ed035f9493dbd0d1d53fd0ccc50` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:41.767265 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1776b52-86e1-4083-bfe6-d5ae08b9aeac admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e972ed035f9493dbd0d1d53fd0ccc50)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:41.769206 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1776b52-86e1-4083-bfe6-d5ae08b9aeac admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:41.817392 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-b1776b52-86e1-4083-bfe6-d5ae08b9aeac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e972ed035f9493dbd0d1d53fd0ccc50', 'request_id': 'req-b1776b52-86e1-4083-bfe6-d5ae08b9aeac'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:41.824000 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-b1776b52-86e1-4083-bfe6-d5ae08b9aeac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e972ed035f9493dbd0d1d53fd0ccc50', 'request_id': 'req-b1776b52-86e1-4083-bfe6-d5ae08b9aeac'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:41.833940 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-b1776b52-86e1-4083-bfe6-d5ae08b9aeac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e972ed035f9493dbd0d1d53fd0ccc50', 'request_id': 'req-b1776b52-86e1-4083-bfe6-d5ae08b9aeac'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:41.844739 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-b1776b52-86e1-4083-bfe6-d5ae08b9aeac admin admin] The token cache is being invalidate because project 4e972ed035f9493dbd0d1d53fd0ccc50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81807) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:25:41.845027 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-b1776b52-86e1-4083-bfe6-d5ae08b9aeac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:41.845651 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-b1776b52-86e1-4083-bfe6-d5ae08b9aeac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:25:41.847135 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1348/2688] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 01:25:41 2022] DELETE /identity/v3/projects/4e972ed035f9493dbd0d1d53fd0ccc50 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:25:41.852452 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9a9ba-0be3-4423-a245-7fdb86729ac5 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:41.852742 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9a9ba-0be3-4423-a245-7fdb86729ac5 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:41.853016 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9a9ba-0be3-4423-a245-7fdb86729ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:41.874099 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-73d9a9ba-0be3-4423-a245-7fdb86729ac5 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:25:41.875322 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-73d9a9ba-0be3-4423-a245-7fdb86729ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:41.950382 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1341/2689] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:25:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:25:41.958431 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa52d4-fa48-4fb2-8df5-b1b1e9c19cc2 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:41.958708 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa52d4-fa48-4fb2-8df5-b1b1e9c19cc2 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:41.958994 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa52d4-fa48-4fb2-8df5-b1b1e9c19cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:41.980399 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-2afa52d4-fa48-4fb2-8df5-b1b1e9c19cc2 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:25:41.981593 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-2afa52d4-fa48-4fb2-8df5-b1b1e9c19cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:41.989974 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1349/2690] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:25:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:25:41.994987 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d9a9ba-0be3-4423-a245-7fdb86729ac5 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:42.010061 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d9a9ba-0be3-4423-a245-7fdb86729ac5 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:42.014972 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149cf018-40ce-4b78-beaa-21b0dd98946d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:42.015642 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149cf018-40ce-4b78-beaa-21b0dd98946d admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:42.015863 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149cf018-40ce-4b78-beaa-21b0dd98946d admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:42.016159 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149cf018-40ce-4b78-beaa-21b0dd98946d admin admin] PATH_INFO: `/v3/domains` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:42.016820 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149cf018-40ce-4b78-beaa-21b0dd98946d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:25:42.017125 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149cf018-40ce-4b78-beaa-21b0dd98946d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:42.018728 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149cf018-40ce-4b78-beaa-21b0dd98946d admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:42.030256 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1342/2691] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 01:25:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:25:42.034905 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afa52d4-fa48-4fb2-8df5-b1b1e9c19cc2 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:42.044921 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afa52d4-fa48-4fb2-8df5-b1b1e9c19cc2 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:42.050723 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacefd4a-7369-40e7-82bf-18d05f3b396b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:42.051314 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacefd4a-7369-40e7-82bf-18d05f3b396b admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:42.051586 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacefd4a-7369-40e7-82bf-18d05f3b396b admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:42.051877 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacefd4a-7369-40e7-82bf-18d05f3b396b admin admin] PATH_INFO: `/v3/projects` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:42.052505 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacefd4a-7369-40e7-82bf-18d05f3b396b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:42.054419 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacefd4a-7369-40e7-82bf-18d05f3b396b admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:42.087995 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1350/2692] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 01:25:42 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:25:42.092582 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149cf018-40ce-4b78-beaa-21b0dd98946d admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:42.102912 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149cf018-40ce-4b78-beaa-21b0dd98946d admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:42.155258 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:25:42.171718 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6718f4a1-1611-4a26-966a-9b924681ce05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:42.172351 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6718f4a1-1611-4a26-966a-9b924681ce05 admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:42.172633 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6718f4a1-1611-4a26-966a-9b924681ce05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:42.172905 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6718f4a1-1611-4a26-966a-9b924681ce05 admin admin] PATH_INFO: `/v3/users` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:42.173947 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6718f4a1-1611-4a26-966a-9b924681ce05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:42.176421 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6718f4a1-1611-4a26-966a-9b924681ce05 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:42.214727 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1343/2693] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 01:25:42 2022] POST /identity/v3/users => generated 292 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:25:42.216065 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacefd4a-7369-40e7-82bf-18d05f3b396b admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:42.226971 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacefd4a-7369-40e7-82bf-18d05f3b396b admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:42.232177 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c0796-ec1f-44e6-9e4e-71fde3ea653b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:42.232995 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c0796-ec1f-44e6-9e4e-71fde3ea653b admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:42.233272 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c0796-ec1f-44e6-9e4e-71fde3ea653b admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:42.233540 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028c0796-ec1f-44e6-9e4e-71fde3ea653b admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:42.234542 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028c0796-ec1f-44e6-9e4e-71fde3ea653b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:42.235850 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028c0796-ec1f-44e6-9e4e-71fde3ea653b admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:42.247243 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1351/2694] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:25:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:25:42.251466 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6718f4a1-1611-4a26-966a-9b924681ce05 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:42.263569 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6718f4a1-1611-4a26-966a-9b924681ce05 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:42.268555 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c80a1dd-1fcb-4569-a4e4-09a6d78cf9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:42.269097 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c80a1dd-1fcb-4569-a4e4-09a6d78cf9fc admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:42.269369 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c80a1dd-1fcb-4569-a4e4-09a6d78cf9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:42.269638 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c80a1dd-1fcb-4569-a4e4-09a6d78cf9fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:42.270310 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c80a1dd-1fcb-4569-a4e4-09a6d78cf9fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:42.271966 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c80a1dd-1fcb-4569-a4e4-09a6d78cf9fc admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:42.286399 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1344/2695] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:25:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:25:42.288140 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c0796-ec1f-44e6-9e4e-71fde3ea653b admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:42.299148 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028c0796-ec1f-44e6-9e4e-71fde3ea653b admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:42.304171 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18949169-1d4d-410c-a66a-d4c08503bd01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:42.304899 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18949169-1d4d-410c-a66a-d4c08503bd01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:42.305143 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18949169-1d4d-410c-a66a-d4c08503bd01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:42.305591 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18949169-1d4d-410c-a66a-d4c08503bd01 admin admin] PATH_INFO: `/v3/projects/517b426645bc4e969cf1d773eb768413/users/d707c63d73a04e9ba91e3660f79de696/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:42.326693 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18949169-1d4d-410c-a66a-d4c08503bd01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=517b426645bc4e969cf1d773eb768413, user_id=d707c63d73a04e9ba91e3660f79de696, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:42.330136 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18949169-1d4d-410c-a66a-d4c08503bd01 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:42.352874 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1352/2696] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 01:25:42 2022] PUT /identity/v3/projects/517b426645bc4e969cf1d773eb768413/users/d707c63d73a04e9ba91e3660f79de696/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:25:42.358744 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac9763-c89a-4185-b2dc-341ee52338a3 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:42.359053 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac9763-c89a-4185-b2dc-341ee52338a3 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:42.359294 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac9763-c89a-4185-b2dc-341ee52338a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:42.381186 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-4eac9763-c89a-4185-b2dc-341ee52338a3 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:25:42.382417 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-4eac9763-c89a-4185-b2dc-341ee52338a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:42.449982 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1345/2697] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:25:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:25:42.461042 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18949169-1d4d-410c-a66a-d4c08503bd01 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:42.463092 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-18949169-1d4d-410c-a66a-d4c08503bd01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:42.478941 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:25:42.525792 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18949169-1d4d-410c-a66a-d4c08503bd01 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:42.531957 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9286ba-863c-4608-85bf-6528865e1925 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:42.532701 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9286ba-863c-4608-85bf-6528865e1925 service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:42.533028 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9286ba-863c-4608-85bf-6528865e1925 service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:42.533296 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9286ba-863c-4608-85bf-6528865e1925 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:42.543427 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9286ba-863c-4608-85bf-6528865e1925 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:42.544975 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9286ba-863c-4608-85bf-6528865e1925 service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:42.558603 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1353/2698] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:25:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:25:46.674887 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e03bf-5170-4f81-bd61-1cf5afcb3db2 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:46.675348 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e03bf-5170-4f81-bd61-1cf5afcb3db2 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:46.675445 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e03bf-5170-4f81-bd61-1cf5afcb3db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:46.712956 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-205e03bf-5170-4f81-bd61-1cf5afcb3db2 None None] MFA Rules not processed for user `d707c63d73a04e9ba91e3660f79de696`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:25:46.714184 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-205e03bf-5170-4f81-bd61-1cf5afcb3db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:46.787860 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1346/2699] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:25:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:25:46.799265 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985fa2d-d6b3-444b-8b20-d021d2ae1fde None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:46.799804 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985fa2d-d6b3-444b-8b20-d021d2ae1fde None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:46.800146 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1985fa2d-d6b3-444b-8b20-d021d2ae1fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:46.820480 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-1985fa2d-d6b3-444b-8b20-d021d2ae1fde None None] MFA Rules not processed for user `d707c63d73a04e9ba91e3660f79de696`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:25:46.821807 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-1985fa2d-d6b3-444b-8b20-d021d2ae1fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:46.829168 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1354/2700] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:25:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:25:46.840551 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e03bf-5170-4f81-bd61-1cf5afcb3db2 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:46.842053 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-205e03bf-5170-4f81-bd61-1cf5afcb3db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:46.898446 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:25:46.922742 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e03bf-5170-4f81-bd61-1cf5afcb3db2 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:46.928405 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec4b949-b119-4f55-a900-1c43f4bd52e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:46.929075 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4b949-b119-4f55-a900-1c43f4bd52e3 service nova] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:46.929321 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4b949-b119-4f55-a900-1c43f4bd52e3 service nova] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:46.929614 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4b949-b119-4f55-a900-1c43f4bd52e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:46.938665 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec4b949-b119-4f55-a900-1c43f4bd52e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:46.940267 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec4b949-b119-4f55-a900-1c43f4bd52e3 service nova] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:46.949841 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1347/2701] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:25:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:25:47.567595 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1985fa2d-d6b3-444b-8b20-d021d2ae1fde None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:47.569191 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-1985fa2d-d6b3-444b-8b20-d021d2ae1fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:47.647558 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1985fa2d-d6b3-444b-8b20-d021d2ae1fde None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:47.652474 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed7a98-e722-4714-b362-d752198dd596 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4fc1d11f5641b0b5f301b234282aa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:47.653080 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed7a98-e722-4714-b362-d752198dd596 service placement] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:47.653352 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed7a98-e722-4714-b362-d752198dd596 service placement] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:47.653647 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed7a98-e722-4714-b362-d752198dd596 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:47.655583 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-72ed7a98-e722-4714-b362-d752198dd596 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:47.667140 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ed7a98-e722-4714-b362-d752198dd596 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:47.668840 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ed7a98-e722-4714-b362-d752198dd596 service placement] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:47.678698 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1355/2702] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:25:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:25:54.201678 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec4b949-b119-4f55-a900-1c43f4bd52e3 service nova] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:54.215332 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec4b949-b119-4f55-a900-1c43f4bd52e3 service nova] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:54.221013 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ec02e-4007-46eb-bade-208e7250a26d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:54.221623 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ec02e-4007-46eb-bade-208e7250a26d service nova] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:54.221896 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ec02e-4007-46eb-bade-208e7250a26d service nova] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:54.222164 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ec02e-4007-46eb-bade-208e7250a26d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:54.223923 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-460ec02e-4007-46eb-bade-208e7250a26d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:54.236690 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460ec02e-4007-46eb-bade-208e7250a26d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:54.238575 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460ec02e-4007-46eb-bade-208e7250a26d service nova] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:54.249891 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1348/2703] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:25:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:25:55.926905 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa0a9f-31a0-45de-b0e0-e0abbf1c863f None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:55.927858 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa0a9f-31a0-45de-b0e0-e0abbf1c863f None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:55.927858 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa0a9f-31a0-45de-b0e0-e0abbf1c863f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:55.950218 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-93aa0a9f-31a0-45de-b0e0-e0abbf1c863f None None] MFA Rules not processed for user `d707c63d73a04e9ba91e3660f79de696`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:25:55.951442 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-93aa0a9f-31a0-45de-b0e0-e0abbf1c863f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:55.958870 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1356/2704] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:25:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:25:56.226643 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ec02e-4007-46eb-bade-208e7250a26d service nova] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:25:56.237375 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ec02e-4007-46eb-bade-208e7250a26d service nova] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:25:56.241181 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0365fd09-c6a9-47da-99de-5ad778c36770 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:25:56.241721 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0365fd09-c6a9-47da-99de-5ad778c36770 service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:25:56.241998 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0365fd09-c6a9-47da-99de-5ad778c36770 service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:25:56.242265 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0365fd09-c6a9-47da-99de-5ad778c36770 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:25:56.250063 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-0365fd09-c6a9-47da-99de-5ad778c36770 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:25:56.261615 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0365fd09-c6a9-47da-99de-5ad778c36770 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:25:56.263099 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0365fd09-c6a9-47da-99de-5ad778c36770 service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:25:56.272268 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1349/2705] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:25:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:26:05.944841 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=58 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:26:06.268159 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=21 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:26:19.050000 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa0a9f-31a0-45de-b0e0-e0abbf1c863f None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:19.064646 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa0a9f-31a0-45de-b0e0-e0abbf1c863f None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:19.071854 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861607a1-efec-4bf4-b8c0-9ab5d9f16bb0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4fc1d11f5641b0b5f301b234282aa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:19.072774 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861607a1-efec-4bf4-b8c0-9ab5d9f16bb0 service placement] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:19.073051 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861607a1-efec-4bf4-b8c0-9ab5d9f16bb0 service placement] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:19.073314 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861607a1-efec-4bf4-b8c0-9ab5d9f16bb0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:19.075212 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-861607a1-efec-4bf4-b8c0-9ab5d9f16bb0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:19.087805 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861607a1-efec-4bf4-b8c0-9ab5d9f16bb0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:19.089742 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861607a1-efec-4bf4-b8c0-9ab5d9f16bb0 service placement] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:19.102211 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1357/2706] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:26:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:26:19.115018 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0365fd09-c6a9-47da-99de-5ad778c36770 service neutron] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:19.130864 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0365fd09-c6a9-47da-99de-5ad778c36770 service neutron] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:19.136407 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc78df59-167a-4d4b-a8ae-634681ca6882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:19.137236 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78df59-167a-4d4b-a8ae-634681ca6882 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:19.137628 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78df59-167a-4d4b-a8ae-634681ca6882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:19.139113 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78df59-167a-4d4b-a8ae-634681ca6882 admin admin] PATH_INFO: `/v3/users/d707c63d73a04e9ba91e3660f79de696` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:19.140777 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc78df59-167a-4d4b-a8ae-634681ca6882 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d707c63d73a04e9ba91e3660f79de696)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:19.143525 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc78df59-167a-4d4b-a8ae-634681ca6882 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:19.207594 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-fc78df59-167a-4d4b-a8ae-634681ca6882 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd707c63d73a04e9ba91e3660f79de696'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:19.216758 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-fc78df59-167a-4d4b-a8ae-634681ca6882 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd707c63d73a04e9ba91e3660f79de696'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:19.230408 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-fc78df59-167a-4d4b-a8ae-634681ca6882 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd707c63d73a04e9ba91e3660f79de696'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:19.231445 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-fc78df59-167a-4d4b-a8ae-634681ca6882 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd707c63d73a04e9ba91e3660f79de696'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:19.232150 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-fc78df59-167a-4d4b-a8ae-634681ca6882 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd707c63d73a04e9ba91e3660f79de696'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:19.246387 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1350/2707] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 01:26:19 2022] DELETE /identity/v3/users/d707c63d73a04e9ba91e3660f79de696 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:26:19.435435 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861607a1-efec-4bf4-b8c0-9ab5d9f16bb0 service placement] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:19.451545 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861607a1-efec-4bf4-b8c0-9ab5d9f16bb0 service placement] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:19.513644 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a4687-9eac-4e5f-a565-e9cf7a8253e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:19.514178 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a4687-9eac-4e5f-a565-e9cf7a8253e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:19.514455 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a4687-9eac-4e5f-a565-e9cf7a8253e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:19.514730 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a4687-9eac-4e5f-a565-e9cf7a8253e6 admin admin] PATH_INFO: `/v3/projects/517b426645bc4e969cf1d773eb768413` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:19.515927 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696a4687-9eac-4e5f-a565-e9cf7a8253e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=517b426645bc4e969cf1d773eb768413)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:19.517877 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696a4687-9eac-4e5f-a565-e9cf7a8253e6 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:19.578325 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-696a4687-9eac-4e5f-a565-e9cf7a8253e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '517b426645bc4e969cf1d773eb768413', 'request_id': 'req-696a4687-9eac-4e5f-a565-e9cf7a8253e6'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:19.587118 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-696a4687-9eac-4e5f-a565-e9cf7a8253e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '517b426645bc4e969cf1d773eb768413', 'request_id': 'req-696a4687-9eac-4e5f-a565-e9cf7a8253e6'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:19.597983 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-696a4687-9eac-4e5f-a565-e9cf7a8253e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '517b426645bc4e969cf1d773eb768413', 'request_id': 'req-696a4687-9eac-4e5f-a565-e9cf7a8253e6'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:19.609924 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-696a4687-9eac-4e5f-a565-e9cf7a8253e6 admin admin] The token cache is being invalidate because project 517b426645bc4e969cf1d773eb768413 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81807) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:26:19.610215 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-696a4687-9eac-4e5f-a565-e9cf7a8253e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:19.610877 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-696a4687-9eac-4e5f-a565-e9cf7a8253e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:19.612499 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1358/2708] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 01:26:19 2022] DELETE /identity/v3/projects/517b426645bc4e969cf1d773eb768413 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:26:19.617628 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c777f-0f25-4956-a708-93e4b5162833 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:19.617917 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c777f-0f25-4956-a708-93e4b5162833 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:19.618191 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c777f-0f25-4956-a708-93e4b5162833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:19.658507 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-a65c777f-0f25-4956-a708-93e4b5162833 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:26:19.659747 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-a65c777f-0f25-4956-a708-93e4b5162833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:19.725006 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1351/2709] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:26:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:26:19.733200 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb18f7-00d0-499e-89c4-6e7081907c6e None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:19.733483 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb18f7-00d0-499e-89c4-6e7081907c6e None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:19.733747 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb18f7-00d0-499e-89c4-6e7081907c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:19.754884 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-2bcb18f7-00d0-499e-89c4-6e7081907c6e None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:26:19.756139 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-2bcb18f7-00d0-499e-89c4-6e7081907c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:19.764560 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1359/2710] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:26:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:26:19.769779 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c777f-0f25-4956-a708-93e4b5162833 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:19.783434 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c777f-0f25-4956-a708-93e4b5162833 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:19.788350 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d52b22e-e3b3-4764-9cc6-dfc2032710cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:19.788965 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52b22e-e3b3-4764-9cc6-dfc2032710cc admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:19.789262 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52b22e-e3b3-4764-9cc6-dfc2032710cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:19.789540 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52b22e-e3b3-4764-9cc6-dfc2032710cc admin admin] PATH_INFO: `/v3/domains` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:19.790192 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d52b22e-e3b3-4764-9cc6-dfc2032710cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:26:19.790493 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d52b22e-e3b3-4764-9cc6-dfc2032710cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:19.792169 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d52b22e-e3b3-4764-9cc6-dfc2032710cc admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:19.805069 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1352/2711] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 01:26:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:26:19.811162 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb18f7-00d0-499e-89c4-6e7081907c6e None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:19.821377 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb18f7-00d0-499e-89c4-6e7081907c6e None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:19.826496 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd3a42-a666-4c77-8326-b055efd1ebb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:19.827100 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd3a42-a666-4c77-8326-b055efd1ebb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:19.827375 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd3a42-a666-4c77-8326-b055efd1ebb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:19.827737 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd3a42-a666-4c77-8326-b055efd1ebb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:19.828427 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dd3a42-a666-4c77-8326-b055efd1ebb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:19.830415 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dd3a42-a666-4c77-8326-b055efd1ebb1 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:19.875280 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1360/2712] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 01:26:19 2022] POST /identity/v3/projects => generated 367 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:26:19.879937 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d52b22e-e3b3-4764-9cc6-dfc2032710cc admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:19.890721 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d52b22e-e3b3-4764-9cc6-dfc2032710cc admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:19.937127 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:26:19.956744 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02398c73-d0a5-4e46-ad85-358022348150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:19.957372 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02398c73-d0a5-4e46-ad85-358022348150 admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:19.957658 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02398c73-d0a5-4e46-ad85-358022348150 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:19.957945 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02398c73-d0a5-4e46-ad85-358022348150 admin admin] PATH_INFO: `/v3/users` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:19.958674 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02398c73-d0a5-4e46-ad85-358022348150 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:19.960647 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02398c73-d0a5-4e46-ad85-358022348150 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:19.984018 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1353/2713] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 01:26:19 2022] POST /identity/v3/users => generated 284 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:26:19.988098 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd3a42-a666-4c77-8326-b055efd1ebb1 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:19.998988 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd3a42-a666-4c77-8326-b055efd1ebb1 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:20.004441 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e87c65d-0969-48c2-bf3d-972c497ef5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:20.005052 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87c65d-0969-48c2-bf3d-972c497ef5da admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:20.005334 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87c65d-0969-48c2-bf3d-972c497ef5da admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:20.005605 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87c65d-0969-48c2-bf3d-972c497ef5da admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:20.006299 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e87c65d-0969-48c2-bf3d-972c497ef5da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:20.007966 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e87c65d-0969-48c2-bf3d-972c497ef5da admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:20.018572 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1361/2714] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:26:20.022747 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02398c73-d0a5-4e46-ad85-358022348150 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:20.033291 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02398c73-d0a5-4e46-ad85-358022348150 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:20.039040 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9773b02a-92c4-4466-877f-c9faae525b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:20.039657 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773b02a-92c4-4466-877f-c9faae525b92 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:20.039973 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773b02a-92c4-4466-877f-c9faae525b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:20.040245 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773b02a-92c4-4466-877f-c9faae525b92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:20.040890 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9773b02a-92c4-4466-877f-c9faae525b92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:20.042531 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9773b02a-92c4-4466-877f-c9faae525b92 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:20.055600 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1354/2715] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:26:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:26:20.060288 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e87c65d-0969-48c2-bf3d-972c497ef5da admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:20.073530 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e87c65d-0969-48c2-bf3d-972c497ef5da admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:20.078340 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6253df3f-4f9b-4863-872a-aebcad758dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:20.079004 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253df3f-4f9b-4863-872a-aebcad758dcf admin admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:20.079284 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253df3f-4f9b-4863-872a-aebcad758dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:20.079557 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253df3f-4f9b-4863-872a-aebcad758dcf admin admin] PATH_INFO: `/v3/projects/5fa0c889219941cf92fd3b73d990e4f9/users/89e864c99acb475491829b1fa6773f12/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:20.094517 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6253df3f-4f9b-4863-872a-aebcad758dcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fa0c889219941cf92fd3b73d990e4f9, user_id=89e864c99acb475491829b1fa6773f12, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:20.097239 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6253df3f-4f9b-4863-872a-aebcad758dcf admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:20.113363 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1362/2716] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 01:26:20 2022] PUT /identity/v3/projects/5fa0c889219941cf92fd3b73d990e4f9/users/89e864c99acb475491829b1fa6773f12/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:26:20.125763 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89bff29-94e7-4eb8-bd30-42165b854dda None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:20.126310 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89bff29-94e7-4eb8-bd30-42165b854dda None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:20.126310 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89bff29-94e7-4eb8-bd30-42165b854dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:20.155320 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-a89bff29-94e7-4eb8-bd30-42165b854dda None None] MFA Rules not processed for user `89e864c99acb475491829b1fa6773f12`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:26:20.156577 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-a89bff29-94e7-4eb8-bd30-42165b854dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:20.226094 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1355/2717] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:26:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:26:20.236941 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6253df3f-4f9b-4863-872a-aebcad758dcf admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:20.238973 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-6253df3f-4f9b-4863-872a-aebcad758dcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:20.246053 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:26:20.303155 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6253df3f-4f9b-4863-872a-aebcad758dcf admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:20.307741 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5209703-1f78-4260-bb6a-c4fa3c5b39c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:20.308372 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5209703-1f78-4260-bb6a-c4fa3c5b39c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:20.308658 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5209703-1f78-4260-bb6a-c4fa3c5b39c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:20.308931 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5209703-1f78-4260-bb6a-c4fa3c5b39c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:20.320172 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5209703-1f78-4260-bb6a-c4fa3c5b39c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:20.321649 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5209703-1f78-4260-bb6a-c4fa3c5b39c0 service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:20.331428 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1363/2718] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:26:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:26:30.222511 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=46,keystone:INSERT=3 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:26:30.327169 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=24 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:26:33.647241 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89bff29-94e7-4eb8-bd30-42165b854dda None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:33.736611 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89bff29-94e7-4eb8-bd30-42165b854dda None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:33.741444 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf779a-a1ff-4979-8bef-419982114788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:33.742027 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf779a-a1ff-4979-8bef-419982114788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:33.742293 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf779a-a1ff-4979-8bef-419982114788 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:33.742536 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf779a-a1ff-4979-8bef-419982114788 admin admin] PATH_INFO: `/v3/users/89e864c99acb475491829b1fa6773f12` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:33.743723 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdf779a-a1ff-4979-8bef-419982114788 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89e864c99acb475491829b1fa6773f12)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:33.745676 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdf779a-a1ff-4979-8bef-419982114788 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:33.794984 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-bbdf779a-a1ff-4979-8bef-419982114788 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89e864c99acb475491829b1fa6773f12'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:33.802942 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-bbdf779a-a1ff-4979-8bef-419982114788 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89e864c99acb475491829b1fa6773f12'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:33.817109 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-bbdf779a-a1ff-4979-8bef-419982114788 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89e864c99acb475491829b1fa6773f12'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:33.817785 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-bbdf779a-a1ff-4979-8bef-419982114788 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89e864c99acb475491829b1fa6773f12'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:33.818420 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-bbdf779a-a1ff-4979-8bef-419982114788 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89e864c99acb475491829b1fa6773f12'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:33.839572 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1356/2719] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 01:26:33 2022] DELETE /identity/v3/users/89e864c99acb475491829b1fa6773f12 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:26:33.844421 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef06a38b-3d74-44ad-a2ba-b71b9762abbd None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:33.844950 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef06a38b-3d74-44ad-a2ba-b71b9762abbd None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:33.844950 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef06a38b-3d74-44ad-a2ba-b71b9762abbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:33.868528 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-ef06a38b-3d74-44ad-a2ba-b71b9762abbd None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:26:33.870157 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-ef06a38b-3d74-44ad-a2ba-b71b9762abbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:33.934016 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1364/2720] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:26:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:26:33.948578 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf779a-a1ff-4979-8bef-419982114788 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:33.950822 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-bbdf779a-a1ff-4979-8bef-419982114788 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:34.015988 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:26:34.033939 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf779a-a1ff-4979-8bef-419982114788 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:34.037792 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d992cbcf-53e0-4e8a-a25b-cd117e87000b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:34.038404 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d992cbcf-53e0-4e8a-a25b-cd117e87000b service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:34.038681 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d992cbcf-53e0-4e8a-a25b-cd117e87000b service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:34.038974 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d992cbcf-53e0-4e8a-a25b-cd117e87000b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:34.048250 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d992cbcf-53e0-4e8a-a25b-cd117e87000b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:34.049686 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d992cbcf-53e0-4e8a-a25b-cd117e87000b service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:34.059140 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1357/2721] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:26:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:26:34.247234 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef06a38b-3d74-44ad-a2ba-b71b9762abbd None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:34.248733 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-ef06a38b-3d74-44ad-a2ba-b71b9762abbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:34.272944 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef06a38b-3d74-44ad-a2ba-b71b9762abbd None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:34.277728 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265e7312-643d-42f7-8465-d50cd915fe72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:34.278408 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e7312-643d-42f7-8465-d50cd915fe72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:34.278690 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e7312-643d-42f7-8465-d50cd915fe72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:34.278946 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265e7312-643d-42f7-8465-d50cd915fe72 admin admin] PATH_INFO: `/v3/projects/5fa0c889219941cf92fd3b73d990e4f9` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:34.280094 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265e7312-643d-42f7-8465-d50cd915fe72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fa0c889219941cf92fd3b73d990e4f9)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:34.282012 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265e7312-643d-42f7-8465-d50cd915fe72 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:34.332578 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-265e7312-643d-42f7-8465-d50cd915fe72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fa0c889219941cf92fd3b73d990e4f9', 'request_id': 'req-265e7312-643d-42f7-8465-d50cd915fe72'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:34.339197 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-265e7312-643d-42f7-8465-d50cd915fe72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fa0c889219941cf92fd3b73d990e4f9', 'request_id': 'req-265e7312-643d-42f7-8465-d50cd915fe72'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:34.350406 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-265e7312-643d-42f7-8465-d50cd915fe72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fa0c889219941cf92fd3b73d990e4f9', 'request_id': 'req-265e7312-643d-42f7-8465-d50cd915fe72'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:34.364663 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-265e7312-643d-42f7-8465-d50cd915fe72 admin admin] The token cache is being invalidate because project 5fa0c889219941cf92fd3b73d990e4f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81807) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:26:34.365030 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-265e7312-643d-42f7-8465-d50cd915fe72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:34.365977 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-265e7312-643d-42f7-8465-d50cd915fe72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:34.368302 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1365/2722] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 01:26:34 2022] DELETE /identity/v3/projects/5fa0c889219941cf92fd3b73d990e4f9 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:26:34.374789 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ae7ef-dd24-474a-974a-ab48d96f807c None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:34.375170 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ae7ef-dd24-474a-974a-ab48d96f807c None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:34.375548 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510ae7ef-dd24-474a-974a-ab48d96f807c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:34.396687 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-510ae7ef-dd24-474a-974a-ab48d96f807c None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:26:34.397886 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-510ae7ef-dd24-474a-974a-ab48d96f807c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:34.462991 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1358/2723] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:26:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:26:34.471052 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20506509-0ec4-40b9-8166-03feff9d94df None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:34.471335 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20506509-0ec4-40b9-8166-03feff9d94df None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:34.471581 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20506509-0ec4-40b9-8166-03feff9d94df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:34.498658 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-20506509-0ec4-40b9-8166-03feff9d94df None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:26:34.499943 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-20506509-0ec4-40b9-8166-03feff9d94df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:34.508902 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1366/2724] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:26:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:26:34.513661 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510ae7ef-dd24-474a-974a-ab48d96f807c None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:34.524532 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510ae7ef-dd24-474a-974a-ab48d96f807c None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:34.530301 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c1bfb0-c3b9-4daf-9e8c-baecfd749c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:34.530929 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1bfb0-c3b9-4daf-9e8c-baecfd749c84 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:34.531209 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1bfb0-c3b9-4daf-9e8c-baecfd749c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:34.531479 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1bfb0-c3b9-4daf-9e8c-baecfd749c84 admin admin] PATH_INFO: `/v3/domains` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:34.532180 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c1bfb0-c3b9-4daf-9e8c-baecfd749c84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:26:34.532493 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c1bfb0-c3b9-4daf-9e8c-baecfd749c84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:34.534109 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c1bfb0-c3b9-4daf-9e8c-baecfd749c84 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:34.547593 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1359/2725] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 01:26:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:26:34.552302 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20506509-0ec4-40b9-8166-03feff9d94df None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:34.564583 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20506509-0ec4-40b9-8166-03feff9d94df None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:34.569739 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6709767-3ddb-45ad-b7ba-2ab77da2ed24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:34.570701 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6709767-3ddb-45ad-b7ba-2ab77da2ed24 admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:34.570971 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6709767-3ddb-45ad-b7ba-2ab77da2ed24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:34.571223 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6709767-3ddb-45ad-b7ba-2ab77da2ed24 admin admin] PATH_INFO: `/v3/projects` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:34.571898 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6709767-3ddb-45ad-b7ba-2ab77da2ed24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:34.573813 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6709767-3ddb-45ad-b7ba-2ab77da2ed24 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:34.604064 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1367/2726] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 01:26:34 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:26:34.608399 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c1bfb0-c3b9-4daf-9e8c-baecfd749c84 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:34.618662 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c1bfb0-c3b9-4daf-9e8c-baecfd749c84 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:34.677890 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47113bc-df52-4b81-a91d-c312a7a4dc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:34.678606 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47113bc-df52-4b81-a91d-c312a7a4dc0f admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:34.678810 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47113bc-df52-4b81-a91d-c312a7a4dc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:34.679078 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47113bc-df52-4b81-a91d-c312a7a4dc0f admin admin] PATH_INFO: `/v3/users` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:34.679748 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47113bc-df52-4b81-a91d-c312a7a4dc0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:34.681695 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47113bc-df52-4b81-a91d-c312a7a4dc0f admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:34.706306 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1360/2727] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 01:26:34 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:26:34.708600 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6709767-3ddb-45ad-b7ba-2ab77da2ed24 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:34.719421 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6709767-3ddb-45ad-b7ba-2ab77da2ed24 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:34.724632 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb8586a-5379-45c6-9442-9bd897cc12ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:34.725258 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8586a-5379-45c6-9442-9bd897cc12ee admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:34.725529 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8586a-5379-45c6-9442-9bd897cc12ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:34.725798 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8586a-5379-45c6-9442-9bd897cc12ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:34.726453 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb8586a-5379-45c6-9442-9bd897cc12ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:34.728126 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb8586a-5379-45c6-9442-9bd897cc12ee admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:34.738863 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1368/2728] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:26:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:26:34.743192 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47113bc-df52-4b81-a91d-c312a7a4dc0f admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:34.753748 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47113bc-df52-4b81-a91d-c312a7a4dc0f admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:34.759779 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6401b76f-098a-4b67-a69a-edb5e63bc62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:34.760391 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6401b76f-098a-4b67-a69a-edb5e63bc62c admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:34.760672 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6401b76f-098a-4b67-a69a-edb5e63bc62c admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:34.760944 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6401b76f-098a-4b67-a69a-edb5e63bc62c admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:34.761605 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6401b76f-098a-4b67-a69a-edb5e63bc62c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:34.763612 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6401b76f-098a-4b67-a69a-edb5e63bc62c admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:34.775021 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1361/2729] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:26:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:26:34.779393 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb8586a-5379-45c6-9442-9bd897cc12ee admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:34.790266 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb8586a-5379-45c6-9442-9bd897cc12ee admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:34.796241 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a42bd4-7be1-4ecf-ad5c-1adfd64e5fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:34.796932 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a42bd4-7be1-4ecf-ad5c-1adfd64e5fea admin admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:34.797215 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a42bd4-7be1-4ecf-ad5c-1adfd64e5fea admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:34.797537 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a42bd4-7be1-4ecf-ad5c-1adfd64e5fea admin admin] PATH_INFO: `/v3/projects/d3df62a533bc4a429fca4a0df16504bd/users/0b78d89683924480905caeea5bbf60a1/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:34.814781 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a42bd4-7be1-4ecf-ad5c-1adfd64e5fea admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3df62a533bc4a429fca4a0df16504bd, user_id=0b78d89683924480905caeea5bbf60a1, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:34.817534 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a42bd4-7be1-4ecf-ad5c-1adfd64e5fea admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:34.833265 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1369/2730] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 01:26:34 2022] PUT /identity/v3/projects/d3df62a533bc4a429fca4a0df16504bd/users/0b78d89683924480905caeea5bbf60a1/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:26:34.843413 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbed66e-1330-45f0-8a38-6b940ede26f2 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:34.843788 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbed66e-1330-45f0-8a38-6b940ede26f2 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:34.844070 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbed66e-1330-45f0-8a38-6b940ede26f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:34.871404 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-6bbed66e-1330-45f0-8a38-6b940ede26f2 None None] MFA Rules not processed for user `0b78d89683924480905caeea5bbf60a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:26:34.872655 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-6bbed66e-1330-45f0-8a38-6b940ede26f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:34.915047 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:26:34.949173 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1362/2731] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:26:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:26:34.959243 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a42bd4-7be1-4ecf-ad5c-1adfd64e5fea admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:34.961225 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-25a42bd4-7be1-4ecf-ad5c-1adfd64e5fea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:34.975497 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:26:35.023490 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a42bd4-7be1-4ecf-ad5c-1adfd64e5fea admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:35.027885 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1b45aa-c715-4148-a033-9aab7feb7757 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:35.028429 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b45aa-c715-4148-a033-9aab7feb7757 service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:35.028736 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b45aa-c715-4148-a033-9aab7feb7757 service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:35.029007 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b45aa-c715-4148-a033-9aab7feb7757 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:35.038141 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1b45aa-c715-4148-a033-9aab7feb7757 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:35.039592 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1b45aa-c715-4148-a033-9aab7feb7757 service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:35.048596 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1370/2732] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:26:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:26:39.574359 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbed66e-1330-45f0-8a38-6b940ede26f2 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:39.641915 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbed66e-1330-45f0-8a38-6b940ede26f2 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:39.647499 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef77f8e8-32a2-4296-ae3d-29fbff58d765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:39.648186 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef77f8e8-32a2-4296-ae3d-29fbff58d765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:39.648455 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef77f8e8-32a2-4296-ae3d-29fbff58d765 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:39.648722 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef77f8e8-32a2-4296-ae3d-29fbff58d765 admin admin] PATH_INFO: `/v3/users/0b78d89683924480905caeea5bbf60a1` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:39.649960 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef77f8e8-32a2-4296-ae3d-29fbff58d765 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b78d89683924480905caeea5bbf60a1)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:39.651941 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef77f8e8-32a2-4296-ae3d-29fbff58d765 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:39.706597 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-ef77f8e8-32a2-4296-ae3d-29fbff58d765 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b78d89683924480905caeea5bbf60a1'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:39.716156 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-ef77f8e8-32a2-4296-ae3d-29fbff58d765 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b78d89683924480905caeea5bbf60a1'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:39.733380 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-ef77f8e8-32a2-4296-ae3d-29fbff58d765 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b78d89683924480905caeea5bbf60a1'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:39.734172 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-ef77f8e8-32a2-4296-ae3d-29fbff58d765 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b78d89683924480905caeea5bbf60a1'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:39.734834 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-ef77f8e8-32a2-4296-ae3d-29fbff58d765 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b78d89683924480905caeea5bbf60a1'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:39.746988 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1363/2733] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 01:26:39 2022] DELETE /identity/v3/users/0b78d89683924480905caeea5bbf60a1 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:26:39.751753 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613d3ad-33ea-448c-a6fe-3e20136682d1 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:39.752256 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613d3ad-33ea-448c-a6fe-3e20136682d1 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:39.752366 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613d3ad-33ea-448c-a6fe-3e20136682d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:39.774188 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-5613d3ad-33ea-448c-a6fe-3e20136682d1 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:26:39.775977 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-5613d3ad-33ea-448c-a6fe-3e20136682d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:39.842062 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1371/2734] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:26:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:26:39.852040 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef77f8e8-32a2-4296-ae3d-29fbff58d765 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:39.853686 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-ef77f8e8-32a2-4296-ae3d-29fbff58d765 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:39.912266 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef77f8e8-32a2-4296-ae3d-29fbff58d765 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:39.916439 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8a65a5-2af4-445e-ab4f-15df86ab372b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:39.917049 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a65a5-2af4-445e-ab4f-15df86ab372b service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:39.917326 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a65a5-2af4-445e-ab4f-15df86ab372b service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:39.917597 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a65a5-2af4-445e-ab4f-15df86ab372b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:39.927254 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8a65a5-2af4-445e-ab4f-15df86ab372b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:39.928735 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8a65a5-2af4-445e-ab4f-15df86ab372b service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:39.934258 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:26:39.939677 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1364/2735] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:26:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:26:40.130290 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5613d3ad-33ea-448c-a6fe-3e20136682d1 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:40.132097 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-5613d3ad-33ea-448c-a6fe-3e20136682d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:40.148003 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5613d3ad-33ea-448c-a6fe-3e20136682d1 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:40.154122 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf439d1e-5d7e-4e74-b10c-9754a1092302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:40.154951 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf439d1e-5d7e-4e74-b10c-9754a1092302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:40.155292 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf439d1e-5d7e-4e74-b10c-9754a1092302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:40.155597 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf439d1e-5d7e-4e74-b10c-9754a1092302 admin admin] PATH_INFO: `/v3/projects/d3df62a533bc4a429fca4a0df16504bd` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:40.158264 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf439d1e-5d7e-4e74-b10c-9754a1092302 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3df62a533bc4a429fca4a0df16504bd)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:40.160352 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf439d1e-5d7e-4e74-b10c-9754a1092302 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:40.216727 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-bf439d1e-5d7e-4e74-b10c-9754a1092302 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3df62a533bc4a429fca4a0df16504bd', 'request_id': 'req-bf439d1e-5d7e-4e74-b10c-9754a1092302'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:40.224390 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-bf439d1e-5d7e-4e74-b10c-9754a1092302 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3df62a533bc4a429fca4a0df16504bd', 'request_id': 'req-bf439d1e-5d7e-4e74-b10c-9754a1092302'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:40.234743 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-bf439d1e-5d7e-4e74-b10c-9754a1092302 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3df62a533bc4a429fca4a0df16504bd', 'request_id': 'req-bf439d1e-5d7e-4e74-b10c-9754a1092302'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:40.247386 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-bf439d1e-5d7e-4e74-b10c-9754a1092302 admin admin] The token cache is being invalidate because project d3df62a533bc4a429fca4a0df16504bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81807) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:26:40.247704 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-bf439d1e-5d7e-4e74-b10c-9754a1092302 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:40.248354 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-bf439d1e-5d7e-4e74-b10c-9754a1092302 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:26:40.249868 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1372/2736] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 01:26:40 2022] DELETE /identity/v3/projects/d3df62a533bc4a429fca4a0df16504bd => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:26:40.255108 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b8fb5-8d87-4b5e-bffd-41bbc517c345 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:40.255390 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b8fb5-8d87-4b5e-bffd-41bbc517c345 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:40.255687 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b8fb5-8d87-4b5e-bffd-41bbc517c345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:40.278702 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-7d5b8fb5-8d87-4b5e-bffd-41bbc517c345 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:26:40.280068 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-7d5b8fb5-8d87-4b5e-bffd-41bbc517c345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:40.346158 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1365/2737] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:26:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:26:40.355400 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a3bb4e-bb7e-4660-ab95-91c621906bad None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:40.355722 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a3bb4e-bb7e-4660-ab95-91c621906bad None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:40.355993 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a3bb4e-bb7e-4660-ab95-91c621906bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:40.375986 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-59a3bb4e-bb7e-4660-ab95-91c621906bad None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:26:40.377223 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-59a3bb4e-bb7e-4660-ab95-91c621906bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:40.385516 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1373/2738] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:26:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:26:40.389758 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b8fb5-8d87-4b5e-bffd-41bbc517c345 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:40.399501 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b8fb5-8d87-4b5e-bffd-41bbc517c345 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:40.404409 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2253bda-6a20-41ae-ad51-bde6905efa5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:40.405047 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2253bda-6a20-41ae-ad51-bde6905efa5a admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:40.405323 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2253bda-6a20-41ae-ad51-bde6905efa5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:40.405588 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2253bda-6a20-41ae-ad51-bde6905efa5a admin admin] PATH_INFO: `/v3/domains` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:40.406239 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2253bda-6a20-41ae-ad51-bde6905efa5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:26:40.406511 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2253bda-6a20-41ae-ad51-bde6905efa5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:40.408142 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2253bda-6a20-41ae-ad51-bde6905efa5a admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:40.420864 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1366/2739] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 01:26:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:26:40.425923 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a3bb4e-bb7e-4660-ab95-91c621906bad None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:40.436572 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a3bb4e-bb7e-4660-ab95-91c621906bad None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:40.442454 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d113d-78ff-4b42-a137-d1a96c03fddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:40.443076 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d113d-78ff-4b42-a137-d1a96c03fddd admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:40.443353 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d113d-78ff-4b42-a137-d1a96c03fddd admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:40.443597 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d113d-78ff-4b42-a137-d1a96c03fddd admin admin] PATH_INFO: `/v3/projects` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:40.444289 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79d113d-78ff-4b42-a137-d1a96c03fddd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:40.446214 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79d113d-78ff-4b42-a137-d1a96c03fddd admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:40.478728 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1374/2740] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 01:26:40 2022] POST /identity/v3/projects => generated 387 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:26:40.483269 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2253bda-6a20-41ae-ad51-bde6905efa5a admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:40.494887 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2253bda-6a20-41ae-ad51-bde6905efa5a admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:40.559267 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367db9b3-a058-419a-90bc-aec20d43f30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:40.559936 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367db9b3-a058-419a-90bc-aec20d43f30a admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:40.560211 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367db9b3-a058-419a-90bc-aec20d43f30a admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:40.560477 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367db9b3-a058-419a-90bc-aec20d43f30a admin admin] PATH_INFO: `/v3/users` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:40.561495 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367db9b3-a058-419a-90bc-aec20d43f30a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:40.563424 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367db9b3-a058-419a-90bc-aec20d43f30a admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:40.589445 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1367/2741] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 01:26:40 2022] POST /identity/v3/users => generated 294 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:26:40.592708 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d113d-78ff-4b42-a137-d1a96c03fddd admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:40.603354 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d113d-78ff-4b42-a137-d1a96c03fddd admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:40.608341 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943c7e4c-5e32-4771-9e50-fb1e4e768887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:40.608951 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c7e4c-5e32-4771-9e50-fb1e4e768887 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:40.609229 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c7e4c-5e32-4771-9e50-fb1e4e768887 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:40.609500 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c7e4c-5e32-4771-9e50-fb1e4e768887 admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:40.610151 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943c7e4c-5e32-4771-9e50-fb1e4e768887 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:40.611894 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943c7e4c-5e32-4771-9e50-fb1e4e768887 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:40.613998 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:26:40.623913 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1375/2742] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:26:40.627291 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367db9b3-a058-419a-90bc-aec20d43f30a admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:40.637794 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367db9b3-a058-419a-90bc-aec20d43f30a admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:40.642702 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a4efaa-b63a-464e-abd8-e30fbe4bb14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:40.643321 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a4efaa-b63a-464e-abd8-e30fbe4bb14d admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:40.643601 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a4efaa-b63a-464e-abd8-e30fbe4bb14d admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:40.643910 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a4efaa-b63a-464e-abd8-e30fbe4bb14d admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:40.644588 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a4efaa-b63a-464e-abd8-e30fbe4bb14d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:40.646256 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a4efaa-b63a-464e-abd8-e30fbe4bb14d admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:40.657825 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1368/2743] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:26:40.662221 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943c7e4c-5e32-4771-9e50-fb1e4e768887 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:40.673016 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943c7e4c-5e32-4771-9e50-fb1e4e768887 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:40.679231 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541a72c5-0011-4a0b-b90c-2a99f66c61cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:40.679929 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a72c5-0011-4a0b-b90c-2a99f66c61cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:40.680211 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a72c5-0011-4a0b-b90c-2a99f66c61cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:40.680482 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541a72c5-0011-4a0b-b90c-2a99f66c61cd admin admin] PATH_INFO: `/v3/projects/a93174cb259e4694948ca5ba6b11ab9b/users/c85ba998310648b3b9b79abafa8737fb/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:40.697960 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541a72c5-0011-4a0b-b90c-2a99f66c61cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a93174cb259e4694948ca5ba6b11ab9b, user_id=c85ba998310648b3b9b79abafa8737fb, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:40.700706 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541a72c5-0011-4a0b-b90c-2a99f66c61cd admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:40.717613 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1376/2744] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 01:26:40 2022] PUT /identity/v3/projects/a93174cb259e4694948ca5ba6b11ab9b/users/c85ba998310648b3b9b79abafa8737fb/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:26:40.723065 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca3579-d243-4b52-87de-eaa40ad28d11 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:40.723354 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca3579-d243-4b52-87de-eaa40ad28d11 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:40.723619 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca3579-d243-4b52-87de-eaa40ad28d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:40.742822 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-d9ca3579-d243-4b52-87de-eaa40ad28d11 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:26:40.744066 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-d9ca3579-d243-4b52-87de-eaa40ad28d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:40.805910 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1369/2745] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:26:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:26:40.816427 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541a72c5-0011-4a0b-b90c-2a99f66c61cd admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:40.818245 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-541a72c5-0011-4a0b-b90c-2a99f66c61cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:40.875562 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541a72c5-0011-4a0b-b90c-2a99f66c61cd admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:40.879459 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc65659b-2db6-4654-a857-6b04cc01d9ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:40.880102 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65659b-2db6-4654-a857-6b04cc01d9ac service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:40.880376 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65659b-2db6-4654-a857-6b04cc01d9ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:40.880636 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65659b-2db6-4654-a857-6b04cc01d9ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:40.890301 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc65659b-2db6-4654-a857-6b04cc01d9ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:40.891833 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc65659b-2db6-4654-a857-6b04cc01d9ac service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:40.901279 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1377/2746] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:26:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:26:44.998466 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78324f24-c084-43e3-9d18-073abb4952dc None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:44.999414 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78324f24-c084-43e3-9d18-073abb4952dc None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:44.999734 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78324f24-c084-43e3-9d18-073abb4952dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:45.014659 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:26:45.031418 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-78324f24-c084-43e3-9d18-073abb4952dc None None] MFA Rules not processed for user `c85ba998310648b3b9b79abafa8737fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:26:45.032796 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-78324f24-c084-43e3-9d18-073abb4952dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:45.109195 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1370/2747] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:26:44 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:26:45.114069 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc65659b-2db6-4654-a857-6b04cc01d9ac service neutron] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:45.124582 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc65659b-2db6-4654-a857-6b04cc01d9ac service neutron] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:45.129417 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4e6fe3-8864-4938-9684-f742abdc9b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:45.130127 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e6fe3-8864-4938-9684-f742abdc9b39 admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:45.130464 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e6fe3-8864-4938-9684-f742abdc9b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:45.130789 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e6fe3-8864-4938-9684-f742abdc9b39 admin admin] PATH_INFO: `/v3/projects` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:45.131498 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4e6fe3-8864-4938-9684-f742abdc9b39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:45.133534 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4e6fe3-8864-4938-9684-f742abdc9b39 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:45.169836 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1378/2748] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 01:26:45 2022] POST /identity/v3/projects => generated 389 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:26:45.171222 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78324f24-c084-43e3-9d18-073abb4952dc None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:45.184092 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78324f24-c084-43e3-9d18-073abb4952dc None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:45.251884 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef7be9-a13a-456a-a5c5-8f67e6e0d936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:45.252520 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef7be9-a13a-456a-a5c5-8f67e6e0d936 admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:45.252810 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef7be9-a13a-456a-a5c5-8f67e6e0d936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:45.253078 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef7be9-a13a-456a-a5c5-8f67e6e0d936 admin admin] PATH_INFO: `/v3/users` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:45.253732 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ef7be9-a13a-456a-a5c5-8f67e6e0d936 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:45.255928 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ef7be9-a13a-456a-a5c5-8f67e6e0d936 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:45.283964 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1371/2749] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 01:26:45 2022] POST /identity/v3/users => generated 301 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:26:45.287913 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4e6fe3-8864-4938-9684-f742abdc9b39 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:45.299135 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4e6fe3-8864-4938-9684-f742abdc9b39 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:45.304271 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d8023-371b-4fbd-9fb3-32728b5b198b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:45.304913 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d8023-371b-4fbd-9fb3-32728b5b198b admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:45.305193 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d8023-371b-4fbd-9fb3-32728b5b198b admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:45.305468 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d8023-371b-4fbd-9fb3-32728b5b198b admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:45.306129 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580d8023-371b-4fbd-9fb3-32728b5b198b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:45.307804 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580d8023-371b-4fbd-9fb3-32728b5b198b admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:45.320200 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1379/2750] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:26:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:26:45.324717 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef7be9-a13a-456a-a5c5-8f67e6e0d936 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:45.335931 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef7be9-a13a-456a-a5c5-8f67e6e0d936 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:45.340962 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bb6a4d-e6c3-453b-8f92-803a7a8186f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:45.341637 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb6a4d-e6c3-453b-8f92-803a7a8186f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:45.341917 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb6a4d-e6c3-453b-8f92-803a7a8186f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:45.342188 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bb6a4d-e6c3-453b-8f92-803a7a8186f8 admin admin] PATH_INFO: `/v3/projects/f0dbd889720841d2907929ac5e491c60/users/63b42f3862dd4efb8264c0d10df3bb7e/roles/2e4889bb71f9434392c0baba59f2534e` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:45.359437 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bb6a4d-e6c3-453b-8f92-803a7a8186f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0dbd889720841d2907929ac5e491c60, user_id=63b42f3862dd4efb8264c0d10df3bb7e, role_id=2e4889bb71f9434392c0baba59f2534e)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:45.362371 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bb6a4d-e6c3-453b-8f92-803a7a8186f8 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:45.380343 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1372/2751] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 01:26:45 2022] PUT /identity/v3/projects/f0dbd889720841d2907929ac5e491c60/users/63b42f3862dd4efb8264c0d10df3bb7e/roles/2e4889bb71f9434392c0baba59f2534e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:26:45.384450 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d8023-371b-4fbd-9fb3-32728b5b198b admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:45.396079 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d8023-371b-4fbd-9fb3-32728b5b198b admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:45.468854 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d4504c-24ff-4e71-b157-b7be0b76f0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:45.469553 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d4504c-24ff-4e71-b157-b7be0b76f0f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:45.469832 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d4504c-24ff-4e71-b157-b7be0b76f0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:45.470074 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d4504c-24ff-4e71-b157-b7be0b76f0f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:45.470724 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d4504c-24ff-4e71-b157-b7be0b76f0f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:45.472406 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d4504c-24ff-4e71-b157-b7be0b76f0f5 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:45.484508 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1380/2752] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:26:45 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:26:45.488977 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bb6a4d-e6c3-453b-8f92-803a7a8186f8 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:45.500498 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bb6a4d-e6c3-453b-8f92-803a7a8186f8 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:45.505419 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff484ba-bf07-4ae8-a6fa-b9d9a8bc0081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:45.506309 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff484ba-bf07-4ae8-a6fa-b9d9a8bc0081 admin admin] REQUEST_METHOD: `PUT` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:45.506743 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff484ba-bf07-4ae8-a6fa-b9d9a8bc0081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:45.507005 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff484ba-bf07-4ae8-a6fa-b9d9a8bc0081 admin admin] PATH_INFO: `/v3/projects/f0dbd889720841d2907929ac5e491c60/users/63b42f3862dd4efb8264c0d10df3bb7e/roles/2e4889bb71f9434392c0baba59f2534e` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:45.508834 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff484ba-bf07-4ae8-a6fa-b9d9a8bc0081 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0dbd889720841d2907929ac5e491c60, user_id=63b42f3862dd4efb8264c0d10df3bb7e, role_id=2e4889bb71f9434392c0baba59f2534e)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:45.511501 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff484ba-bf07-4ae8-a6fa-b9d9a8bc0081 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:45.522655 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1373/2753] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 01:26:45 2022] PUT /identity/v3/projects/f0dbd889720841d2907929ac5e491c60/users/63b42f3862dd4efb8264c0d10df3bb7e/roles/2e4889bb71f9434392c0baba59f2534e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:26:49.824018 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6363cd96-ac02-4273-b2d3-35cf7bcac3f6 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:49.824443 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6363cd96-ac02-4273-b2d3-35cf7bcac3f6 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:49.824700 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6363cd96-ac02-4273-b2d3-35cf7bcac3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:49.861093 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-6363cd96-ac02-4273-b2d3-35cf7bcac3f6 None None] MFA Rules not processed for user `63b42f3862dd4efb8264c0d10df3bb7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:26:49.862338 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-6363cd96-ac02-4273-b2d3-35cf7bcac3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:49.903864 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:26:49.965055 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1381/2754] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:26:49 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:26:49.983861 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff484ba-bf07-4ae8-a6fa-b9d9a8bc0081 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:49.985874 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-0ff484ba-bf07-4ae8-a6fa-b9d9a8bc0081 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:50.059083 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:26:50.099897 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff484ba-bf07-4ae8-a6fa-b9d9a8bc0081 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:50.107328 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685139bf-cdbc-4b6b-ac10-9f2f4e881e05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:50.108403 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685139bf-cdbc-4b6b-ac10-9f2f4e881e05 service nova] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:50.108841 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685139bf-cdbc-4b6b-ac10-9f2f4e881e05 service nova] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:50.109297 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685139bf-cdbc-4b6b-ac10-9f2f4e881e05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:50.187730 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685139bf-cdbc-4b6b-ac10-9f2f4e881e05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:50.190016 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685139bf-cdbc-4b6b-ac10-9f2f4e881e05 service nova] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:50.222453 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1374/2755] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:26:49 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:26:50.283692 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df32d48-0568-4ffd-ad1d-15deb06831be None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:50.283940 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df32d48-0568-4ffd-ad1d-15deb06831be None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:50.284219 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df32d48-0568-4ffd-ad1d-15deb06831be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:50.311484 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-2df32d48-0568-4ffd-ad1d-15deb06831be None None] MFA Rules not processed for user `c85ba998310648b3b9b79abafa8737fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:26:50.312409 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-2df32d48-0568-4ffd-ad1d-15deb06831be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:50.321241 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1382/2756] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:26:50 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:26:50.623502 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685139bf-cdbc-4b6b-ac10-9f2f4e881e05 service nova] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:26:50.625020 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-685139bf-cdbc-4b6b-ac10-9f2f4e881e05 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:50.683895 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685139bf-cdbc-4b6b-ac10-9f2f4e881e05 service nova] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:26:50.687979 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d392269a-0d02-4d7a-b66a-717d08a99e25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:26:50.688595 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392269a-0d02-4d7a-b66a-717d08a99e25 service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:26:50.688870 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392269a-0d02-4d7a-b66a-717d08a99e25 service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:26:50.689143 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d392269a-0d02-4d7a-b66a-717d08a99e25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:26:50.690928 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-d392269a-0d02-4d7a-b66a-717d08a99e25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:26:50.701022 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d392269a-0d02-4d7a-b66a-717d08a99e25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:26:50.702469 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d392269a-0d02-4d7a-b66a-717d08a99e25 service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:26:50.710924 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1375/2757] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:26:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:27:00.305209 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=19 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:27:00.707238 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=60 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:27:00.881094 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df32d48-0568-4ffd-ad1d-15deb06831be None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:00.882895 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-2df32d48-0568-4ffd-ad1d-15deb06831be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:00.972942 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df32d48-0568-4ffd-ad1d-15deb06831be None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:00.977555 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3450be9-feb7-4b39-b71c-4aa67cc27282 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '95355adb5a6a4a69a31904247eac6d69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:00.978164 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3450be9-feb7-4b39-b71c-4aa67cc27282 service cinder] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:00.978435 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3450be9-feb7-4b39-b71c-4aa67cc27282 service cinder] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:00.978709 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3450be9-feb7-4b39-b71c-4aa67cc27282 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:00.988134 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3450be9-feb7-4b39-b71c-4aa67cc27282 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:00.989658 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3450be9-feb7-4b39-b71c-4aa67cc27282 service cinder] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:01.000912 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1383/2758] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:27:00 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:27:10.996049 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=35 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:27:26.391276 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d392269a-0d02-4d7a-b66a-717d08a99e25 service neutron] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:27:26.393088 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-d392269a-0d02-4d7a-b66a-717d08a99e25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:26.514586 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d392269a-0d02-4d7a-b66a-717d08a99e25 service neutron] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:27:26.520287 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b13675-3605-433c-a07f-1cff23fcd8a4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4fc1d11f5641b0b5f301b234282aa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:27:26.521052 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b13675-3605-433c-a07f-1cff23fcd8a4 service placement] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:26.521425 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b13675-3605-433c-a07f-1cff23fcd8a4 service placement] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:26.522171 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b13675-3605-433c-a07f-1cff23fcd8a4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:26.523655 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-f1b13675-3605-433c-a07f-1cff23fcd8a4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:26.536672 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b13675-3605-433c-a07f-1cff23fcd8a4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:27:26.538279 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b13675-3605-433c-a07f-1cff23fcd8a4 service placement] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:27:26.549099 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1376/2759] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:27:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:27:27.653748 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b6d6a-614a-4e5e-a646-e4547f54aca3 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:27:27.654302 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b6d6a-614a-4e5e-a646-e4547f54aca3 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:27:27.654302 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b6d6a-614a-4e5e-a646-e4547f54aca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:27:27.674084 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-491b6d6a-614a-4e5e-a646-e4547f54aca3 None None] MFA Rules not processed for user `c85ba998310648b3b9b79abafa8737fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:27:27.675287 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-491b6d6a-614a-4e5e-a646-e4547f54aca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:27:27.682376 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1384/2760] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:27:27 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:27:36.544326 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=41 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:27:37.669569 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=3 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:28:03.266922 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c881ad5e-8c97-4c5c-8735-124b8f85ac56 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:03.267512 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c881ad5e-8c97-4c5c-8735-124b8f85ac56 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:03.267512 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c881ad5e-8c97-4c5c-8735-124b8f85ac56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:03.287460 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-c881ad5e-8c97-4c5c-8735-124b8f85ac56 None None] MFA Rules not processed for user `c85ba998310648b3b9b79abafa8737fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:28:03.288828 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-c881ad5e-8c97-4c5c-8735-124b8f85ac56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:03.296463 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1377/2761] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:28:03 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:28:13.282055 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=3 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:28:45.917493 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b6d6a-614a-4e5e-a646-e4547f54aca3 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:46.002497 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b6d6a-614a-4e5e-a646-e4547f54aca3 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:46.007133 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4086994-b243-4288-b7ba-0f4bffd2acf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:46.007774 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4086994-b243-4288-b7ba-0f4bffd2acf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:46.008026 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4086994-b243-4288-b7ba-0f4bffd2acf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:46.008326 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4086994-b243-4288-b7ba-0f4bffd2acf6 admin admin] PATH_INFO: `/v3/users/c85ba998310648b3b9b79abafa8737fb` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:46.009493 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4086994-b243-4288-b7ba-0f4bffd2acf6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c85ba998310648b3b9b79abafa8737fb)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:46.011425 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4086994-b243-4288-b7ba-0f4bffd2acf6 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:46.071575 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-d4086994-b243-4288-b7ba-0f4bffd2acf6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c85ba998310648b3b9b79abafa8737fb'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:46.084364 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-d4086994-b243-4288-b7ba-0f4bffd2acf6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c85ba998310648b3b9b79abafa8737fb'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:46.093116 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-d4086994-b243-4288-b7ba-0f4bffd2acf6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c85ba998310648b3b9b79abafa8737fb'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:46.093742 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-d4086994-b243-4288-b7ba-0f4bffd2acf6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c85ba998310648b3b9b79abafa8737fb'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:46.094347 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-d4086994-b243-4288-b7ba-0f4bffd2acf6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c85ba998310648b3b9b79abafa8737fb'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:46.107503 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1385/2762] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 01:28:45 2022] DELETE /identity/v3/users/c85ba998310648b3b9b79abafa8737fb => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:28:46.304682 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c881ad5e-8c97-4c5c-8735-124b8f85ac56 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:46.319632 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c881ad5e-8c97-4c5c-8735-124b8f85ac56 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:46.382191 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fca510-3bc0-4701-a593-8c62456a144d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:46.382984 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fca510-3bc0-4701-a593-8c62456a144d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:46.383259 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fca510-3bc0-4701-a593-8c62456a144d admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:46.383594 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fca510-3bc0-4701-a593-8c62456a144d admin admin] PATH_INFO: `/v3/projects/a93174cb259e4694948ca5ba6b11ab9b` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:46.384842 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fca510-3bc0-4701-a593-8c62456a144d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a93174cb259e4694948ca5ba6b11ab9b)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:46.387007 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fca510-3bc0-4701-a593-8c62456a144d admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:46.439004 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-10fca510-3bc0-4701-a593-8c62456a144d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a93174cb259e4694948ca5ba6b11ab9b', 'request_id': 'req-10fca510-3bc0-4701-a593-8c62456a144d'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:46.445319 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-10fca510-3bc0-4701-a593-8c62456a144d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a93174cb259e4694948ca5ba6b11ab9b', 'request_id': 'req-10fca510-3bc0-4701-a593-8c62456a144d'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:46.455036 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-10fca510-3bc0-4701-a593-8c62456a144d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a93174cb259e4694948ca5ba6b11ab9b', 'request_id': 'req-10fca510-3bc0-4701-a593-8c62456a144d'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:46.483335 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-10fca510-3bc0-4701-a593-8c62456a144d admin admin] The token cache is being invalidate because project a93174cb259e4694948ca5ba6b11ab9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81808) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:28:46.483578 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-10fca510-3bc0-4701-a593-8c62456a144d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:46.484286 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-10fca510-3bc0-4701-a593-8c62456a144d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:46.485892 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1378/2763] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 01:28:46 2022] DELETE /identity/v3/projects/a93174cb259e4694948ca5ba6b11ab9b => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:28:46.490210 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4086994-b243-4288-b7ba-0f4bffd2acf6 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:46.491896 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-d4086994-b243-4288-b7ba-0f4bffd2acf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:46.506516 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4086994-b243-4288-b7ba-0f4bffd2acf6 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:46.567305 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d01b5e-c3cc-4f0a-a1d5-4ae6d41cf743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:46.567996 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d01b5e-c3cc-4f0a-a1d5-4ae6d41cf743 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:46.568283 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d01b5e-c3cc-4f0a-a1d5-4ae6d41cf743 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:46.568530 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d01b5e-c3cc-4f0a-a1d5-4ae6d41cf743 admin admin] PATH_INFO: `/v3/users/63b42f3862dd4efb8264c0d10df3bb7e` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:46.569706 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d01b5e-c3cc-4f0a-a1d5-4ae6d41cf743 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63b42f3862dd4efb8264c0d10df3bb7e)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:46.571731 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d01b5e-c3cc-4f0a-a1d5-4ae6d41cf743 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:46.574593 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:28:46.649002 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-64d01b5e-c3cc-4f0a-a1d5-4ae6d41cf743 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63b42f3862dd4efb8264c0d10df3bb7e'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:46.661625 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-64d01b5e-c3cc-4f0a-a1d5-4ae6d41cf743 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63b42f3862dd4efb8264c0d10df3bb7e'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:46.672463 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-64d01b5e-c3cc-4f0a-a1d5-4ae6d41cf743 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63b42f3862dd4efb8264c0d10df3bb7e'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:46.674891 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-64d01b5e-c3cc-4f0a-a1d5-4ae6d41cf743 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63b42f3862dd4efb8264c0d10df3bb7e'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:46.675533 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-64d01b5e-c3cc-4f0a-a1d5-4ae6d41cf743 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63b42f3862dd4efb8264c0d10df3bb7e'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:46.694516 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1386/2764] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 01:28:46 2022] DELETE /identity/v3/users/63b42f3862dd4efb8264c0d10df3bb7e => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:28:46.900804 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fca510-3bc0-4701-a593-8c62456a144d admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:46.902788 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-10fca510-3bc0-4701-a593-8c62456a144d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:46.916265 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fca510-3bc0-4701-a593-8c62456a144d admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:46.978129 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a9247-461d-445e-b7ce-753873b1ed95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:46.978935 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a9247-461d-445e-b7ce-753873b1ed95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:46.979258 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a9247-461d-445e-b7ce-753873b1ed95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:46.979610 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a9247-461d-445e-b7ce-753873b1ed95 admin admin] PATH_INFO: `/v3/projects/f0dbd889720841d2907929ac5e491c60` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:46.981205 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25a9247-461d-445e-b7ce-753873b1ed95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0dbd889720841d2907929ac5e491c60)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:46.983242 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25a9247-461d-445e-b7ce-753873b1ed95 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:47.008248 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:28:47.036949 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-e25a9247-461d-445e-b7ce-753873b1ed95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0dbd889720841d2907929ac5e491c60', 'request_id': 'req-e25a9247-461d-445e-b7ce-753873b1ed95'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:47.043861 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-e25a9247-461d-445e-b7ce-753873b1ed95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0dbd889720841d2907929ac5e491c60', 'request_id': 'req-e25a9247-461d-445e-b7ce-753873b1ed95'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:47.053343 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-e25a9247-461d-445e-b7ce-753873b1ed95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0dbd889720841d2907929ac5e491c60', 'request_id': 'req-e25a9247-461d-445e-b7ce-753873b1ed95'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:47.067164 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-e25a9247-461d-445e-b7ce-753873b1ed95 admin admin] The token cache is being invalidate because project f0dbd889720841d2907929ac5e491c60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81808) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:28:47.067565 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-e25a9247-461d-445e-b7ce-753873b1ed95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:47.068799 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-e25a9247-461d-445e-b7ce-753873b1ed95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:28:47.071255 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1379/2765] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 01:28:46 2022] DELETE /identity/v3/projects/f0dbd889720841d2907929ac5e491c60 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:28:47.076627 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b508fa-a04d-4c75-b88d-a6c65b9a8a3e None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:47.077140 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b508fa-a04d-4c75-b88d-a6c65b9a8a3e None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:47.077140 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b508fa-a04d-4c75-b88d-a6c65b9a8a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:47.107324 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-42b508fa-a04d-4c75-b88d-a6c65b9a8a3e None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:28:47.108599 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-42b508fa-a04d-4c75-b88d-a6c65b9a8a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:47.179779 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1387/2766] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:28:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:28:47.189361 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eabd391-b348-4105-8b7d-5d9b2ec96d81 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:47.189655 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eabd391-b348-4105-8b7d-5d9b2ec96d81 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:47.189898 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eabd391-b348-4105-8b7d-5d9b2ec96d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:47.209867 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-9eabd391-b348-4105-8b7d-5d9b2ec96d81 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:28:47.211104 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-9eabd391-b348-4105-8b7d-5d9b2ec96d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:47.219608 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1380/2767] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:28:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:28:47.225002 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b508fa-a04d-4c75-b88d-a6c65b9a8a3e None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:47.234905 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b508fa-a04d-4c75-b88d-a6c65b9a8a3e None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:47.239424 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed4a1ec-0ab3-418e-8962-cb4e27e833fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:47.240062 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed4a1ec-0ab3-418e-8962-cb4e27e833fa admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:47.240336 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed4a1ec-0ab3-418e-8962-cb4e27e833fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:47.240604 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed4a1ec-0ab3-418e-8962-cb4e27e833fa admin admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:47.241255 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed4a1ec-0ab3-418e-8962-cb4e27e833fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:28:47.241552 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed4a1ec-0ab3-418e-8962-cb4e27e833fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:47.243171 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed4a1ec-0ab3-418e-8962-cb4e27e833fa admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:47.254805 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1388/2768] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 01:28:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:28:47.261047 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eabd391-b348-4105-8b7d-5d9b2ec96d81 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:47.274927 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eabd391-b348-4105-8b7d-5d9b2ec96d81 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:47.281990 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15da7d51-7b64-4686-ba87-e6859ccfa567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:47.282600 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da7d51-7b64-4686-ba87-e6859ccfa567 admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:47.282883 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da7d51-7b64-4686-ba87-e6859ccfa567 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:47.283155 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15da7d51-7b64-4686-ba87-e6859ccfa567 admin admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:47.283828 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15da7d51-7b64-4686-ba87-e6859ccfa567 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:47.285753 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15da7d51-7b64-4686-ba87-e6859ccfa567 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:47.318000 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1381/2769] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 01:28:47 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:28:47.322459 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed4a1ec-0ab3-418e-8962-cb4e27e833fa admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:47.333564 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed4a1ec-0ab3-418e-8962-cb4e27e833fa admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:47.390677 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7173e867-6396-4a75-96c5-9c64c09a37b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:47.391287 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173e867-6396-4a75-96c5-9c64c09a37b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:47.391569 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173e867-6396-4a75-96c5-9c64c09a37b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:47.391867 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173e867-6396-4a75-96c5-9c64c09a37b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:47.392526 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7173e867-6396-4a75-96c5-9c64c09a37b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:47.394433 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7173e867-6396-4a75-96c5-9c64c09a37b4 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:47.403833 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:28:47.418342 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1389/2770] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 01:28:47 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:28:47.422306 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15da7d51-7b64-4686-ba87-e6859ccfa567 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:47.433038 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15da7d51-7b64-4686-ba87-e6859ccfa567 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:47.438919 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe9f60e-f510-424e-9169-00a3f9a3b870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:47.439562 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9f60e-f510-424e-9169-00a3f9a3b870 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:47.439960 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9f60e-f510-424e-9169-00a3f9a3b870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:47.440234 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9f60e-f510-424e-9169-00a3f9a3b870 admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:47.440888 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe9f60e-f510-424e-9169-00a3f9a3b870 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:47.442506 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe9f60e-f510-424e-9169-00a3f9a3b870 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:47.453179 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1382/2771] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:28:47.457252 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7173e867-6396-4a75-96c5-9c64c09a37b4 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:47.469790 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7173e867-6396-4a75-96c5-9c64c09a37b4 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:47.474907 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4230617f-e886-4ca6-8668-d1461320e58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:47.475525 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4230617f-e886-4ca6-8668-d1461320e58c admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:47.475848 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4230617f-e886-4ca6-8668-d1461320e58c admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:47.476123 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4230617f-e886-4ca6-8668-d1461320e58c admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:47.476773 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4230617f-e886-4ca6-8668-d1461320e58c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:47.478407 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4230617f-e886-4ca6-8668-d1461320e58c admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:47.489899 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1390/2772] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:28:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:28:47.494466 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe9f60e-f510-424e-9169-00a3f9a3b870 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:47.505586 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe9f60e-f510-424e-9169-00a3f9a3b870 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:47.511769 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fbda9e-ee4a-488e-b38b-eb11fa546694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:47.512423 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fbda9e-ee4a-488e-b38b-eb11fa546694 admin admin] REQUEST_METHOD: `PUT` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:47.512750 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fbda9e-ee4a-488e-b38b-eb11fa546694 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:47.513029 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fbda9e-ee4a-488e-b38b-eb11fa546694 admin admin] PATH_INFO: `/v3/projects/e054a46dcce4403c8de19c698f713b7c/users/1b0ee1f818e24ed1a70734c9bf9af1eb/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:47.530889 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fbda9e-ee4a-488e-b38b-eb11fa546694 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e054a46dcce4403c8de19c698f713b7c, user_id=1b0ee1f818e24ed1a70734c9bf9af1eb, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:47.533613 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fbda9e-ee4a-488e-b38b-eb11fa546694 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:47.548964 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1383/2773] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 01:28:47 2022] PUT /identity/v3/projects/e054a46dcce4403c8de19c698f713b7c/users/1b0ee1f818e24ed1a70734c9bf9af1eb/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:28:47.554882 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb3c6e-619e-404e-abee-71227f8d0e7f None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:47.555255 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb3c6e-619e-404e-abee-71227f8d0e7f None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:47.555580 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb3c6e-619e-404e-abee-71227f8d0e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:47.581026 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-bcdb3c6e-619e-404e-abee-71227f8d0e7f None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:28:47.582236 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-bcdb3c6e-619e-404e-abee-71227f8d0e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:47.646414 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1391/2774] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:28:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:28:47.658164 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fbda9e-ee4a-488e-b38b-eb11fa546694 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:47.660099 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-03fbda9e-ee4a-488e-b38b-eb11fa546694 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:47.743159 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fbda9e-ee4a-488e-b38b-eb11fa546694 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:47.747460 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86139f4c-5ae4-4aaf-a360-926edb46ca90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:47.748114 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86139f4c-5ae4-4aaf-a360-926edb46ca90 service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:47.748386 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86139f4c-5ae4-4aaf-a360-926edb46ca90 service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:47.748656 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86139f4c-5ae4-4aaf-a360-926edb46ca90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:47.758032 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86139f4c-5ae4-4aaf-a360-926edb46ca90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:47.759483 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86139f4c-5ae4-4aaf-a360-926edb46ca90 service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:47.769002 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1384/2775] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:28:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:28:52.042536 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e874eea-ca51-41a4-bb03-928f07845c2b None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:52.043126 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e874eea-ca51-41a4-bb03-928f07845c2b None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:52.043126 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e874eea-ca51-41a4-bb03-928f07845c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:52.079394 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-9e874eea-ca51-41a4-bb03-928f07845c2b None None] MFA Rules not processed for user `1b0ee1f818e24ed1a70734c9bf9af1eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:28:52.080936 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-9e874eea-ca51-41a4-bb03-928f07845c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:52.149034 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1392/2776] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:28:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:28:52.153937 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86139f4c-5ae4-4aaf-a360-926edb46ca90 service neutron] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:52.164194 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86139f4c-5ae4-4aaf-a360-926edb46ca90 service neutron] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:52.169314 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a098db30-7180-449e-a999-e848e3b97196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:52.169926 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a098db30-7180-449e-a999-e848e3b97196 admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:52.170224 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a098db30-7180-449e-a999-e848e3b97196 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:52.170489 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a098db30-7180-449e-a999-e848e3b97196 admin admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:52.171134 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a098db30-7180-449e-a999-e848e3b97196 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:52.173072 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a098db30-7180-449e-a999-e848e3b97196 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:52.208915 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1385/2777] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 01:28:52 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:28:52.210122 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e874eea-ca51-41a4-bb03-928f07845c2b None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:52.221593 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e874eea-ca51-41a4-bb03-928f07845c2b None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:52.281625 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f4d5e-12bf-4269-8d0f-3cc531a18916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:52.282529 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f4d5e-12bf-4269-8d0f-3cc531a18916 admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:52.282812 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f4d5e-12bf-4269-8d0f-3cc531a18916 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:52.283232 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f4d5e-12bf-4269-8d0f-3cc531a18916 admin admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:52.284029 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5f4d5e-12bf-4269-8d0f-3cc531a18916 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:52.287093 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5f4d5e-12bf-4269-8d0f-3cc531a18916 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:52.310885 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:28:52.317111 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1393/2778] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 01:28:52 2022] POST /identity/v3/users => generated 298 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:28:52.321720 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a098db30-7180-449e-a999-e848e3b97196 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:52.338275 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a098db30-7180-449e-a999-e848e3b97196 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:52.344381 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a61097-81f9-4705-8e6f-994b73b5d0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:52.345130 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a61097-81f9-4705-8e6f-994b73b5d0a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:52.345495 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a61097-81f9-4705-8e6f-994b73b5d0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:52.345838 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a61097-81f9-4705-8e6f-994b73b5d0a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:52.346564 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a61097-81f9-4705-8e6f-994b73b5d0a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:52.348512 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a61097-81f9-4705-8e6f-994b73b5d0a8 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:52.350220 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:28:52.361265 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1386/2779] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:28:52 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:28:52.365624 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f4d5e-12bf-4269-8d0f-3cc531a18916 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:52.376929 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f4d5e-12bf-4269-8d0f-3cc531a18916 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:52.382280 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815dd58b-97bb-428f-8755-2569fc80ef0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:52.383048 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815dd58b-97bb-428f-8755-2569fc80ef0c admin admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:52.383397 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815dd58b-97bb-428f-8755-2569fc80ef0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:52.383830 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815dd58b-97bb-428f-8755-2569fc80ef0c admin admin] PATH_INFO: `/v3/projects/b3e0416856cc4610a10d1fa49e26a7dc/users/f73244e0cc2b413da2d23efad835be7b/roles/2e4889bb71f9434392c0baba59f2534e` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:52.402486 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815dd58b-97bb-428f-8755-2569fc80ef0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3e0416856cc4610a10d1fa49e26a7dc, user_id=f73244e0cc2b413da2d23efad835be7b, role_id=2e4889bb71f9434392c0baba59f2534e)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:52.405444 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815dd58b-97bb-428f-8755-2569fc80ef0c admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:52.421735 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1394/2780] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 01:28:52 2022] PUT /identity/v3/projects/b3e0416856cc4610a10d1fa49e26a7dc/users/f73244e0cc2b413da2d23efad835be7b/roles/2e4889bb71f9434392c0baba59f2534e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:28:52.426512 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a61097-81f9-4705-8e6f-994b73b5d0a8 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:52.437845 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a61097-81f9-4705-8e6f-994b73b5d0a8 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:52.512898 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061446bc-ba57-4e06-9837-a680ce679b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:52.513530 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061446bc-ba57-4e06-9837-a680ce679b21 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:52.513833 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061446bc-ba57-4e06-9837-a680ce679b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:52.514104 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061446bc-ba57-4e06-9837-a680ce679b21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:52.514760 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061446bc-ba57-4e06-9837-a680ce679b21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:52.516396 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061446bc-ba57-4e06-9837-a680ce679b21 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:52.528030 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1387/2781] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:28:52 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:28:52.532343 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815dd58b-97bb-428f-8755-2569fc80ef0c admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:52.543710 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815dd58b-97bb-428f-8755-2569fc80ef0c admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:52.548598 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07fda0b-45bd-4fb9-b6db-da5e52f72f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:52.549336 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07fda0b-45bd-4fb9-b6db-da5e52f72f0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:52.549707 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07fda0b-45bd-4fb9-b6db-da5e52f72f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:52.550066 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07fda0b-45bd-4fb9-b6db-da5e52f72f0b admin admin] PATH_INFO: `/v3/projects/b3e0416856cc4610a10d1fa49e26a7dc/users/f73244e0cc2b413da2d23efad835be7b/roles/2e4889bb71f9434392c0baba59f2534e` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:52.552179 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07fda0b-45bd-4fb9-b6db-da5e52f72f0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3e0416856cc4610a10d1fa49e26a7dc, user_id=f73244e0cc2b413da2d23efad835be7b, role_id=2e4889bb71f9434392c0baba59f2534e)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:52.554927 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07fda0b-45bd-4fb9-b6db-da5e52f72f0b admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:52.566412 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1395/2782] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 01:28:52 2022] PUT /identity/v3/projects/b3e0416856cc4610a10d1fa49e26a7dc/users/f73244e0cc2b413da2d23efad835be7b/roles/2e4889bb71f9434392c0baba59f2534e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:28:57.251297 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f37092-6fd8-4d6f-9d16-8e71d5696c85 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:57.251916 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f37092-6fd8-4d6f-9d16-8e71d5696c85 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:57.252114 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f37092-6fd8-4d6f-9d16-8e71d5696c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:57.283688 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-39f37092-6fd8-4d6f-9d16-8e71d5696c85 None None] MFA Rules not processed for user `f73244e0cc2b413da2d23efad835be7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:28:57.285170 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-39f37092-6fd8-4d6f-9d16-8e71d5696c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:57.365007 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1388/2783] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:28:57 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:28:57.378240 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07fda0b-45bd-4fb9-b6db-da5e52f72f0b admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:57.380138 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-a07fda0b-45bd-4fb9-b6db-da5e52f72f0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:57.486069 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07fda0b-45bd-4fb9-b6db-da5e52f72f0b admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:57.490231 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8218f7e-5f7d-4a58-97b6-26778b946843 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22053bd9632346aab63814f740415f69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:57.490855 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8218f7e-5f7d-4a58-97b6-26778b946843 service glance] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:57.491129 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8218f7e-5f7d-4a58-97b6-26778b946843 service glance] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:57.491400 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8218f7e-5f7d-4a58-97b6-26778b946843 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:57.551655 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8218f7e-5f7d-4a58-97b6-26778b946843 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:57.553204 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8218f7e-5f7d-4a58-97b6-26778b946843 service glance] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:57.563520 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1396/2784] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:28:57 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:28:57.699295 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f8232-876e-465a-b3d0-0143d006c052 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:57.699887 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f8232-876e-465a-b3d0-0143d006c052 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:57.700358 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f8232-876e-465a-b3d0-0143d006c052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:57.767750 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-de3f8232-876e-465a-b3d0-0143d006c052 None None] MFA Rules not processed for user `cbe0653ed0c04a9080b5c337392de8ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:28:57.768984 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-de3f8232-876e-465a-b3d0-0143d006c052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:57.812691 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:28:57.845707 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1389/2785] 10.222.0.49 () {58 vars in 1009 bytes} [Sun Aug 28 01:28:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:28:57.889796 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8218f7e-5f7d-4a58-97b6-26778b946843 service glance] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:28:57.891226 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-b8218f7e-5f7d-4a58-97b6-26778b946843 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:28:57.956668 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:28:57.991548 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8218f7e-5f7d-4a58-97b6-26778b946843 service glance] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:28:57.997862 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb13cb2e-237d-4ff9-8375-c75c25e0d4af service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ce463b940db4f83a6df7e0561a88567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:28:57.998489 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13cb2e-237d-4ff9-8375-c75c25e0d4af service swift] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:28:57.998763 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13cb2e-237d-4ff9-8375-c75c25e0d4af service swift] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:28:57.999034 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13cb2e-237d-4ff9-8375-c75c25e0d4af service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:28:58.010471 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb13cb2e-237d-4ff9-8375-c75c25e0d4af service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:28:58.012750 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb13cb2e-237d-4ff9-8375-c75c25e0d4af service swift] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:28:58.025693 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1397/2786] 10.222.0.49 () {60 vars in 1384 bytes} [Sun Aug 28 01:28:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:29:06.722541 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0d1a1-84b3-48f5-8281-a9f1b4bd95c0 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:06.723016 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0d1a1-84b3-48f5-8281-a9f1b4bd95c0 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:06.723132 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0d1a1-84b3-48f5-8281-a9f1b4bd95c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:06.745328 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-0ab0d1a1-84b3-48f5-8281-a9f1b4bd95c0 None None] MFA Rules not processed for user `1b0ee1f818e24ed1a70734c9bf9af1eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:29:06.746862 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-0ab0d1a1-84b3-48f5-8281-a9f1b4bd95c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:29:06.754683 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1390/2787] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:29:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:29:07.366343 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb13cb2e-237d-4ff9-8375-c75c25e0d4af service swift] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:29:07.367910 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-eb13cb2e-237d-4ff9-8375-c75c25e0d4af service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:29:07.426773 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb13cb2e-237d-4ff9-8375-c75c25e0d4af service swift] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:29:07.431404 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c4df7-34b5-4429-bb59-742abaa143f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:29:07.432061 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c4df7-34b5-4429-bb59-742abaa143f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:07.432335 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c4df7-34b5-4429-bb59-742abaa143f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:07.432602 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c4df7-34b5-4429-bb59-742abaa143f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:07.434744 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-053c4df7-34b5-4429-bb59-742abaa143f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:29:07.534411 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053c4df7-34b5-4429-bb59-742abaa143f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:29:07.535952 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053c4df7-34b5-4429-bb59-742abaa143f1 service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:29:07.563734 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1398/2788] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:29:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:29:08.775707 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f13a0-def2-4b83-a8af-12fa3dc6d907 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:08.776267 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f13a0-def2-4b83-a8af-12fa3dc6d907 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:08.776267 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f13a0-def2-4b83-a8af-12fa3dc6d907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:08.795776 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-453f13a0-def2-4b83-a8af-12fa3dc6d907 None None] MFA Rules not processed for user `cbe0653ed0c04a9080b5c337392de8ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:29:08.797002 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-453f13a0-def2-4b83-a8af-12fa3dc6d907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:29:08.804354 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1391/2789] 10.222.0.49 () {58 vars in 1009 bytes} [Sun Aug 28 01:29:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:29:08.817306 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c4df7-34b5-4429-bb59-742abaa143f1 service neutron] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:29:08.829415 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c4df7-34b5-4429-bb59-742abaa143f1 service neutron] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:29:08.835680 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a779b3db-9f2d-47a1-b846-8572ca99d131 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ce463b940db4f83a6df7e0561a88567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:29:08.836429 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779b3db-9f2d-47a1-b846-8572ca99d131 service swift] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:08.836765 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779b3db-9f2d-47a1-b846-8572ca99d131 service swift] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:08.837096 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a779b3db-9f2d-47a1-b846-8572ca99d131 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:08.846226 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a779b3db-9f2d-47a1-b846-8572ca99d131 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:29:08.847856 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a779b3db-9f2d-47a1-b846-8572ca99d131 service swift] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:29:08.856660 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1399/2790] 10.222.0.49 () {60 vars in 1384 bytes} [Sun Aug 28 01:29:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:29:16.537088 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f13a0-def2-4b83-a8af-12fa3dc6d907 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:29:16.548143 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f13a0-def2-4b83-a8af-12fa3dc6d907 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:29:16.552527 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeeb10d-0d79-4c4e-be72-9511c85f7d26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:29:16.553143 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeeb10d-0d79-4c4e-be72-9511c85f7d26 service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:16.553413 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeeb10d-0d79-4c4e-be72-9511c85f7d26 service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:16.553661 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeeb10d-0d79-4c4e-be72-9511c85f7d26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:16.555694 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-8eeeb10d-0d79-4c4e-be72-9511c85f7d26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:29:16.566809 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeeb10d-0d79-4c4e-be72-9511c85f7d26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:29:16.568301 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeeb10d-0d79-4c4e-be72-9511c85f7d26 service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:29:16.577135 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1392/2791] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:29:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:29:18.853419 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=84 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:29:19.386954 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a779b3db-9f2d-47a1-b846-8572ca99d131 service swift] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:29:19.397968 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a779b3db-9f2d-47a1-b846-8572ca99d131 service swift] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:29:19.402560 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a2ca9-05ce-4727-b8db-9f0748efc927 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:29:19.403176 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a2ca9-05ce-4727-b8db-9f0748efc927 service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:19.403450 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a2ca9-05ce-4727-b8db-9f0748efc927 service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:19.403905 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a2ca9-05ce-4727-b8db-9f0748efc927 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:19.406106 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-fd2a2ca9-05ce-4727-b8db-9f0748efc927 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:29:19.421062 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2a2ca9-05ce-4727-b8db-9f0748efc927 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:29:19.422549 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2a2ca9-05ce-4727-b8db-9f0748efc927 service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:29:19.435212 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1400/2792] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:29:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:29:26.573067 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=24 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:29:29.429359 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=6 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:29:42.310544 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeeb10d-0d79-4c4e-be72-9511c85f7d26 service neutron] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:29:42.319960 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeeb10d-0d79-4c4e-be72-9511c85f7d26 service neutron] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:29:42.324625 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a39f0d0-0bcf-41cb-aa5c-1b22cb6e69cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:29:42.325234 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39f0d0-0bcf-41cb-aa5c-1b22cb6e69cb service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:42.325512 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39f0d0-0bcf-41cb-aa5c-1b22cb6e69cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:42.325784 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39f0d0-0bcf-41cb-aa5c-1b22cb6e69cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:42.335590 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a39f0d0-0bcf-41cb-aa5c-1b22cb6e69cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:29:42.337059 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a39f0d0-0bcf-41cb-aa5c-1b22cb6e69cb service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:29:42.346728 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1393/2793] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:29:42 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:29:46.375977 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a2ca9-05ce-4727-b8db-9f0748efc927 service neutron] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:29:46.377520 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-fd2a2ca9-05ce-4727-b8db-9f0748efc927 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:29:46.393644 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a2ca9-05ce-4727-b8db-9f0748efc927 service neutron] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:29:46.400764 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac27bcd-4b26-4695-8d74-b431b35d4bd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:29:46.401629 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac27bcd-4b26-4695-8d74-b431b35d4bd3 service nova] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:29:46.402066 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac27bcd-4b26-4695-8d74-b431b35d4bd3 service nova] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:29:46.402506 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac27bcd-4b26-4695-8d74-b431b35d4bd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:29:46.404589 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-5ac27bcd-4b26-4695-8d74-b431b35d4bd3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:29:46.419106 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac27bcd-4b26-4695-8d74-b431b35d4bd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:29:46.421251 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac27bcd-4b26-4695-8d74-b431b35d4bd3 service nova] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:29:46.436375 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1401/2794] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:29:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:29:52.342432 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=6 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:29:56.429806 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=6 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:32:32.417793 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a39f0d0-0bcf-41cb-aa5c-1b22cb6e69cb service neutron] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:32:32.419584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-0a39f0d0-0bcf-41cb-aa5c-1b22cb6e69cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:32:32.496939 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a39f0d0-0bcf-41cb-aa5c-1b22cb6e69cb service neutron] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:32:32.503309 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755333a7-f077-4f77-b0fd-805ba7ca9b1d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4fc1d11f5641b0b5f301b234282aa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:32:32.504107 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755333a7-f077-4f77-b0fd-805ba7ca9b1d service placement] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:32.504442 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755333a7-f077-4f77-b0fd-805ba7ca9b1d service placement] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:32.504723 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755333a7-f077-4f77-b0fd-805ba7ca9b1d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:32.507217 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-755333a7-f077-4f77-b0fd-805ba7ca9b1d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:32:32.525711 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755333a7-f077-4f77-b0fd-805ba7ca9b1d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:32:32.527306 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755333a7-f077-4f77-b0fd-805ba7ca9b1d service placement] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:32:32.538319 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1394/2795] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:32:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:32:41.373013 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac27bcd-4b26-4695-8d74-b431b35d4bd3 service nova] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:32:41.376090 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-5ac27bcd-4b26-4695-8d74-b431b35d4bd3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:32:41.406057 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac27bcd-4b26-4695-8d74-b431b35d4bd3 service nova] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:32:41.414862 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2234bf1d-e74f-49a7-b58f-b2d138173a93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:32:41.415620 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234bf1d-e74f-49a7-b58f-b2d138173a93 service nova] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:41.416901 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234bf1d-e74f-49a7-b58f-b2d138173a93 service nova] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:41.416901 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234bf1d-e74f-49a7-b58f-b2d138173a93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:41.420184 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-2234bf1d-e74f-49a7-b58f-b2d138173a93 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:32:41.436261 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2234bf1d-e74f-49a7-b58f-b2d138173a93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:32:41.438285 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2234bf1d-e74f-49a7-b58f-b2d138173a93 service nova] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:32:41.458854 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1402/2796] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:32:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:32:42.533252 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=32 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:32:51.453452 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=6 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:32:56.156626 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8263c15e-a534-42b5-b5df-2dd743845229 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:56.157118 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8263c15e-a534-42b5-b5df-2dd743845229 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:56.157219 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8263c15e-a534-42b5-b5df-2dd743845229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:56.180944 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-8263c15e-a534-42b5-b5df-2dd743845229 None None] MFA Rules not processed for user `cbe0653ed0c04a9080b5c337392de8ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:32:56.182525 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-8263c15e-a534-42b5-b5df-2dd743845229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:32:56.193121 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1395/2797] 10.222.0.49 () {58 vars in 967 bytes} [Sun Aug 28 01:32:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:32:56.241284 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2234bf1d-e74f-49a7-b58f-b2d138173a93 service nova] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:32:56.259362 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2234bf1d-e74f-49a7-b58f-b2d138173a93 service nova] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:32:56.265335 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678eb676-c06f-4d92-b34d-ae3eab58ef24 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ce463b940db4f83a6df7e0561a88567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:32:56.265929 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678eb676-c06f-4d92-b34d-ae3eab58ef24 service swift] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:56.266202 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678eb676-c06f-4d92-b34d-ae3eab58ef24 service swift] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:56.266462 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678eb676-c06f-4d92-b34d-ae3eab58ef24 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:56.276518 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678eb676-c06f-4d92-b34d-ae3eab58ef24 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:32:56.278903 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678eb676-c06f-4d92-b34d-ae3eab58ef24 service swift] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:32:56.288256 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1403/2798] 10.222.0.49 () {60 vars in 1384 bytes} [Sun Aug 28 01:32:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:32:56.856930 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e741c541-4e9a-47ff-a8d9-e731ad688c62 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:56.857220 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e741c541-4e9a-47ff-a8d9-e731ad688c62 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:56.857496 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e741c541-4e9a-47ff-a8d9-e731ad688c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:56.878089 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-e741c541-4e9a-47ff-a8d9-e731ad688c62 None None] MFA Rules not processed for user `cbe0653ed0c04a9080b5c337392de8ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:32:56.879488 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-e741c541-4e9a-47ff-a8d9-e731ad688c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:32:56.890102 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1396/2799] 10.222.0.49 () {58 vars in 1009 bytes} [Sun Aug 28 01:32:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:32:56.905624 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678eb676-c06f-4d92-b34d-ae3eab58ef24 service swift] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:32:56.919379 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678eb676-c06f-4d92-b34d-ae3eab58ef24 service swift] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:32:56.925826 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ddd975-fa81-4801-81b8-7aed53908482 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ce463b940db4f83a6df7e0561a88567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:32:56.926441 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ddd975-fa81-4801-81b8-7aed53908482 service swift] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:32:56.926721 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ddd975-fa81-4801-81b8-7aed53908482 service swift] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:32:56.926996 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ddd975-fa81-4801-81b8-7aed53908482 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:32:56.937040 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ddd975-fa81-4801-81b8-7aed53908482 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:32:56.938646 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ddd975-fa81-4801-81b8-7aed53908482 service swift] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:32:56.947637 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1404/2800] 10.222.0.49 () {60 vars in 1384 bytes} [Sun Aug 28 01:32:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:33:05.215475 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae0591-a3c0-4d65-8371-7276c4d9ce1b None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:05.216164 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae0591-a3c0-4d65-8371-7276c4d9ce1b None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:05.216164 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae0591-a3c0-4d65-8371-7276c4d9ce1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:05.235045 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-f4ae0591-a3c0-4d65-8371-7276c4d9ce1b None None] MFA Rules not processed for user `1b0ee1f818e24ed1a70734c9bf9af1eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:33:05.236285 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-f4ae0591-a3c0-4d65-8371-7276c4d9ce1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:05.243719 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1397/2801] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:33:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:33:05.534440 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ddd975-fa81-4801-81b8-7aed53908482 service swift] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:05.545462 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ddd975-fa81-4801-81b8-7aed53908482 service swift] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:05.549555 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94754b1d-cb5b-4f33-aa82-528c5f22cee7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:05.550149 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94754b1d-cb5b-4f33-aa82-528c5f22cee7 service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:05.550432 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94754b1d-cb5b-4f33-aa82-528c5f22cee7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:05.550705 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94754b1d-cb5b-4f33-aa82-528c5f22cee7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:05.552607 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-94754b1d-cb5b-4f33-aa82-528c5f22cee7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:05.562992 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94754b1d-cb5b-4f33-aa82-528c5f22cee7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:05.564451 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94754b1d-cb5b-4f33-aa82-528c5f22cee7 service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:05.572401 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1405/2802] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:33:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:33:05.937211 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ae0591-a3c0-4d65-8371-7276c4d9ce1b None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:05.949586 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ae0591-a3c0-4d65-8371-7276c4d9ce1b None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:05.954600 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0999604d-d7a8-49a5-8311-97158ae6137a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4fc1d11f5641b0b5f301b234282aa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:05.955216 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999604d-d7a8-49a5-8311-97158ae6137a service placement] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:05.955494 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999604d-d7a8-49a5-8311-97158ae6137a service placement] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:05.955821 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999604d-d7a8-49a5-8311-97158ae6137a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:05.957606 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-0999604d-d7a8-49a5-8311-97158ae6137a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:05.969863 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0999604d-d7a8-49a5-8311-97158ae6137a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:05.971358 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0999604d-d7a8-49a5-8311-97158ae6137a service placement] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:05.981823 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1398/2803] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:33:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:33:07.387708 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f2944-d0bd-4d31-8bef-ef8c584fe68a None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:07.388188 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f2944-d0bd-4d31-8bef-ef8c584fe68a None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:07.388385 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f2944-d0bd-4d31-8bef-ef8c584fe68a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:07.409731 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-177f2944-d0bd-4d31-8bef-ef8c584fe68a None None] MFA Rules not processed for user `cbe0653ed0c04a9080b5c337392de8ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:33:07.411103 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-177f2944-d0bd-4d31-8bef-ef8c584fe68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:07.419591 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1406/2804] 10.222.0.49 () {58 vars in 1009 bytes} [Sun Aug 28 01:33:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:33:07.431952 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0999604d-d7a8-49a5-8311-97158ae6137a service placement] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:07.444225 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0999604d-d7a8-49a5-8311-97158ae6137a service placement] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:07.451766 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6786c639-4b30-496f-86e3-a79cc3a9145d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ce463b940db4f83a6df7e0561a88567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:07.452405 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786c639-4b30-496f-86e3-a79cc3a9145d service swift] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:07.452661 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786c639-4b30-496f-86e3-a79cc3a9145d service swift] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:07.452924 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786c639-4b30-496f-86e3-a79cc3a9145d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:07.462019 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6786c639-4b30-496f-86e3-a79cc3a9145d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:07.463612 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6786c639-4b30-496f-86e3-a79cc3a9145d service swift] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:07.472518 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1399/2805] 10.222.0.49 () {60 vars in 1384 bytes} [Sun Aug 28 01:33:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:33:17.404327 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=21 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:17.469073 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=21 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:20.863837 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177f2944-d0bd-4d31-8bef-ef8c584fe68a None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:20.879687 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177f2944-d0bd-4d31-8bef-ef8c584fe68a None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:20.885273 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cab19e-3b47-436f-ba92-ecf0cf54c896 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:20.885971 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cab19e-3b47-436f-ba92-ecf0cf54c896 service nova] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:20.886318 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cab19e-3b47-436f-ba92-ecf0cf54c896 service nova] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:20.886663 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cab19e-3b47-436f-ba92-ecf0cf54c896 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:20.888444 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-07cab19e-3b47-436f-ba92-ecf0cf54c896 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:33:20.901728 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cab19e-3b47-436f-ba92-ecf0cf54c896 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:20.903399 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cab19e-3b47-436f-ba92-ecf0cf54c896 service nova] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:20.914797 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1407/2806] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:33:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:33:30.910250 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=6 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:33:58.018130 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6786c639-4b30-496f-86e3-a79cc3a9145d service swift] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:33:58.031344 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6786c639-4b30-496f-86e3-a79cc3a9145d service swift] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:33:58.039722 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e59987-3836-4bd8-b51f-d36979d6c280 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:33:58.040469 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e59987-3836-4bd8-b51f-d36979d6c280 service nova] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:33:58.040794 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e59987-3836-4bd8-b51f-d36979d6c280 service nova] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:33:58.041115 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e59987-3836-4bd8-b51f-d36979d6c280 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:33:58.050113 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e59987-3836-4bd8-b51f-d36979d6c280 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:33:58.051707 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e59987-3836-4bd8-b51f-d36979d6c280 service nova] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:33:58.061447 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1400/2807] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:33:58 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:34:08.057276 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=6 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:34:31.100211 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cab19e-3b47-436f-ba92-ecf0cf54c896 service nova] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:31.110664 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cab19e-3b47-436f-ba92-ecf0cf54c896 service nova] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:31.115396 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e7e279-3b73-4e8a-9bdf-7c986cd4353b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:31.116064 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7e279-3b73-4e8a-9bdf-7c986cd4353b service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:31.116366 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7e279-3b73-4e8a-9bdf-7c986cd4353b service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:31.116621 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7e279-3b73-4e8a-9bdf-7c986cd4353b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:31.125538 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e7e279-3b73-4e8a-9bdf-7c986cd4353b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:31.127055 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e7e279-3b73-4e8a-9bdf-7c986cd4353b service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:31.136080 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1408/2808] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:34:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:34:40.303594 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e59987-3836-4bd8-b51f-d36979d6c280 service nova] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:40.314379 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e59987-3836-4bd8-b51f-d36979d6c280 service nova] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:40.318971 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179703b4-5ea3-46b3-8bcb-fa3859c3faec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:40.319549 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179703b4-5ea3-46b3-8bcb-fa3859c3faec service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:40.319844 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179703b4-5ea3-46b3-8bcb-fa3859c3faec service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:40.320116 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179703b4-5ea3-46b3-8bcb-fa3859c3faec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:40.330880 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179703b4-5ea3-46b3-8bcb-fa3859c3faec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:40.332374 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179703b4-5ea3-46b3-8bcb-fa3859c3faec service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:40.343517 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1401/2809] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:34:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:34:41.131878 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=6 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:34:50.338456 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=6 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:34:52.244550 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e7e279-3b73-4e8a-9bdf-7c986cd4353b service neutron] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:52.254670 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e7e279-3b73-4e8a-9bdf-7c986cd4353b service neutron] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:52.259320 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6924962-95bf-49b9-ad45-89c5ccd21601 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:52.260238 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6924962-95bf-49b9-ad45-89c5ccd21601 service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:52.260539 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6924962-95bf-49b9-ad45-89c5ccd21601 service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:52.260867 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6924962-95bf-49b9-ad45-89c5ccd21601 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:52.277109 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6924962-95bf-49b9-ad45-89c5ccd21601 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:52.278654 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6924962-95bf-49b9-ad45-89c5ccd21601 service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:52.292438 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1409/2810] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:34:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:34:54.635023 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88971923-75f3-42e2-8641-9c6dd7baf83f None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:54.635559 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88971923-75f3-42e2-8641-9c6dd7baf83f None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:54.635692 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88971923-75f3-42e2-8641-9c6dd7baf83f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:54.656239 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-88971923-75f3-42e2-8641-9c6dd7baf83f None None] MFA Rules not processed for user `cbe0653ed0c04a9080b5c337392de8ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:34:54.657463 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-88971923-75f3-42e2-8641-9c6dd7baf83f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:54.665883 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1402/2811] 10.222.0.49 () {58 vars in 967 bytes} [Sun Aug 28 01:34:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:34:54.715421 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6924962-95bf-49b9-ad45-89c5ccd21601 service neutron] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:54.727328 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6924962-95bf-49b9-ad45-89c5ccd21601 service neutron] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:54.733039 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09305849-3369-4ebb-b9d2-0e3b2ed79c5e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ce463b940db4f83a6df7e0561a88567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:54.733648 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09305849-3369-4ebb-b9d2-0e3b2ed79c5e service swift] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:54.733928 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09305849-3369-4ebb-b9d2-0e3b2ed79c5e service swift] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:54.734201 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09305849-3369-4ebb-b9d2-0e3b2ed79c5e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:54.742815 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09305849-3369-4ebb-b9d2-0e3b2ed79c5e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:54.744477 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09305849-3369-4ebb-b9d2-0e3b2ed79c5e service swift] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:54.752515 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1410/2812] 10.222.0.49 () {60 vars in 1384 bytes} [Sun Aug 28 01:34:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:34:55.155323 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88971923-75f3-42e2-8641-9c6dd7baf83f None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:55.165255 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88971923-75f3-42e2-8641-9c6dd7baf83f None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:55.169241 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1625e68-0a54-4f74-b0dd-0432f1f2a53d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:55.169852 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1625e68-0a54-4f74-b0dd-0432f1f2a53d service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:55.170130 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1625e68-0a54-4f74-b0dd-0432f1f2a53d service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:55.170399 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1625e68-0a54-4f74-b0dd-0432f1f2a53d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:55.232750 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1625e68-0a54-4f74-b0dd-0432f1f2a53d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:55.234191 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1625e68-0a54-4f74-b0dd-0432f1f2a53d service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:55.244412 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1403/2813] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:34:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:34:58.157488 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09305849-3369-4ebb-b9d2-0e3b2ed79c5e service swift] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:34:58.159247 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-09305849-3369-4ebb-b9d2-0e3b2ed79c5e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:58.175505 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09305849-3369-4ebb-b9d2-0e3b2ed79c5e service swift] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:34:58.181899 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3201bd-3779-4dc5-b77f-fed65caf2d38 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4fc1d11f5641b0b5f301b234282aa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:34:58.183015 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3201bd-3779-4dc5-b77f-fed65caf2d38 service placement] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:34:58.183542 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3201bd-3779-4dc5-b77f-fed65caf2d38 service placement] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:34:58.184029 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3201bd-3779-4dc5-b77f-fed65caf2d38 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:34:58.186196 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-0f3201bd-3779-4dc5-b77f-fed65caf2d38 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:34:58.199764 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3201bd-3779-4dc5-b77f-fed65caf2d38 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:34:58.201581 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3201bd-3779-4dc5-b77f-fed65caf2d38 service placement] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:34:58.224801 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1411/2814] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:34:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:35:01.831192 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1625e68-0a54-4f74-b0dd-0432f1f2a53d service neutron] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:35:01.841632 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1625e68-0a54-4f74-b0dd-0432f1f2a53d service neutron] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:35:01.846734 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1faefa-972d-4a11-af1e-6f84f19236c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:35:01.847552 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1faefa-972d-4a11-af1e-6f84f19236c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:35:01.847761 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1faefa-972d-4a11-af1e-6f84f19236c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:35:01.848331 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1faefa-972d-4a11-af1e-6f84f19236c6 admin admin] PATH_INFO: `/v3/users/1b0ee1f818e24ed1a70734c9bf9af1eb` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:35:01.849852 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1faefa-972d-4a11-af1e-6f84f19236c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b0ee1f818e24ed1a70734c9bf9af1eb)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:35:01.852672 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1faefa-972d-4a11-af1e-6f84f19236c6 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:35:01.905509 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-ad1faefa-972d-4a11-af1e-6f84f19236c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b0ee1f818e24ed1a70734c9bf9af1eb'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:35:01.914632 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-ad1faefa-972d-4a11-af1e-6f84f19236c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b0ee1f818e24ed1a70734c9bf9af1eb'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:35:01.927221 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-ad1faefa-972d-4a11-af1e-6f84f19236c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b0ee1f818e24ed1a70734c9bf9af1eb'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:35:01.927906 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-ad1faefa-972d-4a11-af1e-6f84f19236c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b0ee1f818e24ed1a70734c9bf9af1eb'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:35:01.928507 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-ad1faefa-972d-4a11-af1e-6f84f19236c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b0ee1f818e24ed1a70734c9bf9af1eb'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:35:01.941621 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1404/2815] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 01:35:01 2022] DELETE /identity/v3/users/1b0ee1f818e24ed1a70734c9bf9af1eb => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:35:02.138318 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3201bd-3779-4dc5-b77f-fed65caf2d38 service placement] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:35:02.153351 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3201bd-3779-4dc5-b77f-fed65caf2d38 service placement] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:35:02.222871 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff888cc-29bf-489c-8638-724e3921283c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:35:02.223628 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff888cc-29bf-489c-8638-724e3921283c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:35:02.223937 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff888cc-29bf-489c-8638-724e3921283c admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:35:02.224238 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff888cc-29bf-489c-8638-724e3921283c admin admin] PATH_INFO: `/v3/projects/e054a46dcce4403c8de19c698f713b7c` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:35:02.225458 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff888cc-29bf-489c-8638-724e3921283c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e054a46dcce4403c8de19c698f713b7c)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:35:02.227465 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff888cc-29bf-489c-8638-724e3921283c admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:35:02.279399 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-bff888cc-29bf-489c-8638-724e3921283c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e054a46dcce4403c8de19c698f713b7c', 'request_id': 'req-bff888cc-29bf-489c-8638-724e3921283c'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:35:02.286389 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-bff888cc-29bf-489c-8638-724e3921283c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e054a46dcce4403c8de19c698f713b7c', 'request_id': 'req-bff888cc-29bf-489c-8638-724e3921283c'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:35:02.296112 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-bff888cc-29bf-489c-8638-724e3921283c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e054a46dcce4403c8de19c698f713b7c', 'request_id': 'req-bff888cc-29bf-489c-8638-724e3921283c'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:35:02.307244 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-bff888cc-29bf-489c-8638-724e3921283c admin admin] The token cache is being invalidate because project e054a46dcce4403c8de19c698f713b7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81807) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:35:02.307463 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-bff888cc-29bf-489c-8638-724e3921283c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:35:02.308110 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-bff888cc-29bf-489c-8638-724e3921283c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:35:02.309601 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1412/2816] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 01:35:02 2022] DELETE /identity/v3/projects/e054a46dcce4403c8de19c698f713b7c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:35:02.313646 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1faefa-972d-4a11-af1e-6f84f19236c6 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:35:02.315236 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-ad1faefa-972d-4a11-af1e-6f84f19236c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:35:02.329317 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1faefa-972d-4a11-af1e-6f84f19236c6 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:35:02.388338 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a836831f-e71c-467f-9575-9e077ffede84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:35:02.388967 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836831f-e71c-467f-9575-9e077ffede84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:35:02.389245 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836831f-e71c-467f-9575-9e077ffede84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:35:02.389513 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836831f-e71c-467f-9575-9e077ffede84 admin admin] PATH_INFO: `/v3/users/f73244e0cc2b413da2d23efad835be7b` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:35:02.390687 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a836831f-e71c-467f-9575-9e077ffede84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f73244e0cc2b413da2d23efad835be7b)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:35:02.392649 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a836831f-e71c-467f-9575-9e077ffede84 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:35:02.394088 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:35:02.446025 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-a836831f-e71c-467f-9575-9e077ffede84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f73244e0cc2b413da2d23efad835be7b'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:35:02.454347 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-a836831f-e71c-467f-9575-9e077ffede84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f73244e0cc2b413da2d23efad835be7b'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:35:02.466593 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-a836831f-e71c-467f-9575-9e077ffede84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f73244e0cc2b413da2d23efad835be7b'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:35:02.467253 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-a836831f-e71c-467f-9575-9e077ffede84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f73244e0cc2b413da2d23efad835be7b'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:35:02.467879 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-a836831f-e71c-467f-9575-9e077ffede84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f73244e0cc2b413da2d23efad835be7b'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:35:02.482210 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1405/2817] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 01:35:02 2022] DELETE /identity/v3/users/f73244e0cc2b413da2d23efad835be7b => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:35:02.662456 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff888cc-29bf-489c-8638-724e3921283c admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:35:02.664229 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-bff888cc-29bf-489c-8638-724e3921283c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:35:02.680519 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff888cc-29bf-489c-8638-724e3921283c admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:35:02.735459 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:35:02.747971 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e30139a-ba9d-4e96-9a8f-fd281a66233d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:35:02.748623 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30139a-ba9d-4e96-9a8f-fd281a66233d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:35:02.749125 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30139a-ba9d-4e96-9a8f-fd281a66233d admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:35:02.749664 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e30139a-ba9d-4e96-9a8f-fd281a66233d admin admin] PATH_INFO: `/v3/projects/b3e0416856cc4610a10d1fa49e26a7dc` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:35:02.750818 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e30139a-ba9d-4e96-9a8f-fd281a66233d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3e0416856cc4610a10d1fa49e26a7dc)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:35:02.752815 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e30139a-ba9d-4e96-9a8f-fd281a66233d admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:35:02.802172 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-4e30139a-ba9d-4e96-9a8f-fd281a66233d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3e0416856cc4610a10d1fa49e26a7dc', 'request_id': 'req-4e30139a-ba9d-4e96-9a8f-fd281a66233d'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:35:02.808893 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-4e30139a-ba9d-4e96-9a8f-fd281a66233d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3e0416856cc4610a10d1fa49e26a7dc', 'request_id': 'req-4e30139a-ba9d-4e96-9a8f-fd281a66233d'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:35:02.819042 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-4e30139a-ba9d-4e96-9a8f-fd281a66233d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3e0416856cc4610a10d1fa49e26a7dc', 'request_id': 'req-4e30139a-ba9d-4e96-9a8f-fd281a66233d'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:35:02.831485 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-4e30139a-ba9d-4e96-9a8f-fd281a66233d admin admin] The token cache is being invalidate because project b3e0416856cc4610a10d1fa49e26a7dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81807) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:35:02.831485 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-4e30139a-ba9d-4e96-9a8f-fd281a66233d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:35:02.832464 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-4e30139a-ba9d-4e96-9a8f-fd281a66233d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:35:02.833995 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1413/2818] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 01:35:02 2022] DELETE /identity/v3/projects/b3e0416856cc4610a10d1fa49e26a7dc => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:35:02.839735 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81942373-ee09-4e7b-93b5-82f5cdea3757 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:35:02.840559 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81942373-ee09-4e7b-93b5-82f5cdea3757 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:35:02.840740 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81942373-ee09-4e7b-93b5-82f5cdea3757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:35:02.880971 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-81942373-ee09-4e7b-93b5-82f5cdea3757 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:35:02.883073 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-81942373-ee09-4e7b-93b5-82f5cdea3757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:35:02.961327 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1406/2819] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:35:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:35:02.971595 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3191dcb-09b0-4629-986e-1c2a263d290b None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:35:02.971922 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3191dcb-09b0-4629-986e-1c2a263d290b None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:35:02.972197 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3191dcb-09b0-4629-986e-1c2a263d290b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:35:02.993760 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-d3191dcb-09b0-4629-986e-1c2a263d290b None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:35:02.994967 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-d3191dcb-09b0-4629-986e-1c2a263d290b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:35:03.004036 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1414/2820] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:35:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:35:03.008522 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81942373-ee09-4e7b-93b5-82f5cdea3757 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:35:03.018917 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81942373-ee09-4e7b-93b5-82f5cdea3757 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:35:03.024709 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c30ac4-d118-4f31-8bce-eaa85a40eb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:35:03.025315 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c30ac4-d118-4f31-8bce-eaa85a40eb8c admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:35:03.025593 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c30ac4-d118-4f31-8bce-eaa85a40eb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:35:03.025868 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c30ac4-d118-4f31-8bce-eaa85a40eb8c admin admin] PATH_INFO: `/v3/domains` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:35:03.026548 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c30ac4-d118-4f31-8bce-eaa85a40eb8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81808) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:35:03.026840 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c30ac4-d118-4f31-8bce-eaa85a40eb8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:35:03.028559 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c30ac4-d118-4f31-8bce-eaa85a40eb8c admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:35:03.041123 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1407/2821] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 01:35:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:35:03.047292 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3191dcb-09b0-4629-986e-1c2a263d290b None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:35:03.062057 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3191dcb-09b0-4629-986e-1c2a263d290b None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:35:03.070519 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d3901f-6c55-4cd9-b10c-64a13164555d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:35:03.071324 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3901f-6c55-4cd9-b10c-64a13164555d admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:35:03.071618 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3901f-6c55-4cd9-b10c-64a13164555d admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:35:03.071982 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3901f-6c55-4cd9-b10c-64a13164555d admin admin] PATH_INFO: `/v3/projects` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:35:03.072675 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d3901f-6c55-4cd9-b10c-64a13164555d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:35:03.075083 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d3901f-6c55-4cd9-b10c-64a13164555d admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:35:03.107975 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1415/2822] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 01:35:03 2022] POST /identity/v3/projects => generated 391 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:35:03.115235 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c30ac4-d118-4f31-8bce-eaa85a40eb8c admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:35:03.131116 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c30ac4-d118-4f31-8bce-eaa85a40eb8c admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:35:03.189255 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:35:03.199290 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa8ac9c-1a5f-455d-a523-a807de86bf9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:35:03.199945 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8ac9c-1a5f-455d-a523-a807de86bf9c admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:35:03.200228 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8ac9c-1a5f-455d-a523-a807de86bf9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:35:03.200500 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8ac9c-1a5f-455d-a523-a807de86bf9c admin admin] PATH_INFO: `/v3/users` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:35:03.201173 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa8ac9c-1a5f-455d-a523-a807de86bf9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:35:03.203504 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa8ac9c-1a5f-455d-a523-a807de86bf9c admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:35:03.228998 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1408/2823] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 01:35:03 2022] POST /identity/v3/users => generated 296 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:35:03.233141 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d3901f-6c55-4cd9-b10c-64a13164555d admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:35:03.243891 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d3901f-6c55-4cd9-b10c-64a13164555d admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:35:03.249872 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf2f7e-d99d-4832-89b4-c257bd8c4449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:35:03.250480 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf2f7e-d99d-4832-89b4-c257bd8c4449 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:35:03.250901 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf2f7e-d99d-4832-89b4-c257bd8c4449 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:35:03.251175 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf2f7e-d99d-4832-89b4-c257bd8c4449 admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:35:03.251878 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cf2f7e-d99d-4832-89b4-c257bd8c4449 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:35:03.253513 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cf2f7e-d99d-4832-89b4-c257bd8c4449 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:35:03.264213 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1416/2824] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:35:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:35:03.268538 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa8ac9c-1a5f-455d-a523-a807de86bf9c admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:35:03.280256 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa8ac9c-1a5f-455d-a523-a807de86bf9c admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:35:03.286657 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71cc12e-040c-4739-adc6-d304db97cb0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:35:03.287268 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71cc12e-040c-4739-adc6-d304db97cb0b admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:35:03.287574 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71cc12e-040c-4739-adc6-d304db97cb0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:35:03.287871 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71cc12e-040c-4739-adc6-d304db97cb0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:35:03.288529 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71cc12e-040c-4739-adc6-d304db97cb0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:35:03.290142 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71cc12e-040c-4739-adc6-d304db97cb0b admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:35:03.304018 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1409/2825] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:35:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:35:03.309071 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf2f7e-d99d-4832-89b4-c257bd8c4449 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:35:03.323484 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf2f7e-d99d-4832-89b4-c257bd8c4449 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:35:03.329081 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c106d9-48cd-47c5-b6c2-9fed0caa3ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:35:03.329745 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c106d9-48cd-47c5-b6c2-9fed0caa3ed1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:35:03.330023 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c106d9-48cd-47c5-b6c2-9fed0caa3ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:35:03.330294 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c106d9-48cd-47c5-b6c2-9fed0caa3ed1 admin admin] PATH_INFO: `/v3/projects/fa1606ea21ec4b4bbcd133c0eeee0074/users/3b64fa69b8cb4fba8057bc852699f388/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:35:03.345812 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c106d9-48cd-47c5-b6c2-9fed0caa3ed1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa1606ea21ec4b4bbcd133c0eeee0074, user_id=3b64fa69b8cb4fba8057bc852699f388, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:35:03.348534 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c106d9-48cd-47c5-b6c2-9fed0caa3ed1 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:35:03.363832 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1417/2826] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 01:35:03 2022] PUT /identity/v3/projects/fa1606ea21ec4b4bbcd133c0eeee0074/users/3b64fa69b8cb4fba8057bc852699f388/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:35:03.374098 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965729b-63b7-4522-8d16-487adf9f0868 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:35:03.374419 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965729b-63b7-4522-8d16-487adf9f0868 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:35:03.374663 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0965729b-63b7-4522-8d16-487adf9f0868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:35:03.402877 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-0965729b-63b7-4522-8d16-487adf9f0868 None None] MFA Rules not processed for user `3b64fa69b8cb4fba8057bc852699f388`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:35:03.404170 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-0965729b-63b7-4522-8d16-487adf9f0868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:35:03.482245 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1410/2827] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:35:03 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:35:03.486861 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c106d9-48cd-47c5-b6c2-9fed0caa3ed1 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:35:03.552597 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c106d9-48cd-47c5-b6c2-9fed0caa3ed1 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:35:03.559326 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d37699d-7eec-4c42-a139-2957aca3bd07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:35:03.560124 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37699d-7eec-4c42-a139-2957aca3bd07 admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:35:03.560405 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37699d-7eec-4c42-a139-2957aca3bd07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:35:03.560684 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37699d-7eec-4c42-a139-2957aca3bd07 admin admin] PATH_INFO: `/v3/projects` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:35:03.561341 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d37699d-7eec-4c42-a139-2957aca3bd07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:35:03.563416 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d37699d-7eec-4c42-a139-2957aca3bd07 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:35:03.593872 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1418/2828] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 01:35:03 2022] POST /identity/v3/projects => generated 391 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 28 01:35:03.598339 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0965729b-63b7-4522-8d16-487adf9f0868 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:35:03.610077 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0965729b-63b7-4522-8d16-487adf9f0868 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:35:03.675069 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d194c863-dcad-49c6-b941-dd659613f699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:35:03.675851 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d194c863-dcad-49c6-b941-dd659613f699 admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:35:03.676173 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d194c863-dcad-49c6-b941-dd659613f699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:35:03.676521 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d194c863-dcad-49c6-b941-dd659613f699 admin admin] PATH_INFO: `/v3/users` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:35:03.677465 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d194c863-dcad-49c6-b941-dd659613f699 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:35:03.680715 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d194c863-dcad-49c6-b941-dd659613f699 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:35:03.707246 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1411/2829] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 01:35:03 2022] POST /identity/v3/users => generated 302 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:35:03.711107 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d37699d-7eec-4c42-a139-2957aca3bd07 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:35:03.716873 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:35:03.724939 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d37699d-7eec-4c42-a139-2957aca3bd07 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:35:03.731249 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76609ef-5632-45f8-8e9e-b8bebd91000e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:35:03.732056 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76609ef-5632-45f8-8e9e-b8bebd91000e admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:35:03.732344 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76609ef-5632-45f8-8e9e-b8bebd91000e admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:35:03.732801 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76609ef-5632-45f8-8e9e-b8bebd91000e admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:35:03.733464 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76609ef-5632-45f8-8e9e-b8bebd91000e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:35:03.735890 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76609ef-5632-45f8-8e9e-b8bebd91000e admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:35:03.747135 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1419/2830] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:35:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:35:03.751578 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d194c863-dcad-49c6-b941-dd659613f699 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:35:03.762586 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d194c863-dcad-49c6-b941-dd659613f699 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:35:03.768417 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6c0ae-f0b9-421f-84e5-66355c70604b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:35:03.769097 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6c0ae-f0b9-421f-84e5-66355c70604b admin admin] REQUEST_METHOD: `PUT` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:35:03.769378 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6c0ae-f0b9-421f-84e5-66355c70604b admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:35:03.769638 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6c0ae-f0b9-421f-84e5-66355c70604b admin admin] PATH_INFO: `/v3/projects/c6b08a63a4954d769068d7f4333de1be/users/27721ee21a1c46a382effb539e4ad28b/roles/2e4889bb71f9434392c0baba59f2534e` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:35:03.787433 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb6c0ae-f0b9-421f-84e5-66355c70604b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6b08a63a4954d769068d7f4333de1be, user_id=27721ee21a1c46a382effb539e4ad28b, role_id=2e4889bb71f9434392c0baba59f2534e)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:35:03.790239 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb6c0ae-f0b9-421f-84e5-66355c70604b admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:35:03.807782 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1412/2831] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 01:35:03 2022] PUT /identity/v3/projects/c6b08a63a4954d769068d7f4333de1be/users/27721ee21a1c46a382effb539e4ad28b/roles/2e4889bb71f9434392c0baba59f2534e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:35:03.812091 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76609ef-5632-45f8-8e9e-b8bebd91000e admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:35:03.823055 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76609ef-5632-45f8-8e9e-b8bebd91000e admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:35:03.887050 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ae4b02-d42e-4cf0-8dae-9ad5d3af2feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:35:03.887692 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae4b02-d42e-4cf0-8dae-9ad5d3af2feb admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:35:03.887968 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae4b02-d42e-4cf0-8dae-9ad5d3af2feb admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:35:03.888239 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae4b02-d42e-4cf0-8dae-9ad5d3af2feb admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:35:03.888979 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ae4b02-d42e-4cf0-8dae-9ad5d3af2feb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:35:03.890654 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ae4b02-d42e-4cf0-8dae-9ad5d3af2feb admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:35:03.902046 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1420/2832] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:35:03 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:35:03.906672 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6c0ae-f0b9-421f-84e5-66355c70604b admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:35:03.917976 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6c0ae-f0b9-421f-84e5-66355c70604b admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:35:03.927472 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd5c4e9-3505-4465-a2bd-0a232a7e3602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:35:03.928095 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5c4e9-3505-4465-a2bd-0a232a7e3602 admin admin] REQUEST_METHOD: `PUT` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:35:03.928368 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5c4e9-3505-4465-a2bd-0a232a7e3602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:35:03.928638 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd5c4e9-3505-4465-a2bd-0a232a7e3602 admin admin] PATH_INFO: `/v3/projects/c6b08a63a4954d769068d7f4333de1be/users/27721ee21a1c46a382effb539e4ad28b/roles/2e4889bb71f9434392c0baba59f2534e` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:35:03.931010 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd5c4e9-3505-4465-a2bd-0a232a7e3602 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6b08a63a4954d769068d7f4333de1be, user_id=27721ee21a1c46a382effb539e4ad28b, role_id=2e4889bb71f9434392c0baba59f2534e)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:35:03.934099 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd5c4e9-3505-4465-a2bd-0a232a7e3602 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:35:03.948018 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1413/2833] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 01:35:03 2022] PUT /identity/v3/projects/c6b08a63a4954d769068d7f4333de1be/users/27721ee21a1c46a382effb539e4ad28b/roles/2e4889bb71f9434392c0baba59f2534e => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:35:03.964035 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a671a5-5d6c-4b46-9e23-94ae05164d86 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:35:03.964319 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a671a5-5d6c-4b46-9e23-94ae05164d86 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:35:03.964602 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a671a5-5d6c-4b46-9e23-94ae05164d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:35:03.993864 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-78a671a5-5d6c-4b46-9e23-94ae05164d86 None None] MFA Rules not processed for user `27721ee21a1c46a382effb539e4ad28b`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:35:03.995085 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-78a671a5-5d6c-4b46-9e23-94ae05164d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:35:04.063689 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1421/2834] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:35:03 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:35:04.078313 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd5c4e9-3505-4465-a2bd-0a232a7e3602 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:35:04.080431 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-3cd5c4e9-3505-4465-a2bd-0a232a7e3602 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:35:04.105756 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:35:04.165144 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd5c4e9-3505-4465-a2bd-0a232a7e3602 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:35:04.172112 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238032c2-7e1d-488e-b1d0-b35c8f7d9e44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:35:04.172727 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238032c2-7e1d-488e-b1d0-b35c8f7d9e44 service nova] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:35:04.173007 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238032c2-7e1d-488e-b1d0-b35c8f7d9e44 service nova] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:35:04.173281 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238032c2-7e1d-488e-b1d0-b35c8f7d9e44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:35:04.229362 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238032c2-7e1d-488e-b1d0-b35c8f7d9e44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:35:04.230961 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238032c2-7e1d-488e-b1d0-b35c8f7d9e44 service nova] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:35:04.239965 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1414/2835] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:35:04 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:35:07.071224 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a671a5-5d6c-4b46-9e23-94ae05164d86 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:35:07.072810 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-78a671a5-5d6c-4b46-9e23-94ae05164d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:35:07.141960 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a671a5-5d6c-4b46-9e23-94ae05164d86 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:35:07.145818 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685be195-d34d-4d1f-9e6c-a87148154a1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:35:07.146619 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685be195-d34d-4d1f-9e6c-a87148154a1a service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:35:07.146766 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685be195-d34d-4d1f-9e6c-a87148154a1a service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:35:07.146982 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685be195-d34d-4d1f-9e6c-a87148154a1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:35:07.157482 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685be195-d34d-4d1f-9e6c-a87148154a1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:35:07.159369 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685be195-d34d-4d1f-9e6c-a87148154a1a service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:35:07.170200 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1422/2836] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:35:07 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:35:09.976155 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdbfe7e-0842-4cd4-9344-383b0131cb02 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:35:09.976710 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdbfe7e-0842-4cd4-9344-383b0131cb02 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:35:09.976710 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdbfe7e-0842-4cd4-9344-383b0131cb02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:35:09.996986 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-abdbfe7e-0842-4cd4-9344-383b0131cb02 None None] MFA Rules not processed for user `3b64fa69b8cb4fba8057bc852699f388`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:35:09.998248 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-abdbfe7e-0842-4cd4-9344-383b0131cb02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:35:10.016110 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1415/2837] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:35:09 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:35:10.378549 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685be195-d34d-4d1f-9e6c-a87148154a1a service neutron] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:35:10.380069 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-685be195-d34d-4d1f-9e6c-a87148154a1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:35:10.392330 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685be195-d34d-4d1f-9e6c-a87148154a1a service neutron] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:35:10.397855 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8625cb6-1a0a-4582-8b16-a295bfafcd7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:35:10.398479 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8625cb6-1a0a-4582-8b16-a295bfafcd7a service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:35:10.398724 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8625cb6-1a0a-4582-8b16-a295bfafcd7a service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:35:10.399177 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8625cb6-1a0a-4582-8b16-a295bfafcd7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:35:10.402157 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-a8625cb6-1a0a-4582-8b16-a295bfafcd7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:35:10.413612 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8625cb6-1a0a-4582-8b16-a295bfafcd7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:35:10.415873 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8625cb6-1a0a-4582-8b16-a295bfafcd7a service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:35:10.425163 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1423/2838] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:35:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:35:19.993474 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=51 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:35:20.421231 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=99 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:35:21.425674 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdbfe7e-0842-4cd4-9344-383b0131cb02 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:35:21.442517 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdbfe7e-0842-4cd4-9344-383b0131cb02 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:35:21.448934 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e455f94-c17f-44c8-888d-b21470f29ec0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:35:21.449268 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e455f94-c17f-44c8-888d-b21470f29ec0 service nova] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:35:21.449722 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e455f94-c17f-44c8-888d-b21470f29ec0 service nova] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:35:21.450023 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e455f94-c17f-44c8-888d-b21470f29ec0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:35:21.452218 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-1e455f94-c17f-44c8-888d-b21470f29ec0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:35:21.465718 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e455f94-c17f-44c8-888d-b21470f29ec0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:35:21.467986 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e455f94-c17f-44c8-888d-b21470f29ec0 service nova] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:35:21.484274 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1416/2839] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:35:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:35:31.477151 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=6 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:36:03.944835 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8625cb6-1a0a-4582-8b16-a295bfafcd7a service neutron] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:36:03.946944 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-a8625cb6-1a0a-4582-8b16-a295bfafcd7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:36:04.040451 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8625cb6-1a0a-4582-8b16-a295bfafcd7a service neutron] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:36:04.045521 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c01f57-1c49-4f28-9d0f-fc1b06e59d59 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4fc1d11f5641b0b5f301b234282aa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:36:04.046146 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c01f57-1c49-4f28-9d0f-fc1b06e59d59 service placement] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:36:04.046421 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c01f57-1c49-4f28-9d0f-fc1b06e59d59 service placement] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:36:04.046691 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c01f57-1c49-4f28-9d0f-fc1b06e59d59 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:36:04.048473 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-96c01f57-1c49-4f28-9d0f-fc1b06e59d59 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:36:04.060920 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c01f57-1c49-4f28-9d0f-fc1b06e59d59 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:36:04.062402 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c01f57-1c49-4f28-9d0f-fc1b06e59d59 service placement] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:36:04.072503 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1424/2840] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:36:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:36:10.000540 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45f201-a092-4c37-ab42-6b844b1026c9 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:36:10.001140 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45f201-a092-4c37-ab42-6b844b1026c9 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:36:10.001140 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45f201-a092-4c37-ab42-6b844b1026c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:36:10.020772 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-bf45f201-a092-4c37-ab42-6b844b1026c9 None None] MFA Rules not processed for user `3b64fa69b8cb4fba8057bc852699f388`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:36:10.022170 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-bf45f201-a092-4c37-ab42-6b844b1026c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:36:10.033920 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1417/2841] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:36:09 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:36:14.068656 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=32 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:36:20.015491 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=3 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:37:38.449771 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c01f57-1c49-4f28-9d0f-fc1b06e59d59 service placement] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:38.451261 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-96c01f57-1c49-4f28-9d0f-fc1b06e59d59 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:38.537080 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c01f57-1c49-4f28-9d0f-fc1b06e59d59 service placement] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:38.543304 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ade5a-12b4-4d67-b65e-ced2d02211a4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4fc1d11f5641b0b5f301b234282aa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:38.543955 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ade5a-12b4-4d67-b65e-ced2d02211a4 service placement] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:38.544231 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ade5a-12b4-4d67-b65e-ced2d02211a4 service placement] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:38.544499 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ade5a-12b4-4d67-b65e-ced2d02211a4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:38.546530 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-402ade5a-12b4-4d67-b65e-ced2d02211a4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:38.559419 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402ade5a-12b4-4d67-b65e-ced2d02211a4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:38.561115 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402ade5a-12b4-4d67-b65e-ced2d02211a4 service placement] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:38.571596 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1425/2842] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:37:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:37:48.567057 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=37 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:37:49.378939 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf45f201-a092-4c37-ab42-6b844b1026c9 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:37:49.431082 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf45f201-a092-4c37-ab42-6b844b1026c9 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:37:49.439274 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde0a54-304f-4fb4-b53a-bb4b9973f0a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:37:49.440236 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde0a54-304f-4fb4-b53a-bb4b9973f0a6 service nova] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:37:49.440662 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde0a54-304f-4fb4-b53a-bb4b9973f0a6 service nova] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:37:49.441090 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde0a54-304f-4fb4-b53a-bb4b9973f0a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:37:49.443295 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-9dde0a54-304f-4fb4-b53a-bb4b9973f0a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:37:49.460488 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dde0a54-304f-4fb4-b53a-bb4b9973f0a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:37:49.462154 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dde0a54-304f-4fb4-b53a-bb4b9973f0a6 service nova] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:37:49.483818 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1418/2843] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:37:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:37:59.472494 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=14 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:38:02.513679 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53abac4-0645-405a-9ec8-ff27cda31ebc None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:02.514157 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53abac4-0645-405a-9ec8-ff27cda31ebc None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:02.514253 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53abac4-0645-405a-9ec8-ff27cda31ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:02.541901 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-b53abac4-0645-405a-9ec8-ff27cda31ebc None None] MFA Rules not processed for user `3b64fa69b8cb4fba8057bc852699f388`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:38:02.543117 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-b53abac4-0645-405a-9ec8-ff27cda31ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:02.551010 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1426/2844] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:38:02 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:38:12.536382 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=3 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:38:49.356833 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a526727-fda2-48bb-b551-c286f8bff80b None None] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:49.357451 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a526727-fda2-48bb-b551-c286f8bff80b None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:49.357451 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a526727-fda2-48bb-b551-c286f8bff80b None None] PATH_INFO: `/` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:49.358868 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1419/2845] 10.222.0.49 () {54 vars in 921 bytes} [Sun Aug 28 01:38:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:38:49.365115 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e8c0f-83da-493e-aa7a-cec4932e4072 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:49.365651 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e8c0f-83da-493e-aa7a-cec4932e4072 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:49.365651 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e8c0f-83da-493e-aa7a-cec4932e4072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:49.424850 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-578e8c0f-83da-493e-aa7a-cec4932e4072 None None] MFA Rules not processed for user `2d14dcd0cb25427291ab8831924184e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:38:49.426071 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-578e8c0f-83da-493e-aa7a-cec4932e4072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:49.444095 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1427/2846] 10.222.0.49 () {58 vars in 1018 bytes} [Sun Aug 28 01:38:49 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:38:49.456607 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a526727-fda2-48bb-b551-c286f8bff80b None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:49.469844 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a526727-fda2-48bb-b551-c286f8bff80b None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:49.473969 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e54c82-80c9-45e6-bc33-fad6d7a14d20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:49.474595 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e54c82-80c9-45e6-bc33-fad6d7a14d20 service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:49.474999 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e54c82-80c9-45e6-bc33-fad6d7a14d20 service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:49.475292 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e54c82-80c9-45e6-bc33-fad6d7a14d20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:49.484164 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e54c82-80c9-45e6-bc33-fad6d7a14d20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:49.486050 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e54c82-80c9-45e6-bc33-fad6d7a14d20 service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:49.496585 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1420/2847] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:38:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:38:49.614204 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e8c0f-83da-493e-aa7a-cec4932e4072 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:49.627340 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e8c0f-83da-493e-aa7a-cec4932e4072 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:49.633657 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d9587-7b40-485e-a39b-e0d40b9ddc61 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4fc1d11f5641b0b5f301b234282aa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:49.634284 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d9587-7b40-485e-a39b-e0d40b9ddc61 service placement] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:49.634568 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d9587-7b40-485e-a39b-e0d40b9ddc61 service placement] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:49.634879 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d9587-7b40-485e-a39b-e0d40b9ddc61 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:49.636786 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-547d9587-7b40-485e-a39b-e0d40b9ddc61 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:49.648959 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547d9587-7b40-485e-a39b-e0d40b9ddc61 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:49.650709 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547d9587-7b40-485e-a39b-e0d40b9ddc61 service placement] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:49.660842 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1428/2848] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:38:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:38:49.850433 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e54c82-80c9-45e6-bc33-fad6d7a14d20 service neutron] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:49.859801 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e54c82-80c9-45e6-bc33-fad6d7a14d20 service neutron] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:49.864402 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410f6708-f3f3-4788-9f05-4ec591089567 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:49.865013 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f6708-f3f3-4788-9f05-4ec591089567 service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:49.865263 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f6708-f3f3-4788-9f05-4ec591089567 service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:49.865549 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f6708-f3f3-4788-9f05-4ec591089567 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:49.867500 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-410f6708-f3f3-4788-9f05-4ec591089567 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:49.881775 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410f6708-f3f3-4788-9f05-4ec591089567 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:49.883225 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410f6708-f3f3-4788-9f05-4ec591089567 service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:49.894099 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1421/2849] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:38:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:38:49.961816 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d9587-7b40-485e-a39b-e0d40b9ddc61 service placement] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:38:49.973165 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d9587-7b40-485e-a39b-e0d40b9ddc61 service placement] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:38:49.979449 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a7e3a8-a1eb-4454-9c47-1217538035ff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4fc1d11f5641b0b5f301b234282aa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:38:49.980111 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7e3a8-a1eb-4454-9c47-1217538035ff service placement] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:38:49.980394 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7e3a8-a1eb-4454-9c47-1217538035ff service placement] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:38:49.980663 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7e3a8-a1eb-4454-9c47-1217538035ff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:38:49.982740 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-e2a7e3a8-a1eb-4454-9c47-1217538035ff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:38:49.995200 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a7e3a8-a1eb-4454-9c47-1217538035ff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:38:49.996845 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a7e3a8-a1eb-4454-9c47-1217538035ff service placement] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:38:50.006980 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1429/2850] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:38:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:38:59.889674 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=12 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:39:00.002682 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=30 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:39:12.699627 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410f6708-f3f3-4788-9f05-4ec591089567 service neutron] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:12.701469 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-410f6708-f3f3-4788-9f05-4ec591089567 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:39:12.765646 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410f6708-f3f3-4788-9f05-4ec591089567 service neutron] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:12.771633 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d6e418-3256-42bc-8d32-6d9c8976dbc2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:12.772316 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6e418-3256-42bc-8d32-6d9c8976dbc2 service nova] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:12.772597 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6e418-3256-42bc-8d32-6d9c8976dbc2 service nova] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:12.772870 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6e418-3256-42bc-8d32-6d9c8976dbc2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:12.774854 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-e4d6e418-3256-42bc-8d32-6d9c8976dbc2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:39:12.790160 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d6e418-3256-42bc-8d32-6d9c8976dbc2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:12.791886 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d6e418-3256-42bc-8d32-6d9c8976dbc2 service nova] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:12.803949 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1422/2851] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:39:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:39:22.798737 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=18 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:39:38.093466 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a7e3a8-a1eb-4454-9c47-1217538035ff service placement] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:38.103764 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a7e3a8-a1eb-4454-9c47-1217538035ff service placement] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:38.107624 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a882e73f-531d-4361-b79c-264580d23a56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:38.108297 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a882e73f-531d-4361-b79c-264580d23a56 service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:38.108585 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a882e73f-531d-4361-b79c-264580d23a56 service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:38.108851 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a882e73f-531d-4361-b79c-264580d23a56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:38.110808 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-a882e73f-531d-4361-b79c-264580d23a56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:39:38.121905 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a882e73f-531d-4361-b79c-264580d23a56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:38.123361 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a882e73f-531d-4361-b79c-264580d23a56 service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:38.131559 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1430/2852] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:39:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:39:43.463856 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d6e418-3256-42bc-8d32-6d9c8976dbc2 service nova] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:43.475769 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d6e418-3256-42bc-8d32-6d9c8976dbc2 service nova] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:43.480210 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e052de1b-eb98-474e-8b3d-92537e8bb7ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:43.480845 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052de1b-eb98-474e-8b3d-92537e8bb7ba service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:43.481134 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052de1b-eb98-474e-8b3d-92537e8bb7ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:43.481407 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052de1b-eb98-474e-8b3d-92537e8bb7ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:43.483550 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-e052de1b-eb98-474e-8b3d-92537e8bb7ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:39:43.498717 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e052de1b-eb98-474e-8b3d-92537e8bb7ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:43.500371 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e052de1b-eb98-474e-8b3d-92537e8bb7ba service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:43.512664 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1423/2853] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:39:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:39:48.128049 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=6 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:39:53.507097 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=6 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:39:56.086634 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7fa75-fbe8-426a-8a4f-dc47bd0e0cf6 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:56.087087 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7fa75-fbe8-426a-8a4f-dc47bd0e0cf6 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:56.087187 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7fa75-fbe8-426a-8a4f-dc47bd0e0cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:56.108739 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-d9c7fa75-fbe8-426a-8a4f-dc47bd0e0cf6 None None] MFA Rules not processed for user `3b64fa69b8cb4fba8057bc852699f388`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:39:56.110661 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-d9c7fa75-fbe8-426a-8a4f-dc47bd0e0cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:39:56.118488 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1431/2854] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:39:56 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:39:56.159215 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e052de1b-eb98-474e-8b3d-92537e8bb7ba service neutron] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:39:56.160913 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-e052de1b-eb98-474e-8b3d-92537e8bb7ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:39:56.257653 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e052de1b-eb98-474e-8b3d-92537e8bb7ba service neutron] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:39:56.270182 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f99fc-ad43-4b64-a866-04ccd9110ea8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22053bd9632346aab63814f740415f69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:39:56.271326 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f99fc-ad43-4b64-a866-04ccd9110ea8 service glance] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:39:56.271961 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f99fc-ad43-4b64-a866-04ccd9110ea8 service glance] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:39:56.272459 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f99fc-ad43-4b64-a866-04ccd9110ea8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:39:56.279250 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-eb2f99fc-ad43-4b64-a866-04ccd9110ea8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:39:56.298520 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f99fc-ad43-4b64-a866-04ccd9110ea8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:39:56.300139 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f99fc-ad43-4b64-a866-04ccd9110ea8 service glance] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:39:56.315136 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1424/2855] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:39:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:40:02.874305 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c7fa75-fbe8-426a-8a4f-dc47bd0e0cf6 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:40:02.890874 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c7fa75-fbe8-426a-8a4f-dc47bd0e0cf6 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:40:02.896644 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccda89b-d5e7-47a8-b451-6e9a0ae12ab2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:40:02.897243 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccda89b-d5e7-47a8-b451-6e9a0ae12ab2 service nova] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:40:02.897514 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccda89b-d5e7-47a8-b451-6e9a0ae12ab2 service nova] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:40:02.897777 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccda89b-d5e7-47a8-b451-6e9a0ae12ab2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:40:02.905927 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccda89b-d5e7-47a8-b451-6e9a0ae12ab2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:40:02.907517 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccda89b-d5e7-47a8-b451-6e9a0ae12ab2 service nova] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:40:02.916692 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1432/2856] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:40:02 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:40:06.309075 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=35 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:40:09.439525 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f99fc-ad43-4b64-a866-04ccd9110ea8 service glance] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:40:09.449268 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f99fc-ad43-4b64-a866-04ccd9110ea8 service glance] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:40:09.453694 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90e4465-0130-4fd2-968a-6e3ae84080dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:40:09.454297 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e4465-0130-4fd2-968a-6e3ae84080dd service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:40:09.454570 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e4465-0130-4fd2-968a-6e3ae84080dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:40:09.454837 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e4465-0130-4fd2-968a-6e3ae84080dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:40:09.464711 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90e4465-0130-4fd2-968a-6e3ae84080dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:40:09.466272 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90e4465-0130-4fd2-968a-6e3ae84080dd service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:40:09.475986 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1425/2857] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:40:09 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:40:12.912823 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=9 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:40:19.471699 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=6 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:41:40.732986 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccda89b-d5e7-47a8-b451-6e9a0ae12ab2 service nova] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:40.751762 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccda89b-d5e7-47a8-b451-6e9a0ae12ab2 service nova] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:40.756894 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91755ae-f129-4c33-9c09-9e9e526f4522 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4fc1d11f5641b0b5f301b234282aa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:40.757543 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91755ae-f129-4c33-9c09-9e9e526f4522 service placement] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:40.757819 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91755ae-f129-4c33-9c09-9e9e526f4522 service placement] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:40.758150 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91755ae-f129-4c33-9c09-9e9e526f4522 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:40.767780 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91755ae-f129-4c33-9c09-9e9e526f4522 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:40.769431 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91755ae-f129-4c33-9c09-9e9e526f4522 service placement] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:40.780188 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1433/2858] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:41:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:41:47.250018 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0f5c0-edd1-4620-811d-cfcfc930d7e3 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:47.250561 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0f5c0-edd1-4620-811d-cfcfc930d7e3 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:47.250751 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0f5c0-edd1-4620-811d-cfcfc930d7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:47.273225 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-aeb0f5c0-edd1-4620-811d-cfcfc930d7e3 None None] MFA Rules not processed for user `3b64fa69b8cb4fba8057bc852699f388`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:41:47.274496 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-aeb0f5c0-edd1-4620-811d-cfcfc930d7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:47.281590 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1426/2859] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:41:47 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:41:47.619437 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91755ae-f129-4c33-9c09-9e9e526f4522 service placement] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:41:47.629338 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91755ae-f129-4c33-9c09-9e9e526f4522 service placement] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:41:47.633078 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb02852-a2d9-4308-b4ab-3227789ac6f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:41:47.633666 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb02852-a2d9-4308-b4ab-3227789ac6f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:41:47.633940 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb02852-a2d9-4308-b4ab-3227789ac6f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:41:47.634209 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb02852-a2d9-4308-b4ab-3227789ac6f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:41:47.636362 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-3eb02852-a2d9-4308-b4ab-3227789ac6f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:41:47.647734 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb02852-a2d9-4308-b4ab-3227789ac6f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:41:47.649187 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb02852-a2d9-4308-b4ab-3227789ac6f9 service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:41:47.657805 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1434/2860] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:41:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:41:57.267570 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=3 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:41:57.653934 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=12 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:42:01.852735 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb0f5c0-edd1-4620-811d-cfcfc930d7e3 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:01.869366 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb0f5c0-edd1-4620-811d-cfcfc930d7e3 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:01.875608 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9abb184-d3e7-44eb-818a-4ba8a297793d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:01.876721 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9abb184-d3e7-44eb-818a-4ba8a297793d service nova] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:01.877219 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9abb184-d3e7-44eb-818a-4ba8a297793d service nova] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:01.877647 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9abb184-d3e7-44eb-818a-4ba8a297793d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:01.888946 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9abb184-d3e7-44eb-818a-4ba8a297793d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:01.890854 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9abb184-d3e7-44eb-818a-4ba8a297793d service nova] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:01.902969 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1427/2861] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:42:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:42:11.898072 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=6 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:42:43.566875 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb02852-a2d9-4308-b4ab-3227789ac6f9 service neutron] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:43.579297 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb02852-a2d9-4308-b4ab-3227789ac6f9 service neutron] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:43.584552 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a820c17d-503b-4197-9b86-8ae4d8ab6196 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4fc1d11f5641b0b5f301b234282aa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:43.585161 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820c17d-503b-4197-9b86-8ae4d8ab6196 service placement] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:43.585440 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820c17d-503b-4197-9b86-8ae4d8ab6196 service placement] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:43.585711 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820c17d-503b-4197-9b86-8ae4d8ab6196 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:43.594719 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a820c17d-503b-4197-9b86-8ae4d8ab6196 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:43.596398 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a820c17d-503b-4197-9b86-8ae4d8ab6196 service placement] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:43.606836 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1435/2862] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:42:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:42:48.381489 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9abb184-d3e7-44eb-818a-4ba8a297793d service nova] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:48.393704 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9abb184-d3e7-44eb-818a-4ba8a297793d service nova] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:48.399764 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e8a23e-9768-459c-873b-d3b7c9fca65c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4fc1d11f5641b0b5f301b234282aa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:48.400383 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8a23e-9768-459c-873b-d3b7c9fca65c service placement] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:48.400664 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8a23e-9768-459c-873b-d3b7c9fca65c service placement] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:48.400937 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8a23e-9768-459c-873b-d3b7c9fca65c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:48.402748 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-c0e8a23e-9768-459c-873b-d3b7c9fca65c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:48.416748 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e8a23e-9768-459c-873b-d3b7c9fca65c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:48.418595 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e8a23e-9768-459c-873b-d3b7c9fca65c service placement] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:48.432353 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1428/2863] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:42:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:42:48.655836 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a820c17d-503b-4197-9b86-8ae4d8ab6196 service placement] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:48.745625 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a820c17d-503b-4197-9b86-8ae4d8ab6196 service placement] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:48.750842 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c53ebb3-5c95-4a76-9ab0-2a51b27c3ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:48.751480 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c53ebb3-5c95-4a76-9ab0-2a51b27c3ad8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:48.751794 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c53ebb3-5c95-4a76-9ab0-2a51b27c3ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:48.752067 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c53ebb3-5c95-4a76-9ab0-2a51b27c3ad8 admin admin] PATH_INFO: `/v3/users/3b64fa69b8cb4fba8057bc852699f388` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:48.753413 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c53ebb3-5c95-4a76-9ab0-2a51b27c3ad8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b64fa69b8cb4fba8057bc852699f388)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:48.755397 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c53ebb3-5c95-4a76-9ab0-2a51b27c3ad8 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:48.804976 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-9c53ebb3-5c95-4a76-9ab0-2a51b27c3ad8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b64fa69b8cb4fba8057bc852699f388'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:48.816851 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-9c53ebb3-5c95-4a76-9ab0-2a51b27c3ad8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b64fa69b8cb4fba8057bc852699f388'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:48.825939 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-9c53ebb3-5c95-4a76-9ab0-2a51b27c3ad8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b64fa69b8cb4fba8057bc852699f388'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:48.826637 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-9c53ebb3-5c95-4a76-9ab0-2a51b27c3ad8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b64fa69b8cb4fba8057bc852699f388'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:48.827432 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-9c53ebb3-5c95-4a76-9ab0-2a51b27c3ad8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b64fa69b8cb4fba8057bc852699f388'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:48.840575 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1436/2864] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 01:42:48 2022] DELETE /identity/v3/users/3b64fa69b8cb4fba8057bc852699f388 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:42:48.845561 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e89277f-1edf-49c0-b6fa-ef6ef098ce9d None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:48.845846 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e89277f-1edf-49c0-b6fa-ef6ef098ce9d None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:48.846118 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e89277f-1edf-49c0-b6fa-ef6ef098ce9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:48.891295 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-4e89277f-1edf-49c0-b6fa-ef6ef098ce9d None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:42:48.892593 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-4e89277f-1edf-49c0-b6fa-ef6ef098ce9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:48.956867 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1429/2865] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:42:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:42:48.968664 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c53ebb3-5c95-4a76-9ab0-2a51b27c3ad8 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:48.970293 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-9c53ebb3-5c95-4a76-9ab0-2a51b27c3ad8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:49.026360 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:42:49.030475 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c53ebb3-5c95-4a76-9ab0-2a51b27c3ad8 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:49.036226 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c6523-ec05-45aa-8ffb-619cd77ca91d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:49.036919 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c6523-ec05-45aa-8ffb-619cd77ca91d service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:49.037204 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c6523-ec05-45aa-8ffb-619cd77ca91d service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:49.037462 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c6523-ec05-45aa-8ffb-619cd77ca91d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:49.047249 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2c6523-ec05-45aa-8ffb-619cd77ca91d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:49.048745 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2c6523-ec05-45aa-8ffb-619cd77ca91d service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:49.058806 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1437/2866] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:42:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:42:49.249469 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e89277f-1edf-49c0-b6fa-ef6ef098ce9d None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:49.251117 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-4e89277f-1edf-49c0-b6fa-ef6ef098ce9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:49.263302 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e89277f-1edf-49c0-b6fa-ef6ef098ce9d None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:49.269436 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9910389-001a-4a5d-8f09-c81de2d9d267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:49.270096 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9910389-001a-4a5d-8f09-c81de2d9d267 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:49.270359 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9910389-001a-4a5d-8f09-c81de2d9d267 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:49.270646 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9910389-001a-4a5d-8f09-c81de2d9d267 admin admin] PATH_INFO: `/v3/projects/fa1606ea21ec4b4bbcd133c0eeee0074` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:49.271972 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9910389-001a-4a5d-8f09-c81de2d9d267 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa1606ea21ec4b4bbcd133c0eeee0074)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:49.273938 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9910389-001a-4a5d-8f09-c81de2d9d267 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:49.323770 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-a9910389-001a-4a5d-8f09-c81de2d9d267 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa1606ea21ec4b4bbcd133c0eeee0074', 'request_id': 'req-a9910389-001a-4a5d-8f09-c81de2d9d267'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:49.332813 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-a9910389-001a-4a5d-8f09-c81de2d9d267 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa1606ea21ec4b4bbcd133c0eeee0074', 'request_id': 'req-a9910389-001a-4a5d-8f09-c81de2d9d267'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:49.345688 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-a9910389-001a-4a5d-8f09-c81de2d9d267 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa1606ea21ec4b4bbcd133c0eeee0074', 'request_id': 'req-a9910389-001a-4a5d-8f09-c81de2d9d267'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:49.359581 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-a9910389-001a-4a5d-8f09-c81de2d9d267 admin admin] The token cache is being invalidate because project fa1606ea21ec4b4bbcd133c0eeee0074 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81808) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:42:49.359905 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-a9910389-001a-4a5d-8f09-c81de2d9d267 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:49.360683 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-a9910389-001a-4a5d-8f09-c81de2d9d267 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:49.362468 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1430/2867] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 01:42:49 2022] DELETE /identity/v3/projects/fa1606ea21ec4b4bbcd133c0eeee0074 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:42:49.367301 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c6523-ec05-45aa-8ffb-619cd77ca91d service neutron] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:49.381311 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c6523-ec05-45aa-8ffb-619cd77ca91d service neutron] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:49.446487 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dab5a07-e596-4258-9e75-626e22b9c302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:49.447105 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab5a07-e596-4258-9e75-626e22b9c302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:49.447381 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab5a07-e596-4258-9e75-626e22b9c302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:49.447652 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab5a07-e596-4258-9e75-626e22b9c302 admin admin] PATH_INFO: `/v3/users/27721ee21a1c46a382effb539e4ad28b` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:49.448914 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dab5a07-e596-4258-9e75-626e22b9c302 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27721ee21a1c46a382effb539e4ad28b)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:49.450886 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dab5a07-e596-4258-9e75-626e22b9c302 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:49.504516 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-0dab5a07-e596-4258-9e75-626e22b9c302 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27721ee21a1c46a382effb539e4ad28b'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:49.516311 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-0dab5a07-e596-4258-9e75-626e22b9c302 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27721ee21a1c46a382effb539e4ad28b'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:49.525336 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-0dab5a07-e596-4258-9e75-626e22b9c302 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27721ee21a1c46a382effb539e4ad28b'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:49.525949 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-0dab5a07-e596-4258-9e75-626e22b9c302 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27721ee21a1c46a382effb539e4ad28b'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:49.526675 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-0dab5a07-e596-4258-9e75-626e22b9c302 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27721ee21a1c46a382effb539e4ad28b'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:49.539539 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1438/2868] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 01:42:49 2022] DELETE /identity/v3/users/27721ee21a1c46a382effb539e4ad28b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:42:49.830161 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9910389-001a-4a5d-8f09-c81de2d9d267 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:49.831730 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-a9910389-001a-4a5d-8f09-c81de2d9d267 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:49.845556 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9910389-001a-4a5d-8f09-c81de2d9d267 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:49.895643 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:42:49.908003 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e6c85-8cf5-40cd-9ed2-3582543bb46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:49.908819 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e6c85-8cf5-40cd-9ed2-3582543bb46c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:49.909280 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e6c85-8cf5-40cd-9ed2-3582543bb46c admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:49.909637 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e6c85-8cf5-40cd-9ed2-3582543bb46c admin admin] PATH_INFO: `/v3/projects/c6b08a63a4954d769068d7f4333de1be` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:49.910999 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e6c85-8cf5-40cd-9ed2-3582543bb46c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6b08a63a4954d769068d7f4333de1be)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:49.912987 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e6c85-8cf5-40cd-9ed2-3582543bb46c admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:49.962234 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-e98e6c85-8cf5-40cd-9ed2-3582543bb46c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6b08a63a4954d769068d7f4333de1be', 'request_id': 'req-e98e6c85-8cf5-40cd-9ed2-3582543bb46c'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:49.968739 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-e98e6c85-8cf5-40cd-9ed2-3582543bb46c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6b08a63a4954d769068d7f4333de1be', 'request_id': 'req-e98e6c85-8cf5-40cd-9ed2-3582543bb46c'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:49.977710 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-e98e6c85-8cf5-40cd-9ed2-3582543bb46c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6b08a63a4954d769068d7f4333de1be', 'request_id': 'req-e98e6c85-8cf5-40cd-9ed2-3582543bb46c'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:49.989136 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-e98e6c85-8cf5-40cd-9ed2-3582543bb46c admin admin] The token cache is being invalidate because project c6b08a63a4954d769068d7f4333de1be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81808) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:42:49.989430 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-e98e6c85-8cf5-40cd-9ed2-3582543bb46c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:49.990086 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-e98e6c85-8cf5-40cd-9ed2-3582543bb46c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:42:49.991629 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1431/2869] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 01:42:49 2022] DELETE /identity/v3/projects/c6b08a63a4954d769068d7f4333de1be => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:42:49.996938 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e0a56-583b-4e5b-ab13-7d0f3dd5a3ce None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:49.997480 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e0a56-583b-4e5b-ab13-7d0f3dd5a3ce None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:49.997480 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e0a56-583b-4e5b-ab13-7d0f3dd5a3ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:50.038670 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-1d7e0a56-583b-4e5b-ab13-7d0f3dd5a3ce None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:42:50.039934 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-1d7e0a56-583b-4e5b-ab13-7d0f3dd5a3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:50.106187 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:42:50.119993 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1439/2870] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:42:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:42:50.128561 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d51f89-a571-4944-a8a1-55916fd1b28e None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:50.128909 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d51f89-a571-4944-a8a1-55916fd1b28e None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:50.129175 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d51f89-a571-4944-a8a1-55916fd1b28e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:50.149877 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-c1d51f89-a571-4944-a8a1-55916fd1b28e None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:42:50.151028 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-c1d51f89-a571-4944-a8a1-55916fd1b28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:50.159686 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1432/2871] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:42:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:42:50.164106 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e0a56-583b-4e5b-ab13-7d0f3dd5a3ce None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:50.173750 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e0a56-583b-4e5b-ab13-7d0f3dd5a3ce None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:50.178819 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b04f19-52cc-48f4-ad95-ea9840ae7fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:50.179428 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b04f19-52cc-48f4-ad95-ea9840ae7fc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:50.179709 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b04f19-52cc-48f4-ad95-ea9840ae7fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:50.179995 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b04f19-52cc-48f4-ad95-ea9840ae7fc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:50.180650 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b04f19-52cc-48f4-ad95-ea9840ae7fc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:42:50.180942 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b04f19-52cc-48f4-ad95-ea9840ae7fc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:50.182547 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b04f19-52cc-48f4-ad95-ea9840ae7fc8 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:50.194580 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1440/2872] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 01:42:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 28 01:42:50.200433 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d51f89-a571-4944-a8a1-55916fd1b28e None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:50.210380 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d51f89-a571-4944-a8a1-55916fd1b28e None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:50.215650 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fcd725-29fa-467a-b079-71823a0b12ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:50.216286 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fcd725-29fa-467a-b079-71823a0b12ce admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:50.216562 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fcd725-29fa-467a-b079-71823a0b12ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:50.216833 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fcd725-29fa-467a-b079-71823a0b12ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:50.217474 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fcd725-29fa-467a-b079-71823a0b12ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:50.219379 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fcd725-29fa-467a-b079-71823a0b12ce admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:50.261163 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1433/2873] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 01:42:50 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:42:50.266046 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b04f19-52cc-48f4-ad95-ea9840ae7fc8 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:50.277168 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b04f19-52cc-48f4-ad95-ea9840ae7fc8 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:50.336665 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e7092d-b548-40bb-8f03-a6e3944aa941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:50.337268 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7092d-b548-40bb-8f03-a6e3944aa941 admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:50.337544 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7092d-b548-40bb-8f03-a6e3944aa941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:50.337812 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7092d-b548-40bb-8f03-a6e3944aa941 admin admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:50.338443 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e7092d-b548-40bb-8f03-a6e3944aa941 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:50.340399 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e7092d-b548-40bb-8f03-a6e3944aa941 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:50.365269 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1441/2874] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 01:42:50 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:42:50.369689 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fcd725-29fa-467a-b079-71823a0b12ce admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:50.380707 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fcd725-29fa-467a-b079-71823a0b12ce admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:50.385506 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811547f6-b28f-4d59-b9bd-78d091fa325a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:50.386111 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811547f6-b28f-4d59-b9bd-78d091fa325a admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:50.386419 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811547f6-b28f-4d59-b9bd-78d091fa325a admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:50.386661 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811547f6-b28f-4d59-b9bd-78d091fa325a admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:50.387311 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811547f6-b28f-4d59-b9bd-78d091fa325a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:50.389160 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811547f6-b28f-4d59-b9bd-78d091fa325a admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:50.399414 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1434/2875] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:42:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:42:50.403805 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e7092d-b548-40bb-8f03-a6e3944aa941 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:50.414066 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e7092d-b548-40bb-8f03-a6e3944aa941 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:50.419123 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdfc452-004d-4088-ac65-ddd7554eb327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:50.419764 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdfc452-004d-4088-ac65-ddd7554eb327 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:50.420112 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdfc452-004d-4088-ac65-ddd7554eb327 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:50.420289 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdfc452-004d-4088-ac65-ddd7554eb327 admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:50.420964 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdfc452-004d-4088-ac65-ddd7554eb327 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:50.422563 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdfc452-004d-4088-ac65-ddd7554eb327 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:50.433794 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1442/2876] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:42:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:42:50.438112 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811547f6-b28f-4d59-b9bd-78d091fa325a admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:50.448679 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811547f6-b28f-4d59-b9bd-78d091fa325a admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:50.454068 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfceda87-d3d8-44da-9894-fd1f55b09e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:50.454724 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfceda87-d3d8-44da-9894-fd1f55b09e18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:50.455033 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfceda87-d3d8-44da-9894-fd1f55b09e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:50.455309 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfceda87-d3d8-44da-9894-fd1f55b09e18 admin admin] PATH_INFO: `/v3/projects/85ef648835b14e89a98aaf0513a26468/users/9612e6454fb74effb75bc2aa8c3f7e0d/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:50.471369 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfceda87-d3d8-44da-9894-fd1f55b09e18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85ef648835b14e89a98aaf0513a26468, user_id=9612e6454fb74effb75bc2aa8c3f7e0d, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:50.474133 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfceda87-d3d8-44da-9894-fd1f55b09e18 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:50.491455 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1435/2877] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 01:42:50 2022] PUT /identity/v3/projects/85ef648835b14e89a98aaf0513a26468/users/9612e6454fb74effb75bc2aa8c3f7e0d/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:42:50.497801 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bab68-393a-41e0-8f66-c2313acc3f2c None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:50.498211 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bab68-393a-41e0-8f66-c2313acc3f2c None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:50.498492 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bab68-393a-41e0-8f66-c2313acc3f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:50.517855 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-9e3bab68-393a-41e0-8f66-c2313acc3f2c None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:42:50.519121 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-9e3bab68-393a-41e0-8f66-c2313acc3f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:50.578288 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1443/2878] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:42:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:42:50.588554 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfceda87-d3d8-44da-9894-fd1f55b09e18 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:50.590433 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-cfceda87-d3d8-44da-9894-fd1f55b09e18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:50.651353 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfceda87-d3d8-44da-9894-fd1f55b09e18 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:50.655701 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2263b1f8-43b0-4bc0-b208-860312830e3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:50.656356 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263b1f8-43b0-4bc0-b208-860312830e3b service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:50.656635 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263b1f8-43b0-4bc0-b208-860312830e3b service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:50.656903 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263b1f8-43b0-4bc0-b208-860312830e3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:50.667054 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2263b1f8-43b0-4bc0-b208-860312830e3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:50.668521 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2263b1f8-43b0-4bc0-b208-860312830e3b service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:50.678451 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1436/2879] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:42:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:42:54.766480 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c186f4-12f7-483a-a10f-affe582af39c None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:54.767009 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c186f4-12f7-483a-a10f-affe582af39c None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:54.767009 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c186f4-12f7-483a-a10f-affe582af39c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:54.799760 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-d1c186f4-12f7-483a-a10f-affe582af39c None None] MFA Rules not processed for user `9612e6454fb74effb75bc2aa8c3f7e0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:42:54.801007 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-d1c186f4-12f7-483a-a10f-affe582af39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:54.875382 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:42:54.886313 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1444/2880] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:42:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:42:54.890785 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2263b1f8-43b0-4bc0-b208-860312830e3b service neutron] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:54.900714 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2263b1f8-43b0-4bc0-b208-860312830e3b service neutron] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:54.905331 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22313953-c838-4053-90c2-013e6b7b997e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:54.906029 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22313953-c838-4053-90c2-013e6b7b997e admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:54.906314 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22313953-c838-4053-90c2-013e6b7b997e admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:54.906588 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22313953-c838-4053-90c2-013e6b7b997e admin admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:54.907220 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22313953-c838-4053-90c2-013e6b7b997e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:54.912857 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22313953-c838-4053-90c2-013e6b7b997e admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:54.927160 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:42:54.949314 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1437/2881] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 01:42:54 2022] POST /identity/v3/projects => generated 371 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:42:54.953436 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c186f4-12f7-483a-a10f-affe582af39c None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:54.964934 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c186f4-12f7-483a-a10f-affe582af39c None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:55.029447 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08158535-cfbf-4b06-9376-4228cab7b54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:55.030094 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08158535-cfbf-4b06-9376-4228cab7b54a admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:55.030352 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08158535-cfbf-4b06-9376-4228cab7b54a admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:55.030622 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08158535-cfbf-4b06-9376-4228cab7b54a admin admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:55.031356 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08158535-cfbf-4b06-9376-4228cab7b54a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:55.033364 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08158535-cfbf-4b06-9376-4228cab7b54a admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:55.061392 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1445/2882] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 01:42:54 2022] POST /identity/v3/users => generated 292 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:42:55.063398 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22313953-c838-4053-90c2-013e6b7b997e admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:55.075855 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22313953-c838-4053-90c2-013e6b7b997e admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:55.082106 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b3ebc7-29ab-40a2-9192-69086ffe5c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:55.082413 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3ebc7-29ab-40a2-9192-69086ffe5c11 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:55.082666 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3ebc7-29ab-40a2-9192-69086ffe5c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:55.082952 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b3ebc7-29ab-40a2-9192-69086ffe5c11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:55.083609 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b3ebc7-29ab-40a2-9192-69086ffe5c11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:55.085330 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b3ebc7-29ab-40a2-9192-69086ffe5c11 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:55.097081 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1438/2883] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:42:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 28 01:42:55.101486 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08158535-cfbf-4b06-9376-4228cab7b54a admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:55.112914 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08158535-cfbf-4b06-9376-4228cab7b54a admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:55.117805 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146b037-2167-47d5-adbb-41ddbc2c88fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:55.118490 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146b037-2167-47d5-adbb-41ddbc2c88fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:55.118765 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146b037-2167-47d5-adbb-41ddbc2c88fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:55.119037 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146b037-2167-47d5-adbb-41ddbc2c88fd admin admin] PATH_INFO: `/v3/projects/af61533c6aef4baea8ac3d35b546c9fa/users/27c51996444e4f449734b2bc50b9c6a0/roles/2e4889bb71f9434392c0baba59f2534e` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:55.141995 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f146b037-2167-47d5-adbb-41ddbc2c88fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=af61533c6aef4baea8ac3d35b546c9fa, user_id=27c51996444e4f449734b2bc50b9c6a0, role_id=2e4889bb71f9434392c0baba59f2534e)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:55.144873 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f146b037-2167-47d5-adbb-41ddbc2c88fd admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:55.163139 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1446/2884] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 01:42:55 2022] PUT /identity/v3/projects/af61533c6aef4baea8ac3d35b546c9fa/users/27c51996444e4f449734b2bc50b9c6a0/roles/2e4889bb71f9434392c0baba59f2534e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:42:55.167045 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b3ebc7-29ab-40a2-9192-69086ffe5c11 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:55.185067 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b3ebc7-29ab-40a2-9192-69086ffe5c11 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:55.254962 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9749ecd-7025-4323-8350-c3bf09c94d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:55.255702 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9749ecd-7025-4323-8350-c3bf09c94d13 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:55.256287 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9749ecd-7025-4323-8350-c3bf09c94d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:55.256629 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9749ecd-7025-4323-8350-c3bf09c94d13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:55.257421 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9749ecd-7025-4323-8350-c3bf09c94d13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:55.259157 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9749ecd-7025-4323-8350-c3bf09c94d13 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:55.271788 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1439/2885] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:42:55 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:42:55.275392 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146b037-2167-47d5-adbb-41ddbc2c88fd admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:55.287449 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146b037-2167-47d5-adbb-41ddbc2c88fd admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:55.292117 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc16aee9-8fa6-4bc3-8ec3-8f08b299fa68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:55.292785 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16aee9-8fa6-4bc3-8ec3-8f08b299fa68 admin admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:55.293070 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16aee9-8fa6-4bc3-8ec3-8f08b299fa68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:55.293340 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16aee9-8fa6-4bc3-8ec3-8f08b299fa68 admin admin] PATH_INFO: `/v3/projects/af61533c6aef4baea8ac3d35b546c9fa/users/27c51996444e4f449734b2bc50b9c6a0/roles/2e4889bb71f9434392c0baba59f2534e` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:55.295383 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc16aee9-8fa6-4bc3-8ec3-8f08b299fa68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af61533c6aef4baea8ac3d35b546c9fa, user_id=27c51996444e4f449734b2bc50b9c6a0, role_id=2e4889bb71f9434392c0baba59f2534e)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:42:55.298244 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc16aee9-8fa6-4bc3-8ec3-8f08b299fa68 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:42:55.309927 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1447/2886] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 01:42:55 2022] PUT /identity/v3/projects/af61533c6aef4baea8ac3d35b546c9fa/users/27c51996444e4f449734b2bc50b9c6a0/roles/2e4889bb71f9434392c0baba59f2534e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:42:59.704058 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633eb067-9542-487a-8986-01d80baca1e0 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:59.704667 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633eb067-9542-487a-8986-01d80baca1e0 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:59.704667 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633eb067-9542-487a-8986-01d80baca1e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:59.734510 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-633eb067-9542-487a-8986-01d80baca1e0 None None] MFA Rules not processed for user `27c51996444e4f449734b2bc50b9c6a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:42:59.735754 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-633eb067-9542-487a-8986-01d80baca1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:59.807500 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1440/2887] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:42:59 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:42:59.823706 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc16aee9-8fa6-4bc3-8ec3-8f08b299fa68 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:42:59.825878 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-cc16aee9-8fa6-4bc3-8ec3-8f08b299fa68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:42:59.924685 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc16aee9-8fa6-4bc3-8ec3-8f08b299fa68 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:42:59.932968 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c3c9b0-55f9-454d-ad82-0a575877ce7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:42:59.933877 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3c9b0-55f9-454d-ad82-0a575877ce7e service nova] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:42:59.934473 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3c9b0-55f9-454d-ad82-0a575877ce7e service nova] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:42:59.934830 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3c9b0-55f9-454d-ad82-0a575877ce7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:42:59.984651 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:43:00.004166 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c3c9b0-55f9-454d-ad82-0a575877ce7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:00.005803 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c3c9b0-55f9-454d-ad82-0a575877ce7e service nova] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:00.016489 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1448/2888] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:42:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:43:01.103368 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1de3cc-d099-417b-b0d6-a85f430471ec None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:01.104045 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1de3cc-d099-417b-b0d6-a85f430471ec None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:01.104342 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1de3cc-d099-417b-b0d6-a85f430471ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:01.130172 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-7e1de3cc-d099-417b-b0d6-a85f430471ec None None] MFA Rules not processed for user `9612e6454fb74effb75bc2aa8c3f7e0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:43:01.131653 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-7e1de3cc-d099-417b-b0d6-a85f430471ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:01.140979 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1441/2889] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:43:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:43:04.660162 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c3c9b0-55f9-454d-ad82-0a575877ce7e service nova] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:04.661947 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-55c3c9b0-55f9-454d-ad82-0a575877ce7e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:04.691562 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c3c9b0-55f9-454d-ad82-0a575877ce7e service nova] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:04.700689 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3002c48f-1b11-4985-862f-fe5ea1b67136 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:04.701312 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3002c48f-1b11-4985-862f-fe5ea1b67136 service nova] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:04.701606 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3002c48f-1b11-4985-862f-fe5ea1b67136 service nova] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:04.701879 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3002c48f-1b11-4985-862f-fe5ea1b67136 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:04.703937 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-3002c48f-1b11-4985-862f-fe5ea1b67136 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:04.717856 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3002c48f-1b11-4985-862f-fe5ea1b67136 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:04.720484 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3002c48f-1b11-4985-862f-fe5ea1b67136 service nova] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:04.738885 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1449/2890] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:43:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:43:11.127552 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=74,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:43:11.680126 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1de3cc-d099-417b-b0d6-a85f430471ec None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:43:11.681599 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-7e1de3cc-d099-417b-b0d6-a85f430471ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:43:11.739815 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1de3cc-d099-417b-b0d6-a85f430471ec None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:43:11.743895 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb7345-0988-4334-a5ea-406e42a1a26c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:43:11.744517 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb7345-0988-4334-a5ea-406e42a1a26c service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:43:11.744797 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb7345-0988-4334-a5ea-406e42a1a26c service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:43:11.745065 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb7345-0988-4334-a5ea-406e42a1a26c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:43:11.754794 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eb7345-0988-4334-a5ea-406e42a1a26c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:43:11.756294 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eb7345-0988-4334-a5ea-406e42a1a26c service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:43:11.765929 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1442/2891] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:43:11 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:43:14.739368 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=15 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:43:21.761632 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=26 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:44:42.092269 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3002c48f-1b11-4985-862f-fe5ea1b67136 service nova] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:44:42.106707 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3002c48f-1b11-4985-862f-fe5ea1b67136 service nova] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:44:42.113148 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b08e0-c8be-4cb4-9de9-a231b68d98b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:44:42.113967 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b08e0-c8be-4cb4-9de9-a231b68d98b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:44:42.114311 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b08e0-c8be-4cb4-9de9-a231b68d98b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:44:42.114673 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b08e0-c8be-4cb4-9de9-a231b68d98b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:44:42.117589 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-3c3b08e0-c8be-4cb4-9de9-a231b68d98b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:44:42.130389 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3b08e0-c8be-4cb4-9de9-a231b68d98b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:44:42.131884 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3b08e0-c8be-4cb4-9de9-a231b68d98b8 service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:44:42.140630 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1450/2892] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:44:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:44:52.137035 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=6 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:11.303537 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb7345-0988-4334-a5ea-406e42a1a26c service neutron] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:11.305144 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-81eb7345-0988-4334-a5ea-406e42a1a26c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:11.365788 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb7345-0988-4334-a5ea-406e42a1a26c service neutron] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:11.370377 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217fb3bd-79d3-43c3-9c45-25bdaa393e29 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22053bd9632346aab63814f740415f69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:11.370987 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217fb3bd-79d3-43c3-9c45-25bdaa393e29 service glance] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:11.371353 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217fb3bd-79d3-43c3-9c45-25bdaa393e29 service glance] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:11.371616 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217fb3bd-79d3-43c3-9c45-25bdaa393e29 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:11.373713 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-217fb3bd-79d3-43c3-9c45-25bdaa393e29 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:11.388835 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217fb3bd-79d3-43c3-9c45-25bdaa393e29 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:11.390286 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217fb3bd-79d3-43c3-9c45-25bdaa393e29 service glance] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:11.401854 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1443/2893] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:45:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:45:11.577712 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b08e0-c8be-4cb4-9de9-a231b68d98b8 service neutron] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:11.586686 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b08e0-c8be-4cb4-9de9-a231b68d98b8 service neutron] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:11.590314 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fcf57f-1a79-449e-8597-c22861f0e65f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:11.590907 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fcf57f-1a79-449e-8597-c22861f0e65f service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:11.591180 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fcf57f-1a79-449e-8597-c22861f0e65f service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:11.591443 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fcf57f-1a79-449e-8597-c22861f0e65f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:11.593179 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-33fcf57f-1a79-449e-8597-c22861f0e65f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:11.608388 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fcf57f-1a79-449e-8597-c22861f0e65f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:11.609908 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fcf57f-1a79-449e-8597-c22861f0e65f service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:11.622240 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1451/2894] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:45:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:45:21.396513 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=26 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:21.616487 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=6 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:24.667100 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf3600e-e7c5-4aa7-8a36-78f829d44fe2 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:24.667613 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf3600e-e7c5-4aa7-8a36-78f829d44fe2 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:24.667802 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf3600e-e7c5-4aa7-8a36-78f829d44fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:24.744170 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-9cf3600e-e7c5-4aa7-8a36-78f829d44fe2 None None] MFA Rules not processed for user `cbe0653ed0c04a9080b5c337392de8ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:45:24.745404 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-9cf3600e-e7c5-4aa7-8a36-78f829d44fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:24.827898 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1444/2895] 10.222.0.49 () {58 vars in 1009 bytes} [Sun Aug 28 01:45:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:45:24.874532 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fcf57f-1a79-449e-8597-c22861f0e65f service neutron] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:24.875994 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-33fcf57f-1a79-449e-8597-c22861f0e65f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:24.980878 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fcf57f-1a79-449e-8597-c22861f0e65f service neutron] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:24.986137 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db55c0e-731b-4114-b987-617185a140f2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ce463b940db4f83a6df7e0561a88567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:24.986760 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db55c0e-731b-4114-b987-617185a140f2 service swift] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:24.987036 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db55c0e-731b-4114-b987-617185a140f2 service swift] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:24.987316 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db55c0e-731b-4114-b987-617185a140f2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:24.996108 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db55c0e-731b-4114-b987-617185a140f2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:24.997733 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db55c0e-731b-4114-b987-617185a140f2 service swift] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:25.006663 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1452/2896] 10.222.0.49 () {60 vars in 1384 bytes} [Sun Aug 28 01:45:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:45:26.721198 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf3600e-e7c5-4aa7-8a36-78f829d44fe2 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:26.737005 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf3600e-e7c5-4aa7-8a36-78f829d44fe2 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:26.743767 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1357392f-e162-411e-ab68-485c1a0fa179 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:26.744560 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357392f-e162-411e-ab68-485c1a0fa179 service nova] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:26.744844 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357392f-e162-411e-ab68-485c1a0fa179 service nova] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:26.745116 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357392f-e162-411e-ab68-485c1a0fa179 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:26.746933 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-1357392f-e162-411e-ab68-485c1a0fa179 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:26.761205 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1357392f-e162-411e-ab68-485c1a0fa179 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:26.763020 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1357392f-e162-411e-ab68-485c1a0fa179 service nova] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:26.778292 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1445/2897] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:45:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:45:35.003050 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=41 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:36.770963 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=50 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:37.054321 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27069e70-9f5d-4e6c-b53b-64e8a5c439d4 None None] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:37.054890 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27069e70-9f5d-4e6c-b53b-64e8a5c439d4 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:37.055047 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27069e70-9f5d-4e6c-b53b-64e8a5c439d4 None None] PATH_INFO: `/` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:37.056519 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1453/2898] 10.222.0.49 () {54 vars in 921 bytes} [Sun Aug 28 01:45:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 28 01:45:37.061735 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd14162-3564-43ed-ae55-86ea71bcf1c8 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:37.062150 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd14162-3564-43ed-ae55-86ea71bcf1c8 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:37.062481 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd14162-3564-43ed-ae55-86ea71bcf1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:37.119894 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-cdd14162-3564-43ed-ae55-86ea71bcf1c8 None None] MFA Rules not processed for user `3dc0655c8156457a8fcb006c9fe85eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:45:37.121130 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-cdd14162-3564-43ed-ae55-86ea71bcf1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:37.131773 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1446/2899] 10.222.0.49 () {58 vars in 1018 bytes} [Sun Aug 28 01:45:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:45:37.143443 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27069e70-9f5d-4e6c-b53b-64e8a5c439d4 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:37.154897 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27069e70-9f5d-4e6c-b53b-64e8a5c439d4 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:37.158841 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e79b8b9-c749-4539-8654-63f69d096c43 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22053bd9632346aab63814f740415f69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:37.159554 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e79b8b9-c749-4539-8654-63f69d096c43 service glance] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:37.159864 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e79b8b9-c749-4539-8654-63f69d096c43 service glance] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:37.160132 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e79b8b9-c749-4539-8654-63f69d096c43 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:37.171520 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e79b8b9-c749-4539-8654-63f69d096c43 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:37.173423 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e79b8b9-c749-4539-8654-63f69d096c43 service glance] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:37.185276 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1454/2900] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:45:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:45:37.256306 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd14162-3564-43ed-ae55-86ea71bcf1c8 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:37.266699 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd14162-3564-43ed-ae55-86ea71bcf1c8 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:37.271024 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c769200c-9500-43aa-97f1-f6dc108cc309 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:37.271635 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769200c-9500-43aa-97f1-f6dc108cc309 service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:37.271957 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769200c-9500-43aa-97f1-f6dc108cc309 service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:37.272227 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769200c-9500-43aa-97f1-f6dc108cc309 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:37.274387 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-c769200c-9500-43aa-97f1-f6dc108cc309 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:37.284145 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c769200c-9500-43aa-97f1-f6dc108cc309 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:37.285601 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c769200c-9500-43aa-97f1-f6dc108cc309 service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:37.293810 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1447/2901] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:45:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:45:37.377475 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e79b8b9-c749-4539-8654-63f69d096c43 service glance] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:37.387889 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e79b8b9-c749-4539-8654-63f69d096c43 service glance] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:37.391953 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a09102-7a8c-4241-93c7-bca4b58827d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:37.392558 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a09102-7a8c-4241-93c7-bca4b58827d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:37.392849 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a09102-7a8c-4241-93c7-bca4b58827d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:37.393100 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a09102-7a8c-4241-93c7-bca4b58827d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:37.395095 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-e2a09102-7a8c-4241-93c7-bca4b58827d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:37.409852 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a09102-7a8c-4241-93c7-bca4b58827d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:37.411316 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a09102-7a8c-4241-93c7-bca4b58827d4 service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:37.422610 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1455/2902] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:45:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:45:37.499209 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c769200c-9500-43aa-97f1-f6dc108cc309 service neutron] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:37.501463 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-c769200c-9500-43aa-97f1-f6dc108cc309 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:37.577372 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c769200c-9500-43aa-97f1-f6dc108cc309 service neutron] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:37.583186 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd525d-16b8-435a-b8ec-0353c74658f5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4fc1d11f5641b0b5f301b234282aa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:37.583962 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd525d-16b8-435a-b8ec-0353c74658f5 service placement] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:37.584431 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd525d-16b8-435a-b8ec-0353c74658f5 service placement] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:37.584748 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd525d-16b8-435a-b8ec-0353c74658f5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:37.586722 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-e7bd525d-16b8-435a-b8ec-0353c74658f5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:37.599496 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bd525d-16b8-435a-b8ec-0353c74658f5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:37.601120 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bd525d-16b8-435a-b8ec-0353c74658f5 service placement] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:37.611709 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1448/2903] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:45:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:45:39.434379 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76134ef-2bbc-4946-8a17-8b692ee0f54b None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:39.434901 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76134ef-2bbc-4946-8a17-8b692ee0f54b None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:39.434901 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76134ef-2bbc-4946-8a17-8b692ee0f54b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:39.454566 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-d76134ef-2bbc-4946-8a17-8b692ee0f54b None None] MFA Rules not processed for user `cbe0653ed0c04a9080b5c337392de8ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:45:39.455822 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-d76134ef-2bbc-4946-8a17-8b692ee0f54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:39.463486 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1456/2904] 10.222.0.49 () {58 vars in 1009 bytes} [Sun Aug 28 01:45:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:45:39.475964 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd525d-16b8-435a-b8ec-0353c74658f5 service placement] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:39.488198 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd525d-16b8-435a-b8ec-0353c74658f5 service placement] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:39.493272 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68cada7-6295-4987-b562-307f3b618a63 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ce463b940db4f83a6df7e0561a88567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:39.493883 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68cada7-6295-4987-b562-307f3b618a63 service swift] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:39.494158 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68cada7-6295-4987-b562-307f3b618a63 service swift] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:39.494425 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68cada7-6295-4987-b562-307f3b618a63 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:39.502977 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68cada7-6295-4987-b562-307f3b618a63 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:39.504599 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68cada7-6295-4987-b562-307f3b618a63 service swift] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:39.513598 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1449/2905] 10.222.0.49 () {60 vars in 1384 bytes} [Sun Aug 28 01:45:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:45:49.449512 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=15 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:49.509812 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=57 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:45:50.905180 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b8226f-3a45-4d9d-a45b-e0639d28e4ff None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:50.905703 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b8226f-3a45-4d9d-a45b-e0639d28e4ff None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:50.905703 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b8226f-3a45-4d9d-a45b-e0639d28e4ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:50.928175 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-f7b8226f-3a45-4d9d-a45b-e0639d28e4ff None None] MFA Rules not processed for user `cbe0653ed0c04a9080b5c337392de8ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:45:50.929629 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-f7b8226f-3a45-4d9d-a45b-e0639d28e4ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:45:50.937672 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1457/2906] 10.222.0.49 () {58 vars in 967 bytes} [Sun Aug 28 01:45:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:45:50.950198 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68cada7-6295-4987-b562-307f3b618a63 service swift] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:45:50.960926 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68cada7-6295-4987-b562-307f3b618a63 service swift] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:45:50.965880 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5650ddb6-b7eb-4d7c-905c-fca3693cf81f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ce463b940db4f83a6df7e0561a88567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:45:50.966479 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650ddb6-b7eb-4d7c-905c-fca3693cf81f service swift] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:45:50.966786 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650ddb6-b7eb-4d7c-905c-fca3693cf81f service swift] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:45:50.967076 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650ddb6-b7eb-4d7c-905c-fca3693cf81f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:45:50.976063 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5650ddb6-b7eb-4d7c-905c-fca3693cf81f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:45:50.977626 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5650ddb6-b7eb-4d7c-905c-fca3693cf81f service swift] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:45:50.986466 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1450/2907] 10.222.0.49 () {60 vars in 1384 bytes} [Sun Aug 28 01:45:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 28 01:46:00.921960 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=3 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:46:00.982604 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=6 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:47:06.838357 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c4a6e-175d-44ec-9419-5415c9fb9852 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:47:06.838975 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c4a6e-175d-44ec-9419-5415c9fb9852 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:47:06.838975 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c4a6e-175d-44ec-9419-5415c9fb9852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:47:06.858300 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-450c4a6e-175d-44ec-9419-5415c9fb9852 None None] MFA Rules not processed for user `9612e6454fb74effb75bc2aa8c3f7e0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:47:06.859507 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-450c4a6e-175d-44ec-9419-5415c9fb9852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:47:06.866730 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1458/2908] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:47:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:47:16.853437 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=3 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:47:23.539907 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5650ddb6-b7eb-4d7c-905c-fca3693cf81f service swift] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:47:23.553317 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5650ddb6-b7eb-4d7c-905c-fca3693cf81f service swift] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:47:23.557991 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0c66e8-a797-4758-97aa-c56180d78f43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:47:23.558589 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c66e8-a797-4758-97aa-c56180d78f43 service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:47:23.558858 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c66e8-a797-4758-97aa-c56180d78f43 service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:47:23.559129 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c66e8-a797-4758-97aa-c56180d78f43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:47:23.561304 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-8d0c66e8-a797-4758-97aa-c56180d78f43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:47:23.572528 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0c66e8-a797-4758-97aa-c56180d78f43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:47:23.573950 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0c66e8-a797-4758-97aa-c56180d78f43 service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:47:23.582946 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1451/2909] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:47:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:47:33.578982 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=6 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:47:48.336886 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c4a6e-175d-44ec-9419-5415c9fb9852 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:47:48.338392 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-450c4a6e-175d-44ec-9419-5415c9fb9852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:47:48.412340 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c4a6e-175d-44ec-9419-5415c9fb9852 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:47:48.417469 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe8e1e-db90-488a-9ffa-d0524e67c765 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4fc1d11f5641b0b5f301b234282aa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:47:48.418079 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe8e1e-db90-488a-9ffa-d0524e67c765 service placement] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:47:48.418366 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe8e1e-db90-488a-9ffa-d0524e67c765 service placement] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:47:48.418626 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe8e1e-db90-488a-9ffa-d0524e67c765 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:47:48.420728 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-84fe8e1e-db90-488a-9ffa-d0524e67c765 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:47:48.432447 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fe8e1e-db90-488a-9ffa-d0524e67c765 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:47:48.434050 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fe8e1e-db90-488a-9ffa-d0524e67c765 service placement] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:47:48.444150 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1459/2910] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:47:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:47:58.439931 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=29 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:49:42.360833 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0c66e8-a797-4758-97aa-c56180d78f43 service neutron] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:42.427930 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0c66e8-a797-4758-97aa-c56180d78f43 service neutron] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:42.435138 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6af4e3-e647-4125-8949-2e6cffb9285f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:42.435798 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6af4e3-e647-4125-8949-2e6cffb9285f service nova] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:42.436055 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6af4e3-e647-4125-8949-2e6cffb9285f service nova] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:42.436350 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6af4e3-e647-4125-8949-2e6cffb9285f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:42.445099 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6af4e3-e647-4125-8949-2e6cffb9285f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:42.446697 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6af4e3-e647-4125-8949-2e6cffb9285f service nova] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:42.456441 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1452/2911] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:49:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:49:49.125903 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06f27d-ba72-4863-836a-acb501039338 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:49.126489 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06f27d-ba72-4863-836a-acb501039338 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:49.126489 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06f27d-ba72-4863-836a-acb501039338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:49.181768 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-ff06f27d-ba72-4863-836a-acb501039338 None None] MFA Rules not processed for user `2d14dcd0cb25427291ab8831924184e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:49:49.182980 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-ff06f27d-ba72-4863-836a-acb501039338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:49:49.202954 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1460/2912] 10.222.0.49 () {58 vars in 1062 bytes} [Sun Aug 28 01:49:49 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:49:49.211792 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6af4e3-e647-4125-8949-2e6cffb9285f service nova] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:49.221110 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6af4e3-e647-4125-8949-2e6cffb9285f service nova] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:49.224849 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e38758-fcac-4c96-a1c6-7ad2665b1a99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:49.225452 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e38758-fcac-4c96-a1c6-7ad2665b1a99 service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:49.225724 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e38758-fcac-4c96-a1c6-7ad2665b1a99 service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:49.225987 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e38758-fcac-4c96-a1c6-7ad2665b1a99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:49.234358 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e38758-fcac-4c96-a1c6-7ad2665b1a99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:49.235832 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e38758-fcac-4c96-a1c6-7ad2665b1a99 service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:49.243773 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1453/2913] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:49:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:49:57.744124 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7380e88f-ef46-403c-8874-0f2d07006f09 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:57.744666 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7380e88f-ef46-403c-8874-0f2d07006f09 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:57.744666 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7380e88f-ef46-403c-8874-0f2d07006f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:57.783916 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-7380e88f-ef46-403c-8874-0f2d07006f09 None None] MFA Rules not processed for user `8f4fc1d11f5641b0b5f301b234282aa9`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:49:57.785148 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-7380e88f-ef46-403c-8874-0f2d07006f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:49:57.794098 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1461/2914] 10.222.0.49 () {58 vars in 1018 bytes} [Sun Aug 28 01:49:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:49:57.812739 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e38758-fcac-4c96-a1c6-7ad2665b1a99 service neutron] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:49:57.829213 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e38758-fcac-4c96-a1c6-7ad2665b1a99 service neutron] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:49:57.835343 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2039d2b8-e02d-499e-9b2c-d45ca3f34b8d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4fc1d11f5641b0b5f301b234282aa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:49:57.835976 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039d2b8-e02d-499e-9b2c-d45ca3f34b8d service placement] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:49:57.836293 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039d2b8-e02d-499e-9b2c-d45ca3f34b8d service placement] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:49:57.836543 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039d2b8-e02d-499e-9b2c-d45ca3f34b8d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:49:57.847803 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2039d2b8-e02d-499e-9b2c-d45ca3f34b8d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:49:57.849499 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2039d2b8-e02d-499e-9b2c-d45ca3f34b8d service placement] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:49:57.859900 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1454/2915] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:49:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:50:07.781372 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=27 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:50:07.855628 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=39 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:50:11.896421 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7380e88f-ef46-403c-8874-0f2d07006f09 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:11.906863 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7380e88f-ef46-403c-8874-0f2d07006f09 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:11.911535 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324106c9-d96d-4f86-a016-7f42af75a53c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:11.912174 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324106c9-d96d-4f86-a016-7f42af75a53c service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:11.912447 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324106c9-d96d-4f86-a016-7f42af75a53c service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:11.912707 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324106c9-d96d-4f86-a016-7f42af75a53c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:11.925147 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324106c9-d96d-4f86-a016-7f42af75a53c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:11.926590 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324106c9-d96d-4f86-a016-7f42af75a53c service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:11.938670 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1462/2916] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:50:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:50:13.141298 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a41cb-25ad-4cea-909d-8190911b2080 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:13.141874 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a41cb-25ad-4cea-909d-8190911b2080 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:13.141874 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a41cb-25ad-4cea-909d-8190911b2080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:13.162495 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-ce4a41cb-25ad-4cea-909d-8190911b2080 None None] MFA Rules not processed for user `2d14dcd0cb25427291ab8831924184e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:50:13.163711 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-ce4a41cb-25ad-4cea-909d-8190911b2080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:50:13.171224 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1455/2917] 10.222.0.49 () {58 vars in 1062 bytes} [Sun Aug 28 01:50:13 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:50:13.177523 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324106c9-d96d-4f86-a016-7f42af75a53c service neutron] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:50:13.186535 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324106c9-d96d-4f86-a016-7f42af75a53c service neutron] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:50:13.190468 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e617dba-da99-4275-9ab8-70dd2eec1849 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:50:13.191066 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e617dba-da99-4275-9ab8-70dd2eec1849 service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:50:13.191448 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e617dba-da99-4275-9ab8-70dd2eec1849 service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:50:13.191605 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e617dba-da99-4275-9ab8-70dd2eec1849 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:50:13.202796 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e617dba-da99-4275-9ab8-70dd2eec1849 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:50:13.204287 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e617dba-da99-4275-9ab8-70dd2eec1849 service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:50:13.215684 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1463/2918] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:50:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:50:23.157953 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=3 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:50:23.210667 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=12 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:33.352821 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4a41cb-25ad-4cea-909d-8190911b2080 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:33.377863 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4a41cb-25ad-4cea-909d-8190911b2080 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:33.387971 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c464fb2-9ecf-49b4-b87d-eb7ca7691116 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:33.388873 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c464fb2-9ecf-49b4-b87d-eb7ca7691116 service nova] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:33.389149 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c464fb2-9ecf-49b4-b87d-eb7ca7691116 service nova] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:33.389921 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c464fb2-9ecf-49b4-b87d-eb7ca7691116 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:33.392621 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-5c464fb2-9ecf-49b4-b87d-eb7ca7691116 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:33.419278 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c464fb2-9ecf-49b4-b87d-eb7ca7691116 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:33.421270 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c464fb2-9ecf-49b4-b87d-eb7ca7691116 service nova] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:33.433215 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1456/2919] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:51:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:51:35.864716 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e617dba-da99-4275-9ab8-70dd2eec1849 service neutron] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:35.877059 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e617dba-da99-4275-9ab8-70dd2eec1849 service neutron] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:35.883719 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0cf644-2dd3-4cb4-ab66-3d500fe63189 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:35.884339 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0cf644-2dd3-4cb4-ab66-3d500fe63189 service nova] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:35.885549 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0cf644-2dd3-4cb4-ab66-3d500fe63189 service nova] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:35.885933 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0cf644-2dd3-4cb4-ab66-3d500fe63189 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:35.896702 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0cf644-2dd3-4cb4-ab66-3d500fe63189 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:35.898542 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0cf644-2dd3-4cb4-ab66-3d500fe63189 service nova] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:35.910464 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1464/2920] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:51:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:51:41.679272 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c464fb2-9ecf-49b4-b87d-eb7ca7691116 service nova] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:41.689856 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c464fb2-9ecf-49b4-b87d-eb7ca7691116 service nova] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:41.693537 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb6fa0-4913-43b9-9603-38fa86aba4eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:41.694151 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb6fa0-4913-43b9-9603-38fa86aba4eb service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:41.694426 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb6fa0-4913-43b9-9603-38fa86aba4eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:41.694701 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb6fa0-4913-43b9-9603-38fa86aba4eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:41.760230 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bb6fa0-4913-43b9-9603-38fa86aba4eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:41.761584 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bb6fa0-4913-43b9-9603-38fa86aba4eb service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:41.771249 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1457/2921] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:51:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:51:45.093100 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0cf644-2dd3-4cb4-ab66-3d500fe63189 service nova] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:45.105705 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0cf644-2dd3-4cb4-ab66-3d500fe63189 service nova] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:45.110651 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3306648b-11d3-4a0c-8eea-99b74f00a234 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4fc1d11f5641b0b5f301b234282aa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:45.111289 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3306648b-11d3-4a0c-8eea-99b74f00a234 service placement] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:45.111750 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3306648b-11d3-4a0c-8eea-99b74f00a234 service placement] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:45.111981 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3306648b-11d3-4a0c-8eea-99b74f00a234 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:45.113713 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-3306648b-11d3-4a0c-8eea-99b74f00a234 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:45.127048 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3306648b-11d3-4a0c-8eea-99b74f00a234 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:45.128902 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3306648b-11d3-4a0c-8eea-99b74f00a234 service placement] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:45.141716 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1465/2922] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:51:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:51:48.391779 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb6fa0-4913-43b9-9603-38fa86aba4eb service neutron] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:48.405148 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb6fa0-4913-43b9-9603-38fa86aba4eb service neutron] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:48.410791 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c97f126-a371-4254-9f61-58068ce8a929 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4fc1d11f5641b0b5f301b234282aa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:48.411415 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97f126-a371-4254-9f61-58068ce8a929 service placement] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:48.411737 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97f126-a371-4254-9f61-58068ce8a929 service placement] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:48.412020 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c97f126-a371-4254-9f61-58068ce8a929 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:48.414123 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-3c97f126-a371-4254-9f61-58068ce8a929 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:48.434453 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c97f126-a371-4254-9f61-58068ce8a929 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:48.436326 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c97f126-a371-4254-9f61-58068ce8a929 service placement] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:48.451571 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3306648b-11d3-4a0c-8eea-99b74f00a234 service placement] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:48.454445 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1458/2923] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:51:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:51:48.471243 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3306648b-11d3-4a0c-8eea-99b74f00a234 service placement] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:48.476484 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d7002f-e7cc-4fff-ada6-c8a623091319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:48.477010 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7002f-e7cc-4fff-ada6-c8a623091319 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:48.477303 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7002f-e7cc-4fff-ada6-c8a623091319 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:48.477561 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7002f-e7cc-4fff-ada6-c8a623091319 admin admin] PATH_INFO: `/v3/users/9612e6454fb74effb75bc2aa8c3f7e0d` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:48.478781 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d7002f-e7cc-4fff-ada6-c8a623091319 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9612e6454fb74effb75bc2aa8c3f7e0d)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:48.490866 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d7002f-e7cc-4fff-ada6-c8a623091319 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:48.542754 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-36d7002f-e7cc-4fff-ada6-c8a623091319 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9612e6454fb74effb75bc2aa8c3f7e0d'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:48.554712 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-36d7002f-e7cc-4fff-ada6-c8a623091319 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9612e6454fb74effb75bc2aa8c3f7e0d'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:48.564481 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-36d7002f-e7cc-4fff-ada6-c8a623091319 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9612e6454fb74effb75bc2aa8c3f7e0d'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:48.565318 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-36d7002f-e7cc-4fff-ada6-c8a623091319 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9612e6454fb74effb75bc2aa8c3f7e0d'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:48.565953 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-36d7002f-e7cc-4fff-ada6-c8a623091319 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9612e6454fb74effb75bc2aa8c3f7e0d'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:48.578637 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1466/2924] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 01:51:48 2022] DELETE /identity/v3/users/9612e6454fb74effb75bc2aa8c3f7e0d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:51:48.765064 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c97f126-a371-4254-9f61-58068ce8a929 service placement] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:48.777263 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c97f126-a371-4254-9f61-58068ce8a929 service placement] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:48.837818 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f6ebf8-9388-4162-9514-7fb3d6d5ee71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:48.838451 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f6ebf8-9388-4162-9514-7fb3d6d5ee71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:48.838737 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f6ebf8-9388-4162-9514-7fb3d6d5ee71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:48.839004 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f6ebf8-9388-4162-9514-7fb3d6d5ee71 admin admin] PATH_INFO: `/v3/projects/85ef648835b14e89a98aaf0513a26468` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:48.840230 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f6ebf8-9388-4162-9514-7fb3d6d5ee71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85ef648835b14e89a98aaf0513a26468)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:48.842134 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f6ebf8-9388-4162-9514-7fb3d6d5ee71 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:48.889133 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-55f6ebf8-9388-4162-9514-7fb3d6d5ee71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85ef648835b14e89a98aaf0513a26468', 'request_id': 'req-55f6ebf8-9388-4162-9514-7fb3d6d5ee71'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:48.896607 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-55f6ebf8-9388-4162-9514-7fb3d6d5ee71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85ef648835b14e89a98aaf0513a26468', 'request_id': 'req-55f6ebf8-9388-4162-9514-7fb3d6d5ee71'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:48.900683 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:48.907295 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-55f6ebf8-9388-4162-9514-7fb3d6d5ee71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85ef648835b14e89a98aaf0513a26468', 'request_id': 'req-55f6ebf8-9388-4162-9514-7fb3d6d5ee71'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:48.919529 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-55f6ebf8-9388-4162-9514-7fb3d6d5ee71 admin admin] The token cache is being invalidate because project 85ef648835b14e89a98aaf0513a26468 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81808) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:51:48.919845 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-55f6ebf8-9388-4162-9514-7fb3d6d5ee71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:48.920478 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-55f6ebf8-9388-4162-9514-7fb3d6d5ee71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:48.922006 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1459/2925] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 01:51:48 2022] DELETE /identity/v3/projects/85ef648835b14e89a98aaf0513a26468 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:51:48.926179 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d7002f-e7cc-4fff-ada6-c8a623091319 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:48.927772 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-36d7002f-e7cc-4fff-ada6-c8a623091319 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:48.941725 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d7002f-e7cc-4fff-ada6-c8a623091319 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:49.012361 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81253eff-6b3e-4355-8a0a-25735504ed5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:49.013206 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81253eff-6b3e-4355-8a0a-25735504ed5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:49.013502 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81253eff-6b3e-4355-8a0a-25735504ed5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:49.013774 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81253eff-6b3e-4355-8a0a-25735504ed5d admin admin] PATH_INFO: `/v3/users/27c51996444e4f449734b2bc50b9c6a0` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:49.015777 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81253eff-6b3e-4355-8a0a-25735504ed5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=27c51996444e4f449734b2bc50b9c6a0)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:49.018728 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81253eff-6b3e-4355-8a0a-25735504ed5d admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:49.077073 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-81253eff-6b3e-4355-8a0a-25735504ed5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27c51996444e4f449734b2bc50b9c6a0'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:49.078173 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:49.090622 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-81253eff-6b3e-4355-8a0a-25735504ed5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27c51996444e4f449734b2bc50b9c6a0'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:49.101564 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-81253eff-6b3e-4355-8a0a-25735504ed5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27c51996444e4f449734b2bc50b9c6a0'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:49.102405 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-81253eff-6b3e-4355-8a0a-25735504ed5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27c51996444e4f449734b2bc50b9c6a0'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:49.103227 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-81253eff-6b3e-4355-8a0a-25735504ed5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27c51996444e4f449734b2bc50b9c6a0'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:49.120051 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1467/2926] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 01:51:48 2022] DELETE /identity/v3/users/27c51996444e4f449734b2bc50b9c6a0 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:51:49.310709 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f6ebf8-9388-4162-9514-7fb3d6d5ee71 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:49.312216 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-55f6ebf8-9388-4162-9514-7fb3d6d5ee71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:49.325416 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f6ebf8-9388-4162-9514-7fb3d6d5ee71 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:49.393711 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deaed3c-b94a-478b-adaa-d9227eb21763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:49.394366 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deaed3c-b94a-478b-adaa-d9227eb21763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:49.394680 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deaed3c-b94a-478b-adaa-d9227eb21763 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:49.394955 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deaed3c-b94a-478b-adaa-d9227eb21763 admin admin] PATH_INFO: `/v3/projects/af61533c6aef4baea8ac3d35b546c9fa` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:49.396210 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deaed3c-b94a-478b-adaa-d9227eb21763 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af61533c6aef4baea8ac3d35b546c9fa)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:49.398533 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deaed3c-b94a-478b-adaa-d9227eb21763 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:49.460202 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-7deaed3c-b94a-478b-adaa-d9227eb21763 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af61533c6aef4baea8ac3d35b546c9fa', 'request_id': 'req-7deaed3c-b94a-478b-adaa-d9227eb21763'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:49.466716 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-7deaed3c-b94a-478b-adaa-d9227eb21763 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af61533c6aef4baea8ac3d35b546c9fa', 'request_id': 'req-7deaed3c-b94a-478b-adaa-d9227eb21763'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:49.476428 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-7deaed3c-b94a-478b-adaa-d9227eb21763 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af61533c6aef4baea8ac3d35b546c9fa', 'request_id': 'req-7deaed3c-b94a-478b-adaa-d9227eb21763'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:49.488479 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-7deaed3c-b94a-478b-adaa-d9227eb21763 admin admin] The token cache is being invalidate because project af61533c6aef4baea8ac3d35b546c9fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81808) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:51:49.488944 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-7deaed3c-b94a-478b-adaa-d9227eb21763 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:49.489690 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-7deaed3c-b94a-478b-adaa-d9227eb21763 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:51:49.491228 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1460/2927] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 01:51:49 2022] DELETE /identity/v3/projects/af61533c6aef4baea8ac3d35b546c9fa => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:51:49.496496 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9f69e-689d-4c7d-ad4a-9d2e848394a9 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:49.497012 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9f69e-689d-4c7d-ad4a-9d2e848394a9 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:49.497102 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab9f69e-689d-4c7d-ad4a-9d2e848394a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:49.517988 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-6ab9f69e-689d-4c7d-ad4a-9d2e848394a9 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:51:49.519217 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-6ab9f69e-689d-4c7d-ad4a-9d2e848394a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:49.584923 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1468/2928] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:51:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:51:49.593072 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e40a3e3-feff-4a3d-b0f5-2d891ab3d749 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:49.593364 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e40a3e3-feff-4a3d-b0f5-2d891ab3d749 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:49.593615 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e40a3e3-feff-4a3d-b0f5-2d891ab3d749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:49.614884 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-8e40a3e3-feff-4a3d-b0f5-2d891ab3d749 None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:51:49.616139 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-8e40a3e3-feff-4a3d-b0f5-2d891ab3d749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:49.625903 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1461/2929] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:51:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:51:49.631213 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab9f69e-689d-4c7d-ad4a-9d2e848394a9 None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:49.641164 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab9f69e-689d-4c7d-ad4a-9d2e848394a9 None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:49.646555 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce525611-f7bc-4a71-9ff2-56bd49fdc94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:49.647155 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce525611-f7bc-4a71-9ff2-56bd49fdc94e admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:49.647427 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce525611-f7bc-4a71-9ff2-56bd49fdc94e admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:49.647687 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce525611-f7bc-4a71-9ff2-56bd49fdc94e admin admin] PATH_INFO: `/v3/domains` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:49.648381 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce525611-f7bc-4a71-9ff2-56bd49fdc94e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81807) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 28 01:51:49.648677 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce525611-f7bc-4a71-9ff2-56bd49fdc94e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:49.650317 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce525611-f7bc-4a71-9ff2-56bd49fdc94e admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:49.662652 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1469/2930] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 28 01:51:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 28 01:51:49.667569 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e40a3e3-feff-4a3d-b0f5-2d891ab3d749 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:49.677424 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e40a3e3-feff-4a3d-b0f5-2d891ab3d749 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:49.682879 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa63f03-9bc3-4cd2-88ff-68889b69b81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:49.683496 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa63f03-9bc3-4cd2-88ff-68889b69b81b admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:49.683836 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa63f03-9bc3-4cd2-88ff-68889b69b81b admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:49.684111 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa63f03-9bc3-4cd2-88ff-68889b69b81b admin admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:49.684785 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa63f03-9bc3-4cd2-88ff-68889b69b81b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:49.686730 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa63f03-9bc3-4cd2-88ff-68889b69b81b admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:49.720316 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1462/2931] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 01:51:49 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:51:49.722524 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce525611-f7bc-4a71-9ff2-56bd49fdc94e admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:49.733049 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce525611-f7bc-4a71-9ff2-56bd49fdc94e admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:49.791165 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fde2f7-53bd-44d7-bc74-296c4f75a55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:49.791797 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fde2f7-53bd-44d7-bc74-296c4f75a55a admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:49.792421 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fde2f7-53bd-44d7-bc74-296c4f75a55a admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:49.792711 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fde2f7-53bd-44d7-bc74-296c4f75a55a admin admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:49.793349 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fde2f7-53bd-44d7-bc74-296c4f75a55a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:49.795255 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fde2f7-53bd-44d7-bc74-296c4f75a55a admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:49.817221 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1470/2932] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 01:51:49 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:51:49.822366 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa63f03-9bc3-4cd2-88ff-68889b69b81b admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:49.834463 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa63f03-9bc3-4cd2-88ff-68889b69b81b admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:49.839370 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122bd23d-495c-42a3-ada4-4dbfaef8d6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:49.840007 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122bd23d-495c-42a3-ada4-4dbfaef8d6bb admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:49.840284 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122bd23d-495c-42a3-ada4-4dbfaef8d6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:49.840552 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122bd23d-495c-42a3-ada4-4dbfaef8d6bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:49.841201 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122bd23d-495c-42a3-ada4-4dbfaef8d6bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:49.842817 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122bd23d-495c-42a3-ada4-4dbfaef8d6bb admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:49.853146 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1463/2933] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:51:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:51:49.857358 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fde2f7-53bd-44d7-bc74-296c4f75a55a admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:49.868177 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fde2f7-53bd-44d7-bc74-296c4f75a55a admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:49.873468 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b959f398-b50a-407b-a1d2-8f691969b117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:49.874110 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b959f398-b50a-407b-a1d2-8f691969b117 admin admin] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:49.874389 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b959f398-b50a-407b-a1d2-8f691969b117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:49.874655 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b959f398-b50a-407b-a1d2-8f691969b117 admin admin] PATH_INFO: `/v3/roles` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:49.875294 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b959f398-b50a-407b-a1d2-8f691969b117 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:49.876959 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b959f398-b50a-407b-a1d2-8f691969b117 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:49.887883 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1471/2934] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:51:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:51:49.892235 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122bd23d-495c-42a3-ada4-4dbfaef8d6bb admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:49.903179 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122bd23d-495c-42a3-ada4-4dbfaef8d6bb admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:49.908546 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb0803-bb55-44c2-8b10-c0bef29e7bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:49.909206 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb0803-bb55-44c2-8b10-c0bef29e7bca admin admin] REQUEST_METHOD: `PUT` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:49.909487 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb0803-bb55-44c2-8b10-c0bef29e7bca admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:49.909760 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bb0803-bb55-44c2-8b10-c0bef29e7bca admin admin] PATH_INFO: `/v3/projects/95f6f0af13614cfda966b6650d21e64b/users/04fa4b08456c4f5b8302cbb9ccc37219/roles/7ac2391cc85a4d138e95e27cd0d09b26` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:49.925771 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bb0803-bb55-44c2-8b10-c0bef29e7bca admin admin] RBAC: Authorizing `identity:create_grant(project_id=95f6f0af13614cfda966b6650d21e64b, user_id=04fa4b08456c4f5b8302cbb9ccc37219, role_id=7ac2391cc85a4d138e95e27cd0d09b26)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:49.928602 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bb0803-bb55-44c2-8b10-c0bef29e7bca admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:49.943488 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1464/2935] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 01:51:49 2022] PUT /identity/v3/projects/95f6f0af13614cfda966b6650d21e64b/users/04fa4b08456c4f5b8302cbb9ccc37219/roles/7ac2391cc85a4d138e95e27cd0d09b26 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:51:49.948801 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c6654-421b-4a4d-8f4b-4eb564c8d8ad None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:49.949090 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c6654-421b-4a4d-8f4b-4eb564c8d8ad None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:49.949361 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3c6654-421b-4a4d-8f4b-4eb564c8d8ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:49.968533 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-3d3c6654-421b-4a4d-8f4b-4eb564c8d8ad None None] MFA Rules not processed for user `8474eba1fd11486db87ca8aa2a114668`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:51:49.969748 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-3d3c6654-421b-4a4d-8f4b-4eb564c8d8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:49.997233 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:50.034960 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1472/2936] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:51:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:51:50.045284 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb0803-bb55-44c2-8b10-c0bef29e7bca admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:50.047172 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-e7bb0803-bb55-44c2-8b10-c0bef29e7bca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:50.061887 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:50.107345 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bb0803-bb55-44c2-8b10-c0bef29e7bca admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:50.111777 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52600239-268f-4c5d-be0f-fa28dc3edae9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:50.112352 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52600239-268f-4c5d-be0f-fa28dc3edae9 service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:50.112633 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52600239-268f-4c5d-be0f-fa28dc3edae9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:50.112904 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52600239-268f-4c5d-be0f-fa28dc3edae9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:50.122125 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52600239-268f-4c5d-be0f-fa28dc3edae9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:50.123596 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52600239-268f-4c5d-be0f-fa28dc3edae9 service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:50.133389 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1465/2937] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:51:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:51:54.368038 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a936b5e-64af-4ad5-9f7e-9f1c0821696f None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:54.368566 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a936b5e-64af-4ad5-9f7e-9f1c0821696f None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:54.368566 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a936b5e-64af-4ad5-9f7e-9f1c0821696f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:54.402544 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-8a936b5e-64af-4ad5-9f7e-9f1c0821696f None None] MFA Rules not processed for user `04fa4b08456c4f5b8302cbb9ccc37219`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:51:54.403863 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-8a936b5e-64af-4ad5-9f7e-9f1c0821696f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:54.473884 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1473/2938] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:51:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:51:54.478241 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52600239-268f-4c5d-be0f-fa28dc3edae9 service neutron] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:54.488845 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52600239-268f-4c5d-be0f-fa28dc3edae9 service neutron] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:54.495076 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba4274d-66c1-4bc0-8432-8c936965e9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:54.495657 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4274d-66c1-4bc0-8432-8c936965e9c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:54.496098 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4274d-66c1-4bc0-8432-8c936965e9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:54.496231 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4274d-66c1-4bc0-8432-8c936965e9c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:54.496898 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba4274d-66c1-4bc0-8432-8c936965e9c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:54.498891 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba4274d-66c1-4bc0-8432-8c936965e9c7 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:54.531200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1466/2939] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 28 01:51:54 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:51:54.535237 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a936b5e-64af-4ad5-9f7e-9f1c0821696f None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:54.547712 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a936b5e-64af-4ad5-9f7e-9f1c0821696f None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:54.607886 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbc084a-8a2b-4665-b120-f1c85456c7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:54.608506 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc084a-8a2b-4665-b120-f1c85456c7bd admin admin] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:54.608784 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc084a-8a2b-4665-b120-f1c85456c7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:54.609052 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbc084a-8a2b-4665-b120-f1c85456c7bd admin admin] PATH_INFO: `/v3/users` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:54.609737 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbc084a-8a2b-4665-b120-f1c85456c7bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:54.611707 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbc084a-8a2b-4665-b120-f1c85456c7bd admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:54.636348 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1474/2940] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 28 01:51:54 2022] POST /identity/v3/users => generated 294 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 28 01:51:54.640631 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba4274d-66c1-4bc0-8432-8c936965e9c7 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:54.651519 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba4274d-66c1-4bc0-8432-8c936965e9c7 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:54.656563 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8128745f-6cd5-40c8-a931-b1cab45a3441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:54.657296 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128745f-6cd5-40c8-a931-b1cab45a3441 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:54.657640 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128745f-6cd5-40c8-a931-b1cab45a3441 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:54.658118 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128745f-6cd5-40c8-a931-b1cab45a3441 admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:54.658853 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8128745f-6cd5-40c8-a931-b1cab45a3441 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:54.660588 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8128745f-6cd5-40c8-a931-b1cab45a3441 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:54.672368 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1467/2941] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:51:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:51:54.676838 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbc084a-8a2b-4665-b120-f1c85456c7bd admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:54.687419 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbc084a-8a2b-4665-b120-f1c85456c7bd admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:54.692286 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee67683-796d-4ce9-a550-43ee8c69caf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:54.693028 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee67683-796d-4ce9-a550-43ee8c69caf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:54.693310 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee67683-796d-4ce9-a550-43ee8c69caf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:54.693582 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee67683-796d-4ce9-a550-43ee8c69caf0 admin admin] PATH_INFO: `/v3/projects/30b3a9324d074d52bb1939420615234d/users/35c8613b5ba847d486b5649b08c3aedd/roles/2e4889bb71f9434392c0baba59f2534e` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:54.710588 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee67683-796d-4ce9-a550-43ee8c69caf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30b3a9324d074d52bb1939420615234d, user_id=35c8613b5ba847d486b5649b08c3aedd, role_id=2e4889bb71f9434392c0baba59f2534e)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:54.713342 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee67683-796d-4ce9-a550-43ee8c69caf0 admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:54.730901 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1475/2942] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 01:51:54 2022] PUT /identity/v3/projects/30b3a9324d074d52bb1939420615234d/users/35c8613b5ba847d486b5649b08c3aedd/roles/2e4889bb71f9434392c0baba59f2534e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 28 01:51:54.735009 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8128745f-6cd5-40c8-a931-b1cab45a3441 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:54.746474 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8128745f-6cd5-40c8-a931-b1cab45a3441 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:54.806663 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe06c53-72f9-4e04-affd-8e38cf3b1372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:54.807295 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe06c53-72f9-4e04-affd-8e38cf3b1372 admin admin] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:54.807573 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe06c53-72f9-4e04-affd-8e38cf3b1372 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:54.807878 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe06c53-72f9-4e04-affd-8e38cf3b1372 admin admin] PATH_INFO: `/v3/roles` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:54.808537 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe06c53-72f9-4e04-affd-8e38cf3b1372 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:54.810153 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe06c53-72f9-4e04-affd-8e38cf3b1372 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:54.821339 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1468/2943] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 28 01:51:54 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 28 01:51:54.825508 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee67683-796d-4ce9-a550-43ee8c69caf0 admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:54.836885 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee67683-796d-4ce9-a550-43ee8c69caf0 admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:54.842559 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4014a152-a655-4c2a-995b-b42fd574c7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:54.843159 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4014a152-a655-4c2a-995b-b42fd574c7cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:54.843443 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4014a152-a655-4c2a-995b-b42fd574c7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:54.843752 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4014a152-a655-4c2a-995b-b42fd574c7cf admin admin] PATH_INFO: `/v3/projects/30b3a9324d074d52bb1939420615234d/users/35c8613b5ba847d486b5649b08c3aedd/roles/2e4889bb71f9434392c0baba59f2534e` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:54.845761 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4014a152-a655-4c2a-995b-b42fd574c7cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=30b3a9324d074d52bb1939420615234d, user_id=35c8613b5ba847d486b5649b08c3aedd, role_id=2e4889bb71f9434392c0baba59f2534e)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:54.848577 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4014a152-a655-4c2a-995b-b42fd574c7cf admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:54.859589 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1476/2944] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 28 01:51:54 2022] PUT /identity/v3/projects/30b3a9324d074d52bb1939420615234d/users/35c8613b5ba847d486b5649b08c3aedd/roles/2e4889bb71f9434392c0baba59f2534e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:51:59.273130 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaef161-0bbe-4e75-9aff-c277338ab72e None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:59.273725 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaef161-0bbe-4e75-9aff-c277338ab72e None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:59.273725 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaef161-0bbe-4e75-9aff-c277338ab72e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:59.310408 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-5aaef161-0bbe-4e75-9aff-c277338ab72e None None] MFA Rules not processed for user `35c8613b5ba847d486b5649b08c3aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:51:59.311693 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-5aaef161-0bbe-4e75-9aff-c277338ab72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:59.389920 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1469/2945] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:51:59 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:51:59.407705 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4014a152-a655-4c2a-995b-b42fd574c7cf admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:51:59.410707 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-4014a152-a655-4c2a-995b-b42fd574c7cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:51:59.431794 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:51:59.512674 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4014a152-a655-4c2a-995b-b42fd574c7cf admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:51:59.520384 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afed6a4-92a4-4179-aacc-9953779c36d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:51:59.521071 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afed6a4-92a4-4179-aacc-9953779c36d7 service nova] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:51:59.521330 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afed6a4-92a4-4179-aacc-9953779c36d7 service nova] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:51:59.521624 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afed6a4-92a4-4179-aacc-9953779c36d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:51:59.586238 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afed6a4-92a4-4179-aacc-9953779c36d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:51:59.587901 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afed6a4-92a4-4179-aacc-9953779c36d7 service nova] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:51:59.598701 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1477/2946] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:51:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:52:00.749592 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8939a4-8d81-47be-a85e-55e4ac9a31a4 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:00.750177 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8939a4-8d81-47be-a85e-55e4ac9a31a4 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:00.750177 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8939a4-8d81-47be-a85e-55e4ac9a31a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:00.759037 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:00.771628 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-ce8939a4-8d81-47be-a85e-55e4ac9a31a4 None None] MFA Rules not processed for user `04fa4b08456c4f5b8302cbb9ccc37219`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:52:00.772934 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-ce8939a4-8d81-47be-a85e-55e4ac9a31a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:00.780115 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1470/2947] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:52:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:52:01.460266 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b2845-1809-477d-a60a-42412562a0ac None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:01.460788 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b2845-1809-477d-a60a-42412562a0ac None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:01.460901 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b2845-1809-477d-a60a-42412562a0ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:01.488390 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-dc9b2845-1809-477d-a60a-42412562a0ac None None] MFA Rules not processed for user `8f4fc1d11f5641b0b5f301b234282aa9`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:52:01.489640 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-dc9b2845-1809-477d-a60a-42412562a0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:01.566979 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1478/2948] 10.222.0.49 () {58 vars in 1018 bytes} [Sun Aug 28 01:52:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:52:01.579934 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8939a4-8d81-47be-a85e-55e4ac9a31a4 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:01.581537 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-ce8939a4-8d81-47be-a85e-55e4ac9a31a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:01.598018 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8939a4-8d81-47be-a85e-55e4ac9a31a4 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:01.602841 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9badf25-d7c8-40da-9f36-d963c09e473a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4fc1d11f5641b0b5f301b234282aa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:01.603586 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9badf25-d7c8-40da-9f36-d963c09e473a service placement] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:01.603988 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9badf25-d7c8-40da-9f36-d963c09e473a service placement] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:01.604323 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9badf25-d7c8-40da-9f36-d963c09e473a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:01.615173 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9badf25-d7c8-40da-9f36-d963c09e473a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:01.616816 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9badf25-d7c8-40da-9f36-d963c09e473a service placement] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:01.627237 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1471/2949] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:52:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:52:10.838457 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9b2845-1809-477d-a60a-42412562a0ac None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:10.840313 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-dc9b2845-1809-477d-a60a-42412562a0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:10.858406 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9b2845-1809-477d-a60a-42412562a0ac None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:10.864170 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c1cdf3-8c5f-4356-b821-722d2f98f6cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:10.864876 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c1cdf3-8c5f-4356-b821-722d2f98f6cf service nova] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:10.865154 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c1cdf3-8c5f-4356-b821-722d2f98f6cf service nova] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:10.865427 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c1cdf3-8c5f-4356-b821-722d2f98f6cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:10.867217 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-40c1cdf3-8c5f-4356-b821-722d2f98f6cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:10.881688 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c1cdf3-8c5f-4356-b821-722d2f98f6cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:10.883318 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c1cdf3-8c5f-4356-b821-722d2f98f6cf service nova] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:10.897048 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1479/2950] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:52:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:52:11.623351 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=7 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:13.605308 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9badf25-d7c8-40da-9f36-d963c09e473a service placement] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:13.671551 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9badf25-d7c8-40da-9f36-d963c09e473a service placement] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:13.675522 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f108df95-a25f-41bf-a5cc-1a11ee561db2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:13.676173 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108df95-a25f-41bf-a5cc-1a11ee561db2 service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:13.676442 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108df95-a25f-41bf-a5cc-1a11ee561db2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:13.676708 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108df95-a25f-41bf-a5cc-1a11ee561db2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:13.686030 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f108df95-a25f-41bf-a5cc-1a11ee561db2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:13.687450 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f108df95-a25f-41bf-a5cc-1a11ee561db2 service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:13.697254 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1472/2951] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:52:13 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:52:20.890204 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=85 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:23.692940 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=26 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:52:57.381725 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c1cdf3-8c5f-4356-b821-722d2f98f6cf service nova] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:52:57.395997 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c1cdf3-8c5f-4356-b821-722d2f98f6cf service nova] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:52:57.401848 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74161a57-aae5-494b-b2cf-95e7b5d7f2dc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4fc1d11f5641b0b5f301b234282aa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:52:57.402444 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74161a57-aae5-494b-b2cf-95e7b5d7f2dc service placement] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:52:57.402720 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74161a57-aae5-494b-b2cf-95e7b5d7f2dc service placement] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:52:57.402990 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74161a57-aae5-494b-b2cf-95e7b5d7f2dc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:52:57.404984 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-74161a57-aae5-494b-b2cf-95e7b5d7f2dc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:52:57.418057 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74161a57-aae5-494b-b2cf-95e7b5d7f2dc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:52:57.419696 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74161a57-aae5-494b-b2cf-95e7b5d7f2dc service placement] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:52:57.430717 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1480/2952] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:52:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:53:07.426025 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=6 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:53:57.388615 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5127fa7-95eb-4616-81e8-34a36e4f8e82 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:57.389304 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5127fa7-95eb-4616-81e8-34a36e4f8e82 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:57.389304 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5127fa7-95eb-4616-81e8-34a36e4f8e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:57.410858 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-c5127fa7-95eb-4616-81e8-34a36e4f8e82 None None] MFA Rules not processed for user `8f4fc1d11f5641b0b5f301b234282aa9`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:53:57.412137 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-c5127fa7-95eb-4616-81e8-34a36e4f8e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:57.422642 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1473/2953] 10.222.0.47 () {58 vars in 1015 bytes} [Sun Aug 28 01:53:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:53:57.437083 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74161a57-aae5-494b-b2cf-95e7b5d7f2dc service placement] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:53:57.438661 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-74161a57-aae5-494b-b2cf-95e7b5d7f2dc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:53:57.452003 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74161a57-aae5-494b-b2cf-95e7b5d7f2dc service placement] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:53:57.458086 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9246b778-5bc3-4c82-93be-ca0d8daca6a4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4fc1d11f5641b0b5f301b234282aa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:53:57.458683 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246b778-5bc3-4c82-93be-ca0d8daca6a4 service placement] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:53:57.458959 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246b778-5bc3-4c82-93be-ca0d8daca6a4 service placement] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:53:57.459223 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246b778-5bc3-4c82-93be-ca0d8daca6a4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:53:57.468242 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9246b778-5bc3-4c82-93be-ca0d8daca6a4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:53:57.469832 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9246b778-5bc3-4c82-93be-ca0d8daca6a4 service placement] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:53:57.479851 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1481/2954] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:53:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:54:07.405334 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=3 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:54:07.475720 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=6 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:54:14.671558 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e41e8f-39ef-42d9-88d0-af0abc401c83 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:14.672095 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e41e8f-39ef-42d9-88d0-af0abc401c83 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:14.672095 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e41e8f-39ef-42d9-88d0-af0abc401c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:14.692206 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-55e41e8f-39ef-42d9-88d0-af0abc401c83 None None] MFA Rules not processed for user `cbe0653ed0c04a9080b5c337392de8ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:54:14.693448 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-55e41e8f-39ef-42d9-88d0-af0abc401c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:54:14.753732 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1474/2955] 10.222.0.49 () {58 vars in 1009 bytes} [Sun Aug 28 01:54:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:54:14.802440 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b6f47-85c5-4fc9-b2bc-7732c33463e1 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:14.802874 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b6f47-85c5-4fc9-b2bc-7732c33463e1 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:14.802979 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b6f47-85c5-4fc9-b2bc-7732c33463e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:14.842705 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-550b6f47-85c5-4fc9-b2bc-7732c33463e1 None None] MFA Rules not processed for user `4ce463b940db4f83a6df7e0561a88567`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:54:14.843985 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-550b6f47-85c5-4fc9-b2bc-7732c33463e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:54:14.913387 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1482/2956] 10.222.0.49 () {58 vars in 1040 bytes} [Sun Aug 28 01:54:14 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:54:14.920118 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e41e8f-39ef-42d9-88d0-af0abc401c83 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:54:14.932619 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e41e8f-39ef-42d9-88d0-af0abc401c83 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:54:14.937919 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba1bb9-77c1-45a9-9cdf-09fcdf4c2d87 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ce463b940db4f83a6df7e0561a88567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:54:14.938521 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba1bb9-77c1-45a9-9cdf-09fcdf4c2d87 service swift] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:14.938835 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba1bb9-77c1-45a9-9cdf-09fcdf4c2d87 service swift] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:14.939100 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba1bb9-77c1-45a9-9cdf-09fcdf4c2d87 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:14.947600 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba1bb9-77c1-45a9-9cdf-09fcdf4c2d87 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:54:14.949205 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba1bb9-77c1-45a9-9cdf-09fcdf4c2d87 service swift] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:54:14.957286 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1475/2957] 10.222.0.49 () {60 vars in 1384 bytes} [Sun Aug 28 01:54:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:54:24.195418 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67627cb5-7c82-4186-88fa-98d5110fd183 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:24.196006 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67627cb5-7c82-4186-88fa-98d5110fd183 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:24.196006 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67627cb5-7c82-4186-88fa-98d5110fd183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:24.216429 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-67627cb5-7c82-4186-88fa-98d5110fd183 None None] MFA Rules not processed for user `04fa4b08456c4f5b8302cbb9ccc37219`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:54:24.217654 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-67627cb5-7c82-4186-88fa-98d5110fd183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:54:24.225508 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1483/2958] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 28 01:54:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:54:24.566828 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba1bb9-77c1-45a9-9cdf-09fcdf4c2d87 service swift] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:54:24.577052 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba1bb9-77c1-45a9-9cdf-09fcdf4c2d87 service swift] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:54:24.581321 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd9069-9937-47b6-84a8-8635bdf67abd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:54:24.581926 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd9069-9937-47b6-84a8-8635bdf67abd service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:24.582205 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd9069-9937-47b6-84a8-8635bdf67abd service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:24.582476 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd9069-9937-47b6-84a8-8635bdf67abd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:24.584372 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-45cd9069-9937-47b6-84a8-8635bdf67abd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:54:24.593994 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cd9069-9937-47b6-84a8-8635bdf67abd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:54:24.595497 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cd9069-9937-47b6-84a8-8635bdf67abd service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:54:24.603587 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1476/2959] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:54:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:54:26.382426 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1797471-18d8-4a0a-b96f-44a573cc89aa None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:26.382935 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1797471-18d8-4a0a-b96f-44a573cc89aa None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:26.382935 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1797471-18d8-4a0a-b96f-44a573cc89aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:26.402547 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-d1797471-18d8-4a0a-b96f-44a573cc89aa None None] MFA Rules not processed for user `cbe0653ed0c04a9080b5c337392de8ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:54:26.403806 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-d1797471-18d8-4a0a-b96f-44a573cc89aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:54:26.411235 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1484/2960] 10.222.0.49 () {58 vars in 1009 bytes} [Sun Aug 28 01:54:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:54:26.423649 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd9069-9937-47b6-84a8-8635bdf67abd service neutron] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:54:26.436642 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd9069-9937-47b6-84a8-8635bdf67abd service neutron] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:54:26.442782 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c0719f-34e6-48fe-824d-2b59f23b4b9b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ce463b940db4f83a6df7e0561a88567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:54:26.443397 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0719f-34e6-48fe-824d-2b59f23b4b9b service swift] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:26.443691 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0719f-34e6-48fe-824d-2b59f23b4b9b service swift] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:26.443972 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c0719f-34e6-48fe-824d-2b59f23b4b9b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:26.453037 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c0719f-34e6-48fe-824d-2b59f23b4b9b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:54:26.454693 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c0719f-34e6-48fe-824d-2b59f23b4b9b service swift] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:54:26.463200 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1477/2961] 10.222.0.49 () {60 vars in 1384 bytes} [Sun Aug 28 01:54:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:54:36.397672 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=41 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:54:36.459840 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=43 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:54:55.073432 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1797471-18d8-4a0a-b96f-44a573cc89aa None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:54:55.083380 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1797471-18d8-4a0a-b96f-44a573cc89aa None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:54:55.087307 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b88300-5c2c-491b-9135-6d075ba3e247 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:54:55.087936 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b88300-5c2c-491b-9135-6d075ba3e247 service neutron] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:54:55.088212 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b88300-5c2c-491b-9135-6d075ba3e247 service neutron] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:54:55.088480 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b88300-5c2c-491b-9135-6d075ba3e247 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:54:55.090396 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-b5b88300-5c2c-491b-9135-6d075ba3e247 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:54:55.100364 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b88300-5c2c-491b-9135-6d075ba3e247 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:54:55.101876 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b88300-5c2c-491b-9135-6d075ba3e247 service neutron] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:54:55.110022 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1485/2962] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:54:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:55:05.106557 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=6 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:56:14.318689 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b490e4-2134-4ad5-8bc4-72bbaacb593d None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:56:14.319333 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b490e4-2134-4ad5-8bc4-72bbaacb593d None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:56:14.319333 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b490e4-2134-4ad5-8bc4-72bbaacb593d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:56:14.379292 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-10b490e4-2134-4ad5-8bc4-72bbaacb593d None None] MFA Rules not processed for user `3dc0655c8156457a8fcb006c9fe85eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:56:14.380550 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-10b490e4-2134-4ad5-8bc4-72bbaacb593d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:56:14.391057 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1478/2963] 10.222.0.49 () {58 vars in 1059 bytes} [Sun Aug 28 01:56:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:56:14.397590 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2dd0b7-36c4-47de-a281-d5c80e55eadf None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:56:14.398112 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2dd0b7-36c4-47de-a281-d5c80e55eadf None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:56:14.398112 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2dd0b7-36c4-47de-a281-d5c80e55eadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:56:14.419114 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-ab2dd0b7-36c4-47de-a281-d5c80e55eadf None None] MFA Rules not processed for user `3dc0655c8156457a8fcb006c9fe85eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:56:14.420334 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-ab2dd0b7-36c4-47de-a281-d5c80e55eadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:56:14.430742 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1486/2964] 10.222.0.49 () {58 vars in 1009 bytes} [Sun Aug 28 01:56:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:56:14.442811 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14983a-0156-462b-b513-0fa082493c9d None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:56:14.443097 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14983a-0156-462b-b513-0fa082493c9d None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:56:14.443363 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14983a-0156-462b-b513-0fa082493c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:56:14.494658 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-6b14983a-0156-462b-b513-0fa082493c9d None None] MFA Rules not processed for user `22053bd9632346aab63814f740415f69`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:56:14.495970 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-6b14983a-0156-462b-b513-0fa082493c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:56:14.565615 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1479/2965] 10.222.0.49 () {58 vars in 1064 bytes} [Sun Aug 28 01:56:14 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:56:14.571819 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2dd0b7-36c4-47de-a281-d5c80e55eadf None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:56:14.581922 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2dd0b7-36c4-47de-a281-d5c80e55eadf None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:56:14.585622 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84905b3e-5a59-4f7a-af38-41d08035632c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22053bd9632346aab63814f740415f69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:56:14.586232 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84905b3e-5a59-4f7a-af38-41d08035632c service glance] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:56:14.586508 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84905b3e-5a59-4f7a-af38-41d08035632c service glance] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:56:14.586780 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84905b3e-5a59-4f7a-af38-41d08035632c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:56:14.596861 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84905b3e-5a59-4f7a-af38-41d08035632c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:56:14.598309 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84905b3e-5a59-4f7a-af38-41d08035632c service glance] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:56:14.608853 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1487/2966] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:56:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:56:18.109101 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b882f8-cf60-4e4d-88c7-bbc59ea4890c None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:56:18.109587 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b882f8-cf60-4e4d-88c7-bbc59ea4890c None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:56:18.109700 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b882f8-cf60-4e4d-88c7-bbc59ea4890c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:56:18.160958 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-57b882f8-cf60-4e4d-88c7-bbc59ea4890c None None] MFA Rules not processed for user `cbe0653ed0c04a9080b5c337392de8ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:56:18.162170 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-57b882f8-cf60-4e4d-88c7-bbc59ea4890c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:56:18.180479 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1480/2967] 10.222.0.49 () {58 vars in 1009 bytes} [Sun Aug 28 01:56:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:56:18.222207 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84905b3e-5a59-4f7a-af38-41d08035632c service glance] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:56:18.243490 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84905b3e-5a59-4f7a-af38-41d08035632c service glance] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:56:18.248753 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6430fd0c-49d9-42ce-b9ad-68e991bbdb06 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ce463b940db4f83a6df7e0561a88567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:56:18.249383 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6430fd0c-49d9-42ce-b9ad-68e991bbdb06 service swift] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:56:18.249669 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6430fd0c-49d9-42ce-b9ad-68e991bbdb06 service swift] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:56:18.249933 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6430fd0c-49d9-42ce-b9ad-68e991bbdb06 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:56:18.261333 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6430fd0c-49d9-42ce-b9ad-68e991bbdb06 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:56:18.262887 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6430fd0c-49d9-42ce-b9ad-68e991bbdb06 service swift] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:56:18.271602 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1488/2968] 10.222.0.49 () {60 vars in 1384 bytes} [Sun Aug 28 01:56:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:56:20.381169 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a69ff79-7cb9-4693-8c49-6eec800bc809 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:56:20.382189 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a69ff79-7cb9-4693-8c49-6eec800bc809 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:56:20.382718 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a69ff79-7cb9-4693-8c49-6eec800bc809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:56:20.410437 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-7a69ff79-7cb9-4693-8c49-6eec800bc809 None None] MFA Rules not processed for user `3dc0655c8156457a8fcb006c9fe85eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:56:20.411869 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-7a69ff79-7cb9-4693-8c49-6eec800bc809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:56:20.434973 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1481/2969] 10.222.0.49 () {58 vars in 1018 bytes} [Sun Aug 28 01:56:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:56:20.459711 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c7eb0-54d6-45e1-9844-246c914b5230 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:56:20.460450 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c7eb0-54d6-45e1-9844-246c914b5230 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:56:20.460450 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c7eb0-54d6-45e1-9844-246c914b5230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:56:20.493656 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-da9c7eb0-54d6-45e1-9844-246c914b5230 None None] MFA Rules not processed for user `3dc0655c8156457a8fcb006c9fe85eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:56:20.494918 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-da9c7eb0-54d6-45e1-9844-246c914b5230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:56:20.505132 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1489/2970] 10.222.0.49 () {58 vars in 1059 bytes} [Sun Aug 28 01:56:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:56:20.512295 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a69ff79-7cb9-4693-8c49-6eec800bc809 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:56:20.523921 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a69ff79-7cb9-4693-8c49-6eec800bc809 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:56:20.531622 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790cb7fa-effd-4725-bfb4-b94f9ec4a94a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:56:20.532710 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790cb7fa-effd-4725-bfb4-b94f9ec4a94a service nova] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:56:20.533156 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790cb7fa-effd-4725-bfb4-b94f9ec4a94a service nova] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:56:20.533590 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790cb7fa-effd-4725-bfb4-b94f9ec4a94a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:56:20.545299 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790cb7fa-effd-4725-bfb4-b94f9ec4a94a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:56:20.547978 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790cb7fa-effd-4725-bfb4-b94f9ec4a94a service nova] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:56:20.559728 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1482/2971] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:56:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:56:27.180720 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac162b-14ae-4284-8136-306612d69095 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:56:27.181276 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac162b-14ae-4284-8136-306612d69095 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:56:27.181468 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac162b-14ae-4284-8136-306612d69095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:56:27.202203 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-a7ac162b-14ae-4284-8136-306612d69095 None None] MFA Rules not processed for user `cbe0653ed0c04a9080b5c337392de8ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:56:27.203405 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-a7ac162b-14ae-4284-8136-306612d69095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:56:27.211066 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1490/2972] 10.222.0.49 () {58 vars in 967 bytes} [Sun Aug 28 01:56:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:56:27.223396 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790cb7fa-effd-4725-bfb4-b94f9ec4a94a service nova] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:56:27.235231 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790cb7fa-effd-4725-bfb4-b94f9ec4a94a service nova] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:56:27.241240 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48027016-1b5e-4074-8ef5-1ed620a616ca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ce463b940db4f83a6df7e0561a88567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:56:27.241850 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48027016-1b5e-4074-8ef5-1ed620a616ca service swift] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:56:27.242129 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48027016-1b5e-4074-8ef5-1ed620a616ca service swift] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:56:27.242395 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48027016-1b5e-4074-8ef5-1ed620a616ca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:56:27.250560 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48027016-1b5e-4074-8ef5-1ed620a616ca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:56:27.252181 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48027016-1b5e-4074-8ef5-1ed620a616ca service swift] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:56:27.260151 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1483/2973] 10.222.0.49 () {60 vars in 1384 bytes} [Sun Aug 28 01:56:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:56:28.405558 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e67c4b7-cfa5-4a78-84d9-97639d766d4e None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:56:28.406074 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e67c4b7-cfa5-4a78-84d9-97639d766d4e None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:56:28.406186 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e67c4b7-cfa5-4a78-84d9-97639d766d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:56:28.428258 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-5e67c4b7-cfa5-4a78-84d9-97639d766d4e None None] MFA Rules not processed for user `3dc0655c8156457a8fcb006c9fe85eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:56:28.429473 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-5e67c4b7-cfa5-4a78-84d9-97639d766d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:56:28.443012 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1491/2974] 10.222.0.49 () {58 vars in 1018 bytes} [Sun Aug 28 01:56:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:56:28.455520 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48027016-1b5e-4074-8ef5-1ed620a616ca service swift] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:56:28.468401 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48027016-1b5e-4074-8ef5-1ed620a616ca service swift] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:56:28.473979 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108e09cd-bcf2-4ba3-9b8b-973dbe710c33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:56:28.474637 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e09cd-bcf2-4ba3-9b8b-973dbe710c33 service nova] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:56:28.474926 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e09cd-bcf2-4ba3-9b8b-973dbe710c33 service nova] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:56:28.475198 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e09cd-bcf2-4ba3-9b8b-973dbe710c33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:56:28.485118 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108e09cd-bcf2-4ba3-9b8b-973dbe710c33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:56:28.487202 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108e09cd-bcf2-4ba3-9b8b-973dbe710c33 service nova] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:56:28.501375 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1484/2975] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:56:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:56:28.628493 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa6be7-59d9-4edc-b0fd-9357d3378244 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:56:28.628782 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa6be7-59d9-4edc-b0fd-9357d3378244 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:56:28.629059 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa6be7-59d9-4edc-b0fd-9357d3378244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:56:28.648306 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-a4aa6be7-59d9-4edc-b0fd-9357d3378244 None None] MFA Rules not processed for user `3dc0655c8156457a8fcb006c9fe85eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:56:28.649511 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-a4aa6be7-59d9-4edc-b0fd-9357d3378244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:56:28.659028 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1492/2976] 10.222.0.49 () {58 vars in 1009 bytes} [Sun Aug 28 01:56:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:56:28.670532 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108e09cd-bcf2-4ba3-9b8b-973dbe710c33 service nova] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:56:28.679955 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108e09cd-bcf2-4ba3-9b8b-973dbe710c33 service nova] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:56:28.684048 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec94a172-28c7-416f-a129-2341a4ac11f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:56:28.684648 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec94a172-28c7-416f-a129-2341a4ac11f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:56:28.684925 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec94a172-28c7-416f-a129-2341a4ac11f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:56:28.685196 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec94a172-28c7-416f-a129-2341a4ac11f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:56:28.695676 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec94a172-28c7-416f-a129-2341a4ac11f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:56:28.697117 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec94a172-28c7-416f-a129-2341a4ac11f4 service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:56:28.703697 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=100 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:56:28.709261 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1485/2977] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:56:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:56:29.866421 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099684b4-f33e-401f-b341-ca5d6b33eb54 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:56:29.866888 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099684b4-f33e-401f-b341-ca5d6b33eb54 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:56:29.866994 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099684b4-f33e-401f-b341-ca5d6b33eb54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:56:29.887370 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-099684b4-f33e-401f-b341-ca5d6b33eb54 None None] MFA Rules not processed for user `2d14dcd0cb25427291ab8831924184e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:56:29.888612 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-099684b4-f33e-401f-b341-ca5d6b33eb54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:56:29.895802 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1493/2978] 10.222.0.47 () {58 vars in 1015 bytes} [Sun Aug 28 01:56:29 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:56:29.908759 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec94a172-28c7-416f-a129-2341a4ac11f4 service neutron] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:56:29.918706 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec94a172-28c7-416f-a129-2341a4ac11f4 service neutron] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:56:29.922744 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc3951-9ce6-4e83-bb76-d6152db42c5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d14dcd0cb25427291ab8831924184e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:56:29.923376 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc3951-9ce6-4e83-bb76-d6152db42c5c service neutron] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:56:29.923806 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc3951-9ce6-4e83-bb76-d6152db42c5c service neutron] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:56:29.924080 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dc3951-9ce6-4e83-bb76-d6152db42c5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:56:29.931592 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dc3951-9ce6-4e83-bb76-d6152db42c5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:56:29.933670 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dc3951-9ce6-4e83-bb76-d6152db42c5c service neutron] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:56:29.942194 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1486/2979] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:56:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:56:30.987029 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4dab5c-2b70-4741-90be-d36bda505220 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:56:30.987598 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4dab5c-2b70-4741-90be-d36bda505220 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:56:30.987598 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4dab5c-2b70-4741-90be-d36bda505220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:56:31.012718 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-fe4dab5c-2b70-4741-90be-d36bda505220 None None] MFA Rules not processed for user `3dc0655c8156457a8fcb006c9fe85eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:56:31.013957 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-fe4dab5c-2b70-4741-90be-d36bda505220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:56:31.025261 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1494/2980] 10.222.0.49 () {58 vars in 1018 bytes} [Sun Aug 28 01:56:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:56:31.037886 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc3951-9ce6-4e83-bb76-d6152db42c5c service neutron] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:56:31.051589 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dc3951-9ce6-4e83-bb76-d6152db42c5c service neutron] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:56:31.057745 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a40860-c2cd-43ea-adff-e373324a2742 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3dc0655c8156457a8fcb006c9fe85eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:56:31.058365 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a40860-c2cd-43ea-adff-e373324a2742 service nova] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:56:31.058642 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a40860-c2cd-43ea-adff-e373324a2742 service nova] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:56:31.058912 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a40860-c2cd-43ea-adff-e373324a2742 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:56:31.068919 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a40860-c2cd-43ea-adff-e373324a2742 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:56:31.070516 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a40860-c2cd-43ea-adff-e373324a2742 service nova] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:56:31.081421 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1487/2981] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:56:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:56:32.229468 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1552e0-df59-4bd3-8036-e18d6a62f575 None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:56:32.229976 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1552e0-df59-4bd3-8036-e18d6a62f575 None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:56:32.229976 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1552e0-df59-4bd3-8036-e18d6a62f575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:56:32.249901 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-1c1552e0-df59-4bd3-8036-e18d6a62f575 None None] MFA Rules not processed for user `cbe0653ed0c04a9080b5c337392de8ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:56:32.251103 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-1c1552e0-df59-4bd3-8036-e18d6a62f575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:56:32.259892 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1495/2982] 10.222.0.49 () {58 vars in 967 bytes} [Sun Aug 28 01:56:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:56:32.272388 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a40860-c2cd-43ea-adff-e373324a2742 service nova] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:56:32.284995 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a40860-c2cd-43ea-adff-e373324a2742 service nova] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:56:32.291528 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0246af-1286-420f-bdd8-2c21fcf15d4d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ce463b940db4f83a6df7e0561a88567', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:56:32.292191 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0246af-1286-420f-bdd8-2c21fcf15d4d service swift] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:56:32.292497 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0246af-1286-420f-bdd8-2c21fcf15d4d service swift] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:56:32.292774 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0246af-1286-420f-bdd8-2c21fcf15d4d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:56:32.301860 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0246af-1286-420f-bdd8-2c21fcf15d4d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:56:32.303629 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0246af-1286-420f-bdd8-2c21fcf15d4d service swift] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:56:32.312002 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1488/2983] 10.222.0.49 () {60 vars in 1384 bytes} [Sun Aug 28 01:56:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 28 01:56:40.605830 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba6c82d-2a98-4c0d-928a-60659f30c5cd None None] REQUEST_METHOD: `POST` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:56:40.606373 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba6c82d-2a98-4c0d-928a-60659f30c5cd None None] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:56:40.606373 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba6c82d-2a98-4c0d-928a-60659f30c5cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:56:40.614256 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=41 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:56:40.629220 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.auth.core [None req-6ba6c82d-2a98-4c0d-928a-60659f30c5cd None None] MFA Rules not processed for user `8f4fc1d11f5641b0b5f301b234282aa9`. Rule list: `[]` (Enabled: `True`). {{(pid=81807) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:56:40.630737 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-6ba6c82d-2a98-4c0d-928a-60659f30c5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:56:40.640757 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1496/2984] 10.222.0.49 () {58 vars in 1018 bytes} [Sun Aug 28 01:56:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:56:40.655007 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3007fdc-bf21-4ff5-8cc6-cf96e26e4eb5 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:56:40.655552 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3007fdc-bf21-4ff5-8cc6-cf96e26e4eb5 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:56:40.655552 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3007fdc-bf21-4ff5-8cc6-cf96e26e4eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:56:40.678069 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-c3007fdc-bf21-4ff5-8cc6-cf96e26e4eb5 None None] MFA Rules not processed for user `8f4fc1d11f5641b0b5f301b234282aa9`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:56:40.679348 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-c3007fdc-bf21-4ff5-8cc6-cf96e26e4eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:56:40.692973 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1489/2985] 10.222.0.49 () {58 vars in 1058 bytes} [Sun Aug 28 01:56:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 28 01:56:40.699461 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba6c82d-2a98-4c0d-928a-60659f30c5cd None None] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:56:40.710490 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba6c82d-2a98-4c0d-928a-60659f30c5cd None None] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:56:40.719375 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bc7d2f-f17c-45fa-ba79-bb7e8a269622 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4fc1d11f5641b0b5f301b234282aa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:56:40.720157 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc7d2f-f17c-45fa-ba79-bb7e8a269622 service placement] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:56:40.720288 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc7d2f-f17c-45fa-ba79-bb7e8a269622 service placement] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:56:40.720553 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc7d2f-f17c-45fa-ba79-bb7e8a269622 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:56:40.731631 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bc7d2f-f17c-45fa-ba79-bb7e8a269622 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:56:40.733352 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bc7d2f-f17c-45fa-ba79-bb7e8a269622 service placement] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:56:40.743323 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1497/2986] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:56:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:56:43.507714 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846c2a1-9aed-4e13-9efb-8d37d3fc78e9 None None] REQUEST_METHOD: `POST` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:56:43.508658 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846c2a1-9aed-4e13-9efb-8d37d3fc78e9 None None] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:56:43.508939 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846c2a1-9aed-4e13-9efb-8d37d3fc78e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:56:43.531212 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.auth.core [None req-9846c2a1-9aed-4e13-9efb-8d37d3fc78e9 None None] MFA Rules not processed for user `8f4fc1d11f5641b0b5f301b234282aa9`. Rule list: `[]` (Enabled: `True`). {{(pid=81808) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 28 01:56:43.532580 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-9846c2a1-9aed-4e13-9efb-8d37d3fc78e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:56:43.544600 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1490/2987] 10.222.0.49 () {58 vars in 1018 bytes} [Sun Aug 28 01:56:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 28 01:56:43.563557 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bc7d2f-f17c-45fa-ba79-bb7e8a269622 service placement] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:56:43.579808 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bc7d2f-f17c-45fa-ba79-bb7e8a269622 service placement] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:56:43.588823 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ddb8e-f367-465b-9150-b866fd1bc383 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4fc1d11f5641b0b5f301b234282aa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:56:43.588823 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ddb8e-f367-465b-9150-b866fd1bc383 service placement] REQUEST_METHOD: `GET` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:56:43.588823 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ddb8e-f367-465b-9150-b866fd1bc383 service placement] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:56:43.588823 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ddb8e-f367-465b-9150-b866fd1bc383 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:56:43.599734 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ddb8e-f367-465b-9150-b866fd1bc383 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:56:43.601545 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ddb8e-f367-465b-9150-b866fd1bc383 service placement] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:56:43.613444 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1498/2988] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:56:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 28 01:56:43.900603 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9846c2a1-9aed-4e13-9efb-8d37d3fc78e9 None None] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:56:43.988343 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9846c2a1-9aed-4e13-9efb-8d37d3fc78e9 None None] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:56:43.993948 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04676822-3ba7-49e3-8711-dac4c084c960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:56:43.994579 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04676822-3ba7-49e3-8711-dac4c084c960 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:56:43.994851 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04676822-3ba7-49e3-8711-dac4c084c960 admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:56:43.995113 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04676822-3ba7-49e3-8711-dac4c084c960 admin admin] PATH_INFO: `/v3/users/04fa4b08456c4f5b8302cbb9ccc37219` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:56:43.996365 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04676822-3ba7-49e3-8711-dac4c084c960 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04fa4b08456c4f5b8302cbb9ccc37219)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:56:43.998290 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04676822-3ba7-49e3-8711-dac4c084c960 admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:56:44.059082 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-04676822-3ba7-49e3-8711-dac4c084c960 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04fa4b08456c4f5b8302cbb9ccc37219'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:56:44.068232 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-04676822-3ba7-49e3-8711-dac4c084c960 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04fa4b08456c4f5b8302cbb9ccc37219'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:56:44.080712 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-04676822-3ba7-49e3-8711-dac4c084c960 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04fa4b08456c4f5b8302cbb9ccc37219'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:56:44.081395 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-04676822-3ba7-49e3-8711-dac4c084c960 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04fa4b08456c4f5b8302cbb9ccc37219'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:56:44.082055 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-04676822-3ba7-49e3-8711-dac4c084c960 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04fa4b08456c4f5b8302cbb9ccc37219'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:56:44.094248 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1491/2989] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 01:56:43 2022] DELETE /identity/v3/users/04fa4b08456c4f5b8302cbb9ccc37219 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:56:44.267219 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ddb8e-f367-465b-9150-b866fd1bc383 service placement] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:56:44.278650 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ddb8e-f367-465b-9150-b866fd1bc383 service placement] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:56:44.338391 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d1d9c4-7aa9-477b-833e-e85f29f718db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:56:44.339078 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d1d9c4-7aa9-477b-833e-e85f29f718db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:56:44.339457 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d1d9c4-7aa9-477b-833e-e85f29f718db admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:56:44.339767 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d1d9c4-7aa9-477b-833e-e85f29f718db admin admin] PATH_INFO: `/v3/projects/95f6f0af13614cfda966b6650d21e64b` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:56:44.340907 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d1d9c4-7aa9-477b-833e-e85f29f718db admin admin] RBAC: Authorizing `identity:delete_project(project_id=95f6f0af13614cfda966b6650d21e64b)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:56:44.342822 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d1d9c4-7aa9-477b-833e-e85f29f718db admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:56:44.393097 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-38d1d9c4-7aa9-477b-833e-e85f29f718db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95f6f0af13614cfda966b6650d21e64b', 'request_id': 'req-38d1d9c4-7aa9-477b-833e-e85f29f718db'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:56:44.399232 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-38d1d9c4-7aa9-477b-833e-e85f29f718db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95f6f0af13614cfda966b6650d21e64b', 'request_id': 'req-38d1d9c4-7aa9-477b-833e-e85f29f718db'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:56:44.408688 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-38d1d9c4-7aa9-477b-833e-e85f29f718db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95f6f0af13614cfda966b6650d21e64b', 'request_id': 'req-38d1d9c4-7aa9-477b-833e-e85f29f718db'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:56:44.431878 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-38d1d9c4-7aa9-477b-833e-e85f29f718db admin admin] The token cache is being invalidate because project 95f6f0af13614cfda966b6650d21e64b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81807) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:56:44.432168 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-38d1d9c4-7aa9-477b-833e-e85f29f718db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:56:44.432852 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-38d1d9c4-7aa9-477b-833e-e85f29f718db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:56:44.434400 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1499/2990] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 01:56:44 2022] DELETE /identity/v3/projects/95f6f0af13614cfda966b6650d21e64b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:56:44.438635 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04676822-3ba7-49e3-8711-dac4c084c960 admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:56:44.440179 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-04676822-3ba7-49e3-8711-dac4c084c960 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:56:44.453321 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04676822-3ba7-49e3-8711-dac4c084c960 admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:56:44.458385 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:56:44.515591 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ada5d2-77d4-4b99-8a9d-012d89f24b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:56:44.516303 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ada5d2-77d4-4b99-8a9d-012d89f24b5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:56:44.516523 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ada5d2-77d4-4b99-8a9d-012d89f24b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:56:44.516798 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ada5d2-77d4-4b99-8a9d-012d89f24b5f admin admin] PATH_INFO: `/v3/users/35c8613b5ba847d486b5649b08c3aedd` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:56:44.518022 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ada5d2-77d4-4b99-8a9d-012d89f24b5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=35c8613b5ba847d486b5649b08c3aedd)` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:56:44.520117 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ada5d2-77d4-4b99-8a9d-012d89f24b5f admin admin] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:56:44.570920 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-04ada5d2-77d4-4b99-8a9d-012d89f24b5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35c8613b5ba847d486b5649b08c3aedd'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:56:44.580641 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-04ada5d2-77d4-4b99-8a9d-012d89f24b5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35c8613b5ba847d486b5649b08c3aedd'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:56:44.593963 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-04ada5d2-77d4-4b99-8a9d-012d89f24b5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35c8613b5ba847d486b5649b08c3aedd'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:56:44.594646 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-04ada5d2-77d4-4b99-8a9d-012d89f24b5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35c8613b5ba847d486b5649b08c3aedd'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:56:44.595261 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.notifications [None req-04ada5d2-77d4-4b99-8a9d-012d89f24b5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35c8613b5ba847d486b5649b08c3aedd'} {{(pid=81808) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:56:44.607429 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1492/2991] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 28 01:56:44 2022] DELETE /identity/v3/users/35c8613b5ba847d486b5649b08c3aedd => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:56:44.785892 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d1d9c4-7aa9-477b-833e-e85f29f718db admin admin] Authenticating user token {{(pid=81807) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:56:44.787396 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.fernet_utils [None req-38d1d9c4-7aa9-477b-833e-e85f29f718db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81807) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:56:44.801828 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d1d9c4-7aa9-477b-833e-e85f29f718db admin admin] Validating token access rules against request {{(pid=81807) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:56:44.849258 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:56:44.862618 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4cba09-31e4-4c98-8de4-ae5eb1d7622e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8474eba1fd11486db87ca8aa2a114668', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8f4ff55387564b158cecc09304291ac9', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81807) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:56:44.863251 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4cba09-31e4-4c98-8de4-ae5eb1d7622e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:56:44.863527 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4cba09-31e4-4c98-8de4-ae5eb1d7622e admin admin] SCRIPT_NAME: `/identity` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:56:44.863838 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4cba09-31e4-4c98-8de4-ae5eb1d7622e admin admin] PATH_INFO: `/v3/projects/30b3a9324d074d52bb1939420615234d` {{(pid=81807) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:56:44.864955 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4cba09-31e4-4c98-8de4-ae5eb1d7622e admin admin] RBAC: Authorizing `identity:delete_project(project_id=30b3a9324d074d52bb1939420615234d)` {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:56:44.866953 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4cba09-31e4-4c98-8de4-ae5eb1d7622e admin admin] RBAC: Authorization granted {{(pid=81807) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:56:44.916198 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-fe4cba09-31e4-4c98-8de4-ae5eb1d7622e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30b3a9324d074d52bb1939420615234d', 'request_id': 'req-fe4cba09-31e4-4c98-8de4-ae5eb1d7622e'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:56:44.922511 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-fe4cba09-31e4-4c98-8de4-ae5eb1d7622e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30b3a9324d074d52bb1939420615234d', 'request_id': 'req-fe4cba09-31e4-4c98-8de4-ae5eb1d7622e'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:56:44.932580 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-fe4cba09-31e4-4c98-8de4-ae5eb1d7622e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30b3a9324d074d52bb1939420615234d', 'request_id': 'req-fe4cba09-31e4-4c98-8de4-ae5eb1d7622e'} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:56:44.943372 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-fe4cba09-31e4-4c98-8de4-ae5eb1d7622e admin admin] The token cache is being invalidate because project 30b3a9324d074d52bb1939420615234d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81807) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 28 01:56:44.943657 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-fe4cba09-31e4-4c98-8de4-ae5eb1d7622e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:56:44.944332 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG keystone.notifications [None req-fe4cba09-31e4-4c98-8de4-ae5eb1d7622e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81807) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 28 01:56:44.945866 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: [pid: 81807|app: 0|req: 1500/2992] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 28 01:56:44 2022] DELETE /identity/v3/projects/30b3a9324d074d52bb1939420615234d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 28 01:56:54.604102 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=49,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:56:54.940174 dv-neutron-master-2-hyperv devstack@keystone.service[81807]: DEBUG dbcounter [-] [81807] Writing DB stats keystone:SELECT=29,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 28 01:59:02.329100 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ada5d2-77d4-4b99-8a9d-012d89f24b5f admin admin] Authenticating user token {{(pid=81808) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 28 01:59:02.330720 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-04ada5d2-77d4-4b99-8a9d-012d89f24b5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:59:02.438509 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ada5d2-77d4-4b99-8a9d-012d89f24b5f admin admin] Validating token access rules against request {{(pid=81808) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 28 01:59:02.512433 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a558d8ee-4393-4ee6-8530-df193b5c5a07 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f4fc1d11f5641b0b5f301b234282aa9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d6e897c6391486e9c44e9277a3ee823', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81808) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 28 01:59:02.513252 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a558d8ee-4393-4ee6-8530-df193b5c5a07 service placement] REQUEST_METHOD: `GET` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 28 01:59:02.513609 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a558d8ee-4393-4ee6-8530-df193b5c5a07 service placement] SCRIPT_NAME: `/identity` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 28 01:59:02.513954 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a558d8ee-4393-4ee6-8530-df193b5c5a07 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81808) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 28 01:59:02.516671 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.fernet_utils [None req-a558d8ee-4393-4ee6-8530-df193b5c5a07 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81808) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 28 01:59:02.527955 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a558d8ee-4393-4ee6-8530-df193b5c5a07 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 28 01:59:02.529534 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a558d8ee-4393-4ee6-8530-df193b5c5a07 service placement] RBAC: Authorization granted {{(pid=81808) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 28 01:59:02.540136 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: [pid: 81808|app: 0|req: 1493/2993] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 28 01:59:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 28 01:59:12.535510 dv-neutron-master-2-hyperv devstack@keystone.service[81808]: DEBUG dbcounter [-] [81808] Writing DB stats keystone:SELECT=74 {{(pid=81808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}